Jul 10 12:26:16 devstack cinder-volume[75912]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 10 12:26:16 devstack cinder-volume[75912]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 10 12:26:16 devstack cinder-volume[75912]: we strongly recommend against using it for new projects.
Jul 10 12:26:16 devstack cinder-volume[75912]: If you are already using Eventlet, we recommend migrating to a different
Jul 10 12:26:16 devstack cinder-volume[75912]: framework.  For more detail see
Jul 10 12:26:16 devstack cinder-volume[75912]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 10 12:26:16 devstack cinder-volume[75912]:   import eventlet  # noqa
Jul 10 12:26:19 devstack cinder-volume[75912]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75912) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 10 12:26:19 devstack cinder-volume[75912]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75912) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 10 12:26:19 devstack cinder-volume[75912]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75912) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 10 12:26:20 devstack cinder-volume[75912]: INFO dbcounter [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] Registered counter for database cinder
Jul 10 12:26:20 devstack cinder-volume[75912]: DEBUG oslo_db.sqlalchemy.engines [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75912) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 10 12:26:20 devstack cinder-volume[75912]: DEBUG dbcounter [-] [75912] Writer thread running {{(pid=75912) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 10 12:26:20 devstack cinder-volume[75912]: INFO cinder.rpc [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 10 12:26:20 devstack cinder-volume[75912]: INFO cinder.rpc [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 10 12:26:20 devstack cinder-volume[75912]: DEBUG oslo_db.sqlalchemy.engines [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75912) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 10 12:26:20 devstack cinder-volume[75912]: INFO cinder.volume.manager [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] Determined volume DB was empty at startup.
Jul 10 12:26:20 devstack cinder-volume[75912]: DEBUG cinder.volume.manager [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75912) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 10 12:26:20 devstack cinder-volume[75912]: INFO cinder.volume.manager [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] Service not found for updating active_backend_id, assuming default for driver init.
Jul 10 12:26:20 devstack cinder-volume[75912]: WARNING stevedore.named [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 10 12:26:20 devstack cinder-volume[75912]: WARNING castellan.key_manager [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 10 12:26:20 devstack cinder-volume[75912]: WARNING cinder.keymgr.conf_key_mgr [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 10 12:26:20 devstack cinder-volume[75912]: DEBUG cinder.volume.drivers.lvm [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75912) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Jul 10 12:26:20 devstack cinder-volume[75912]: DEBUG oslo_concurrency.processutils [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75912) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_concurrency.processutils [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] CMD "cinder-rtstool verify" returned: 0 in 0.446s {{(pid=75912) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_db.sqlalchemy.engines [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75912) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 10 12:26:21 devstack cinder-volume[75912]: INFO cinder.rpc [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Jul 10 12:26:21 devstack cinder-volume[75912]: INFO cinder.rpc [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Jul 10 12:26:21 devstack cinder-volume[75912]: WARNING stevedore.named [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 10 12:26:21 devstack cinder-volume[75912]: WARNING castellan.key_manager [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 10 12:26:21 devstack cinder-volume[75912]: INFO cinder.volume.manager [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_db.sqlalchemy.engines [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75912) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 10 12:26:21 devstack cinder-volume[75912]: INFO oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] Starting 1 workers
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] Started child 76081 {{(pid=75912) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] Full set of CONF: {{(pid=75912) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] ******************************************************************************** {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 10 12:26:21 devstack cinder-volume[76081]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] Configuration options gathered from: {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] ================================================================================ {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] allow_availability_zone_fallback = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] allow_compression_on_image_upload = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] allowed_direct_url_schemes     = [] {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] api_rate_limit                 = True {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] auth_strategy                  = keystone {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] az_cache_duration              = 3600 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_availability_zone      = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_host                   = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_name                   = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_stats_polling_interval = 60 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backup_api_class               = cinder.backup.api.API {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backup_name_template           = backup-%s {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backup_use_same_host           = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backup_use_temp_snapshot       = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] chap_password                  = **** {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] chap_username                  =  {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] cinder_internal_tenant_project_id = 0c9c778b7c8547998e00d072b68a4cdd {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] cinder_internal_tenant_user_id = 90a75ba0a10d4d158d3dd9e1f239c067 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] cloned_volume_same_az          = True {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] cluster                        = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] compression_format             = gzip {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] compute_api_class              = cinder.compute.nova.API {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] config_dir                     = [] {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] config_source                  = [] {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] control_exchange               = openstack {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] debug                          = True {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] default_availability_zone      = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] default_group_type             = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] default_volume_type            = lvmdriver-1 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] disk_geometry                  = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] driver_client_cert             = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] driver_client_cert_key         = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] driver_data_namespace          = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] driver_ssl_cert_path           = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] driver_ssl_cert_verify         = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] driver_use_ssl                 = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] enable_force_upload            = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] enable_new_services            = True {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] enable_unsupported_driver      = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] enforce_multipath_for_image_xfer = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] filter_function                = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] glance_api_insecure            = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] glance_api_servers             = ['http://192.168.122.185/image'] {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] glance_api_ssl_compression     = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] glance_ca_certificates_file    = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] glance_catalog_info            = image:glance:publicURL {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] glance_certfile                = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] glance_keyfile                 = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] glance_num_retries             = 3 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] glance_request_timeout         = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] goodness_function              = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] graceful_shutdown_timeout      = 5 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[76081]: INFO cinder.volume.manager [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Jul 10 12:26:21 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] group_api_class                = cinder.group.api.API {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] host                           = devstack {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] image_compress_on_upload       = True {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] image_conversion_address_space_limit = 1 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] image_conversion_cpu_limit     = 60 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] image_conversion_disable       = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] image_upload_use_cinder_backend = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] image_upload_use_internal_tenant = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] image_volume_cache_enabled     = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] image_volume_cache_max_count   = 0 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] image_volume_cache_max_size_gb = 0 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] init_host_max_objects_retrieval = 0 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] iscsi_target_flags             =  {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] iscsi_write_cache              = on {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] iser_helper                    = tgtadm {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] iser_ip_address                = 192.168.122.185 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] iser_port                      = 3260 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] log_color                      = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] log_config_append              = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] log_dir                        = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] log_file                       = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] log_options                    = True {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] log_rotate_interval            = 1 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] log_rotate_interval_type       = days {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] log_rotation_type              = none {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] max_age                        = 0 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] max_logfile_count              = 30 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] max_logfile_size_mb            = 200 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] max_over_subscription_ratio    = 20.0 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] message_reap_interval          = 86400 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] message_ttl                    = 2592000 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] migration_create_volume_timeout_secs = 300 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] monkey_patch                   = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] monkey_patch_modules           = [] {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] my_ip                          = 192.168.122.185 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] no_snapshot_gb_quota           = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] num_iser_scan_tries            = 3 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] num_shell_tries                = 3 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] num_volume_device_scan_tries   = 3 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] nvmeof_conn_info_version       = 1 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] nvmet_ns_id                    = 10 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] nvmet_port_id                  = 1 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] osapi_max_limit                = 1000 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] osapi_volume_ext_list          = [] {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] osapi_volume_listen_port       = 8776 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] osapi_volume_use_ssl           = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] osapi_volume_workers           = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] per_volume_size_limit          = -1 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] periodic_fuzzy_delay           = 60 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] periodic_interval              = 60 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] public_endpoint                = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] publish_errors                 = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] quota_backup_gigabytes         = 1000 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] quota_backups                  = 10 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] quota_gigabytes                = 1000 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] quota_groups                   = 10 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] quota_snapshots                = 10 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] quota_volumes                  = 10 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] rate_limit_burst               = 0 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] rate_limit_except_level        = CRITICAL {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] rate_limit_interval            = 0 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] reinit_driver_count            = 3 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] replication_device             = **** {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] report_discard_supported       = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] report_interval                = 120 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] reservation_clean_interval     = 86400 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] reservation_expire             = 86400 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] reserved_image_namespaces      = [] {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] reserved_percentage            = 0 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] rpc_response_timeout           = 120 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] run_external_periodic_tasks    = True {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] scst_target_driver             = iscsi {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] scst_target_iqn_name           = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] service_down_time              = 720 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] shell_completion               = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] snapshot_name_template         = snapshot-%s {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] snapshot_same_host             = True {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] split_loggers                  = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] state_path                     = /opt/stack/data/cinder {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] storage_availability_zone      = nova {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] storage_protocol               = iSCSI {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] syslog_log_facility            = LOG_USER {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] target_helper                  = lioadm {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] target_ip_address              = 192.168.122.185 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] target_port                    = 3260 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] target_protocol                = iscsi {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] target_secondary_ip_addresses  = [] {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] trace_flags                    = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] transport_url                  = **** {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] until_refresh                  = 0 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] use_chap_auth                  = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] use_default_quota_class        = True {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] use_journal                    = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] use_json                       = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] use_multipath_for_image_xfer   = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] use_stderr                     = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] use_syslog                     = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] verify_glance_signatures       = enabled {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] volume_api_class               = cinder.volume.api.API {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] volume_backend_name            = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] volume_clear                   = zero {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] volume_clear_ionice            = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] volume_clear_size              = 0 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] volume_copy_bps_limit          = 0 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] volume_dd_blocksize            = 1M {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] volume_name_template           = volume-%s {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] volume_service_inithost_offload = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] volume_usage_audit_period      = month {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] zoning_mode                    = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_concurrency.disable_process_locking = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] keystone_authtoken.auth_section = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] keystone_authtoken.auth_type   = password {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] keystone_authtoken.auth_version = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] keystone_authtoken.cache       = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] keystone_authtoken.certfile    = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] keystone_authtoken.include_service_catalog = True {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] keystone_authtoken.insecure    = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] keystone_authtoken.interface   = public {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] keystone_authtoken.keyfile     = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] keystone_authtoken.memcache_password =  {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] keystone_authtoken.memcache_username =  {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] keystone_authtoken.region_name = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] keystone_authtoken.service_type = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.185/identity {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] cache.backend                  = dogpile.cache.null {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] cache.backend_argument         = **** {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] cache.backend_expiration_time  = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] cache.config_prefix            = cache.oslo {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] cache.debug_cache_backend      = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] cache.enable_retry_client      = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] cache.enable_socket_keepalive  = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] cache.enabled                  = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] cache.expiration_time          = 600 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] cache.hashclient_retry_attempts = 2 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] cache.memcache_dead_retry      = 300 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] cache.memcache_sasl_enabled    = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] cache.password                 = **** {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] cache.proxies                  = [] {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] cache.redis_db                 = 0 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] cache.redis_server             = localhost:6379 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] cache.retry_attempts           = 2 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] cache.retry_delay              = 0.0 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] cache.socket_keepalive_count   = 1 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] cache.socket_keepalive_idle    = 1 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] cache.socket_keepalive_interval = 1 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] cache.socket_timeout           = 1.0 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] cache.tls_allowed_ciphers      = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] cache.tls_cafile               = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] cache.tls_certfile             = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] cache.tls_enabled              = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] cache.tls_keyfile              = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] cache.username                 = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] coordination.backend_url       = **** {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] database.asyncio_connection    = **** {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] database.asyncio_slave_connection = **** {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] database.backend               = sqlalchemy {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] database.connection            = **** {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] database.connection_debug      = 0 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] database.connection_parameters =  {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] database.connection_recycle_time = 3600 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] database.connection_trace      = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] database.db_inc_retry_interval = True {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] database.db_max_retries        = 20 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] database.db_max_retry_interval = 10 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] database.db_retry_interval     = 1 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] database.max_overflow          = 50 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] database.max_pool_size         = 5 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] database.max_retries           = 10 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] database.mysql_wsrep_sync_wait = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] database.pool_timeout          = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] database.retry_interval        = 10 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] database.slave_connection      = **** {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] database.sqlite_synchronous    = True {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] database.synchronous_reader    = True {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] database.use_db_reconnect      = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] profiler.connection_string     = messaging:// {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] profiler.enabled               = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] profiler.es_doc_type           = notification {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] profiler.es_scroll_size        = 10000 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] profiler.es_scroll_time        = 2m {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] profiler.filter_error_trace    = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] profiler.hmac_keys             = **** {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] profiler.sentinel_service_name = mymaster {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] profiler.socket_timeout        = 0.1 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] profiler.trace_requests        = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] profiler.trace_sqlalchemy      = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] profiler_jaeger.process_tags   = {} {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] profiler_jaeger.service_name_prefix = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] profiler_otlp.service_name_prefix = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_policy.enforce_new_defaults = True {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_policy.enforce_scope      = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_policy.policy_default_rule = default {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] privsep_osbrick.group          = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] privsep_osbrick.helper_command = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] privsep_osbrick.user           = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] cinder_sys_admin.group         = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] cinder_sys_admin.helper_command = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] cinder_sys_admin.user          = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] service_user.auth_section      = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] service_user.auth_type         = password {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] service_user.cafile            = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] service_user.certfile          = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] service_user.collect_timing    = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] service_user.insecure          = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] service_user.keyfile           = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] service_user.send_service_user_token = True {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] service_user.split_loggers     = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] service_user.timeout           = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] glance.auth_section            = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] glance.auth_type               = password {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] glance.certfile                = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] glance.collect_timing          = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] glance.insecure                = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] glance.keyfile                 = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] glance.region_name             = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] glance.split_loggers           = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] glance.timeout                 = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.backend_availability_zone = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.chap_password = **** {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.chap_username =  {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.disk_geometry = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.driver_client_cert = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.driver_client_cert_key = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.driver_data_namespace = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.driver_use_ssl = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.extra_capabilities = {} {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.filter_function = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.goodness_function = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.iscsi_target_flags =  {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.iscsi_write_cache = on {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.iser_helper   = tgtadm {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.iser_ip_address = 192.168.122.185 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.iser_port     = 3260 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.lvm_share_target = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.lvm_type      = auto {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.num_shell_tries = 3 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.replication_device = **** {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.report_discard_supported = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.reserved_percentage = 0 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.target_helper = tgtadm {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.target_ip_address = 192.168.122.185 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.target_port   = 3260 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.target_protocol = iscsi {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.trace_flags   = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.unique_fqdn_network = True {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.use_chap_auth = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.volume_backend_name = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.volume_clear  = zero {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.volume_clear_ionice = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.volume_clear_size = 0 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_reports.file_event_handler = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_reports.log_dir           = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.backend_host       = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.chap_password      = **** {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.chap_username      = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.disk_geometry      = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.driver_client_cert = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack sudo[76085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.extra_capabilities = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.filter_function    = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.goodness_function  = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack sudo[76085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.iser_helper        = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.iser_ip_address    = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.iser_port          = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.lvm_share_target   = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.lvm_type           = auto {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.num_shell_tries    = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.replication_device = **** {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.report_discard_supported = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.reserved_percentage = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.scst_target_driver = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.storage_protocol   = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.target_helper      = lioadm {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.target_ip_address  = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.target_port        = 3260 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.trace_flags        = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.use_chap_auth      = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.volume_clear       = zero {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.volume_clear_size  = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] lvmdriver-1.volumes_dir        = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_messaging_notifications.driver = [] {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_messaging_notifications.retry = -1 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] key_manager.fixed_key          = **** {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] barbican.barbican_api_version  = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] barbican.barbican_endpoint     = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] barbican.barbican_endpoint_type = public {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] barbican.barbican_region_name  = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] barbican.cafile                = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] barbican.certfile              = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] barbican.collect_timing        = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] barbican.insecure              = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] barbican.keyfile               = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] barbican.number_of_retries     = 60 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] barbican.retry_delay           = 1 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] barbican.send_service_user_token = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] barbican.split_loggers         = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] barbican.timeout               = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] barbican.verify_ssl            = True {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] barbican.verify_ssl_path       = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] barbican_service_user.auth_section = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] barbican_service_user.auth_type = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] barbican_service_user.cafile   = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] barbican_service_user.certfile = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] barbican_service_user.collect_timing = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] barbican_service_user.insecure = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] barbican_service_user.keyfile  = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] barbican_service_user.split_loggers = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] barbican_service_user.timeout  = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] vault.approle_role_id          = **** {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] vault.approle_secret_id        = **** {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] vault.kv_mountpoint            = secret {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] vault.kv_path                  = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] vault.kv_version               = 2 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] vault.namespace                = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] vault.root_token_id            = **** {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] vault.ssl_ca_crt_file          = None {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] vault.timeout                  = 60.0 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] vault.use_ssl                  = False {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:26:21 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] ******************************************************************************** {{(pid=75912) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 10 12:26:22 devstack sudo[76085]: pam_unix(sudo:session): session closed for user root
Jul 10 12:26:22 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.688s {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:26:22 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:26:22 devstack sudo[76276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 10 12:26:22 devstack sudo[76276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:26:22 devstack sudo[76276]: pam_unix(sudo:session): session closed for user root
Jul 10 12:26:22 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.678s {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:26:22 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 10 12:26:22 devstack cinder-volume[76081]: INFO cinder.brick.local_dev.lvm [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Jul 10 12:26:22 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:26:22 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:26:22 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:26:22 devstack sudo[76497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 10 12:26:22 devstack sudo[76497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:26:23 devstack sudo[76497]: pam_unix(sudo:session): session closed for user root
Jul 10 12:26:23 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.711s {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:26:23 devstack cinder-volume[76081]: DEBUG cinder.brick.local_dev.lvm [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76081) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Jul 10 12:26:23 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:26:23 devstack sudo[76650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 10 12:26:23 devstack sudo[76650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:26:24 devstack sudo[76650]: pam_unix(sudo:session): session closed for user root
Jul 10 12:26:24 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.171s {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:26:24 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:26:24 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:26:24 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:26:24 devstack sudo[76859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 10 12:26:24 devstack sudo[76859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:26:25 devstack sudo[76859]: pam_unix(sudo:session): session closed for user root
Jul 10 12:26:25 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.651s {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:26:25 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:26:25 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:26:25 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:26:25 devstack sudo[76864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Jul 10 12:26:25 devstack sudo[76864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:26:26 devstack sudo[76864]: pam_unix(sudo:session): session closed for user root
Jul 10 12:26:26 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.704s {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:26:26 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:26:26 devstack sudo[76869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 10 12:26:26 devstack sudo[76869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:26:26 devstack sudo[76869]: pam_unix(sudo:session): session closed for user root
Jul 10 12:26:26 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.662s {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:26:26 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:26:26 devstack sudo[76873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 10 12:26:26 devstack sudo[76873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:26:27 devstack sudo[76873]: pam_unix(sudo:session): session closed for user root
Jul 10 12:26:27 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.809s {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:26:27 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:26:27 devstack sudo[76884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 10 12:26:27 devstack sudo[76884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:26:28 devstack sudo[76884]: pam_unix(sudo:session): session closed for user root
Jul 10 12:26:28 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.749s {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:26:28 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:26:28 devstack sudo[76890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 10 12:26:28 devstack sudo[76890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:26:29 devstack sudo[76890]: pam_unix(sudo:session): session closed for user root
Jul 10 12:26:29 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.796s {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:26:29 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:26:29 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:26:29 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:26:29 devstack sudo[76899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 10 12:26:29 devstack sudo[76899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:26:29 devstack sudo[76899]: pam_unix(sudo:session): session closed for user root
Jul 10 12:26:29 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.656s {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:26:29 devstack cinder-volume[76081]: INFO cinder.volume.drivers.lvm [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Jul 10 12:26:29 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:26:29 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:26:29 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:26:29 devstack sudo[76908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 10 12:26:29 devstack sudo[76908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:26:30 devstack sudo[76908]: pam_unix(sudo:session): session closed for user root
Jul 10 12:26:30 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.784s {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:26:30 devstack cinder-volume[76081]: DEBUG cinder.volume.drivers.lvm [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] Updating volume stats {{(pid=76081) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 10 12:26:30 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:26:30 devstack sudo[77025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 10 12:26:30 devstack sudo[77025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:26:31 devstack sudo[77025]: pam_unix(sudo:session): session closed for user root
Jul 10 12:26:31 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.644s {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:26:31 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:26:31 devstack cinder-volume[75912]: DEBUG dbcounter [-] [75912] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75912) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:26:31 devstack sudo[77165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 10 12:26:31 devstack sudo[77165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:26:32 devstack sudo[77165]: pam_unix(sudo:session): session closed for user root
Jul 10 12:26:32 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.677s {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:26:32 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:26:32 devstack sudo[77176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 10 12:26:32 devstack sudo[77176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:26:32 devstack sudo[77176]: pam_unix(sudo:session): session closed for user root
Jul 10 12:26:32 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.630s {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:26:32 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:26:32 devstack sudo[77180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 10 12:26:32 devstack sudo[77180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:26:33 devstack sudo[77180]: pam_unix(sudo:session): session closed for user root
Jul 10 12:26:33 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.627s {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:26:33 devstack cinder-volume[76081]: INFO cinder.volume.driver [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] Driver hasn't implemented _init_vendor_properties()
Jul 10 12:26:33 devstack cinder-volume[76081]: DEBUG cinder.volume.driver [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76081) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 10 12:26:33 devstack cinder-volume[76081]: DEBUG oslo_db.sqlalchemy.engines [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76081) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 10 12:26:33 devstack cinder-volume[76081]: DEBUG dbcounter [-] [76081] Writer thread running {{(pid=76081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 10 12:26:33 devstack cinder-volume[76081]: DEBUG cinder.db.api [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] Building query based on filter {{(pid=76081) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 10 12:26:33 devstack cinder-volume[76081]: DEBUG cinder.image.image_utils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76081) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 10 12:26:33 devstack cinder-volume[76081]: INFO cinder.keymgr.migration [None req-a3b48e37-54b7-4c89-88ef-15960fb12b87 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 10 12:26:33 devstack cinder-volume[76081]: DEBUG cinder.volume.drivers.lvm [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] Updating volume stats {{(pid=76081) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 10 12:26:33 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:26:33 devstack sudo[77184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 10 12:26:33 devstack sudo[77184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:26:34 devstack sudo[77184]: pam_unix(sudo:session): session closed for user root
Jul 10 12:26:34 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.662s {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:26:34 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:26:34 devstack sudo[77187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 10 12:26:34 devstack sudo[77187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:26:34 devstack sudo[77187]: pam_unix(sudo:session): session closed for user root
Jul 10 12:26:34 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.645s {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:26:34 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:26:34 devstack sudo[77194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 10 12:26:34 devstack sudo[77194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:26:35 devstack sudo[77194]: pam_unix(sudo:session): session closed for user root
Jul 10 12:26:35 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.689s {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:26:35 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:26:35 devstack sudo[77198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 10 12:26:35 devstack sudo[77198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:26:36 devstack sudo[77198]: pam_unix(sudo:session): session closed for user root
Jul 10 12:26:36 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.651s {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:26:36 devstack cinder-volume[76081]: DEBUG cinder.manager [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] Notifying Schedulers of capabilities ... {{(pid=76081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:26:36 devstack cinder-volume[76081]: INFO cinder.volume.manager [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] Driver initialization completed successfully.
Jul 10 12:26:36 devstack cinder-volume[76081]: INFO cinder.manager [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] Initiating service 2 cleanup
Jul 10 12:26:36 devstack cinder-volume[76081]: INFO cinder.manager [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] Service 2 cleanup completed.
Jul 10 12:26:36 devstack cinder-volume[76081]: DEBUG cinder.service [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] Creating RPC server for service cinder-volume {{(pid=76081) start /opt/stack/cinder/cinder/service.py:231}}
Jul 10 12:26:36 devstack cinder-volume[76081]: DEBUG cinder.service [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76081) start /opt/stack/cinder/cinder/service.py:237}}
Jul 10 12:26:36 devstack cinder-volume[76081]: INFO cinder.volume.manager [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Jul 10 12:26:36 devstack cinder-volume[76081]: DEBUG cinder.volume.drivers.lvm [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] Updating volume stats {{(pid=76081) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 10 12:26:36 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:26:36 devstack sudo[77202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 10 12:26:36 devstack sudo[77202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:26:36 devstack sudo[77202]: pam_unix(sudo:session): session closed for user root
Jul 10 12:26:36 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.663s {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:26:36 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:26:36 devstack sudo[77205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 10 12:26:36 devstack sudo[77205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:26:37 devstack sudo[77205]: pam_unix(sudo:session): session closed for user root
Jul 10 12:26:37 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.642s {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:26:37 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:26:37 devstack sudo[77246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 10 12:26:37 devstack sudo[77246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:26:38 devstack sudo[77246]: pam_unix(sudo:session): session closed for user root
Jul 10 12:26:38 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.618s {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:26:38 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:26:38 devstack sudo[77269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 10 12:26:38 devstack sudo[77269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:26:38 devstack sudo[77269]: pam_unix(sudo:session): session closed for user root
Jul 10 12:26:38 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.651s {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:26:38 devstack cinder-volume[76081]: INFO cinder.volume.manager [None req-d74ba1dc-a28f-44b1-800f-dc081e31d0d0 None None] Driver post RPC initialization completed successfully.
Jul 10 12:26:48 devstack cinder-volume[76081]: DEBUG dbcounter [-] [76081] Writing DB stats cinder:SELECT=4 {{(pid=76081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:26:48 devstack cinder-volume[76081]: DEBUG dbcounter [-] [76081] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:27:25 devstack cinder-volume[76081]: DEBUG oslo_service.periodic_task [None req-66feed6c-9af0-4792-83bb-d9ca9bfcf1b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:27:25 devstack cinder-volume[76081]: DEBUG cinder.volume.drivers.lvm [None req-66feed6c-9af0-4792-83bb-d9ca9bfcf1b7 None None] Updating volume stats {{(pid=76081) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 10 12:27:25 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-66feed6c-9af0-4792-83bb-d9ca9bfcf1b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:27:25 devstack sudo[78878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 10 12:27:25 devstack sudo[78878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:27:26 devstack sudo[78878]: pam_unix(sudo:session): session closed for user root
Jul 10 12:27:26 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-66feed6c-9af0-4792-83bb-d9ca9bfcf1b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.631s {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:27:26 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-66feed6c-9af0-4792-83bb-d9ca9bfcf1b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:27:26 devstack sudo[78881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 10 12:27:26 devstack sudo[78881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:27:27 devstack sudo[78881]: pam_unix(sudo:session): session closed for user root
Jul 10 12:27:27 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-66feed6c-9af0-4792-83bb-d9ca9bfcf1b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.630s {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:27:27 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-66feed6c-9af0-4792-83bb-d9ca9bfcf1b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:27:27 devstack sudo[78884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 10 12:27:27 devstack sudo[78884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:27:27 devstack sudo[78884]: pam_unix(sudo:session): session closed for user root
Jul 10 12:27:27 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-66feed6c-9af0-4792-83bb-d9ca9bfcf1b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.642s {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:27:27 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-66feed6c-9af0-4792-83bb-d9ca9bfcf1b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:27:27 devstack sudo[78927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 10 12:27:27 devstack sudo[78927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:27:28 devstack sudo[78927]: pam_unix(sudo:session): session closed for user root
Jul 10 12:27:28 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-66feed6c-9af0-4792-83bb-d9ca9bfcf1b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.623s {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:27:28 devstack cinder-volume[76081]: DEBUG cinder.manager [None req-66feed6c-9af0-4792-83bb-d9ca9bfcf1b7 None None] Notifying Schedulers of capabilities ... {{(pid=76081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:27:28 devstack cinder-volume[76081]: DEBUG oslo_service.periodic_task [None req-66feed6c-9af0-4792-83bb-d9ca9bfcf1b7 None None] Running periodic task VolumeManager._thread_info {{(pid=76081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:27:28 devstack cinder-volume[76081]: DEBUG cinder.volume.manager [None req-66feed6c-9af0-4792-83bb-d9ca9bfcf1b7 None None] thread count: 6 {{(pid=76081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 10 12:27:28 devstack cinder-volume[76081]: DEBUG cinder.volume.manager [None req-66feed6c-9af0-4792-83bb-d9ca9bfcf1b7 None None] thread info: [<_MainThread(MainThread, started 139277131042944)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139277019510080)>, <Thread(Thread-3 (stat_writer), started daemon 139277019479040)>, <Thread(Rabbit-heartbeat, started daemon 139277023308800)>, <Thread(Thread-5 (_runner), started daemon 139277018960448)>, <Thread(Thread-7 (_runner), started daemon 139277019028608)>] {{(pid=76081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 10 12:28:25 devstack cinder-volume[76081]: DEBUG oslo_service.periodic_task [None req-66feed6c-9af0-4792-83bb-d9ca9bfcf1b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:28:25 devstack cinder-volume[76081]: DEBUG cinder.volume.drivers.lvm [None req-66feed6c-9af0-4792-83bb-d9ca9bfcf1b7 None None] Updating volume stats {{(pid=76081) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 10 12:28:25 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-66feed6c-9af0-4792-83bb-d9ca9bfcf1b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:28:25 devstack sudo[82185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 10 12:28:25 devstack sudo[82185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:28:26 devstack sudo[82185]: pam_unix(sudo:session): session closed for user root
Jul 10 12:28:26 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-66feed6c-9af0-4792-83bb-d9ca9bfcf1b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.662s {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:28:26 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-66feed6c-9af0-4792-83bb-d9ca9bfcf1b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:28:26 devstack sudo[82188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 10 12:28:26 devstack sudo[82188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:28:27 devstack sudo[82188]: pam_unix(sudo:session): session closed for user root
Jul 10 12:28:27 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-66feed6c-9af0-4792-83bb-d9ca9bfcf1b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.656s {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:28:27 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-66feed6c-9af0-4792-83bb-d9ca9bfcf1b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:28:27 devstack sudo[82191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 10 12:28:27 devstack sudo[82191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:28:27 devstack sudo[82191]: pam_unix(sudo:session): session closed for user root
Jul 10 12:28:27 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-66feed6c-9af0-4792-83bb-d9ca9bfcf1b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.640s {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:28:27 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-66feed6c-9af0-4792-83bb-d9ca9bfcf1b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:28:27 devstack sudo[82194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 10 12:28:27 devstack sudo[82194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:28:28 devstack sudo[82194]: pam_unix(sudo:session): session closed for user root
Jul 10 12:28:28 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-66feed6c-9af0-4792-83bb-d9ca9bfcf1b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.628s {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:28:28 devstack cinder-volume[76081]: DEBUG cinder.manager [None req-66feed6c-9af0-4792-83bb-d9ca9bfcf1b7 None None] Notifying Schedulers of capabilities ... {{(pid=76081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:28:28 devstack cinder-volume[76081]: DEBUG oslo_service.periodic_task [None req-66feed6c-9af0-4792-83bb-d9ca9bfcf1b7 None None] Running periodic task VolumeManager._thread_info {{(pid=76081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:28:28 devstack cinder-volume[76081]: DEBUG cinder.volume.manager [None req-66feed6c-9af0-4792-83bb-d9ca9bfcf1b7 None None] thread count: 6 {{(pid=76081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 10 12:28:28 devstack cinder-volume[76081]: DEBUG cinder.volume.manager [None req-66feed6c-9af0-4792-83bb-d9ca9bfcf1b7 None None] thread info: [<_MainThread(MainThread, started 139277131042944)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139277019510080)>, <Thread(Thread-3 (stat_writer), started daemon 139277019479040)>, <Thread(Rabbit-heartbeat, started daemon 139277023308800)>, <Thread(Thread-5 (_runner), started daemon 139277018960448)>, <Thread(Thread-7 (_runner), started daemon 139277019028608)>] {{(pid=76081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 10 12:28:48 devstack cinder-volume[76081]: DEBUG dbcounter [-] [76081] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:29:25 devstack cinder-volume[76081]: DEBUG oslo_service.periodic_task [None req-66feed6c-9af0-4792-83bb-d9ca9bfcf1b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:29:25 devstack cinder-volume[76081]: DEBUG cinder.volume.drivers.lvm [None req-66feed6c-9af0-4792-83bb-d9ca9bfcf1b7 None None] Updating volume stats {{(pid=76081) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 10 12:29:25 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-66feed6c-9af0-4792-83bb-d9ca9bfcf1b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:29:25 devstack sudo[84038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 10 12:29:25 devstack sudo[84038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:29:26 devstack sudo[84038]: pam_unix(sudo:session): session closed for user root
Jul 10 12:29:26 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-66feed6c-9af0-4792-83bb-d9ca9bfcf1b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.653s {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:29:26 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-66feed6c-9af0-4792-83bb-d9ca9bfcf1b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:29:26 devstack sudo[84041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 10 12:29:26 devstack sudo[84041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:29:27 devstack sudo[84041]: pam_unix(sudo:session): session closed for user root
Jul 10 12:29:27 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-66feed6c-9af0-4792-83bb-d9ca9bfcf1b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.662s {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:29:27 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-66feed6c-9af0-4792-83bb-d9ca9bfcf1b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:29:27 devstack sudo[84055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 10 12:29:27 devstack sudo[84055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:29:27 devstack sudo[84055]: pam_unix(sudo:session): session closed for user root
Jul 10 12:29:27 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-66feed6c-9af0-4792-83bb-d9ca9bfcf1b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.646s {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:29:27 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-66feed6c-9af0-4792-83bb-d9ca9bfcf1b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:29:27 devstack sudo[84078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 10 12:29:27 devstack sudo[84078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:29:28 devstack sudo[84078]: pam_unix(sudo:session): session closed for user root
Jul 10 12:29:28 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-66feed6c-9af0-4792-83bb-d9ca9bfcf1b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.643s {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:29:28 devstack cinder-volume[76081]: DEBUG cinder.manager [None req-66feed6c-9af0-4792-83bb-d9ca9bfcf1b7 None None] Notifying Schedulers of capabilities ... {{(pid=76081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:30:25 devstack cinder-volume[76081]: DEBUG oslo_service.periodic_task [None req-66feed6c-9af0-4792-83bb-d9ca9bfcf1b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:30:25 devstack cinder-volume[76081]: DEBUG cinder.volume.drivers.lvm [None req-66feed6c-9af0-4792-83bb-d9ca9bfcf1b7 None None] Updating volume stats {{(pid=76081) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 10 12:30:25 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-66feed6c-9af0-4792-83bb-d9ca9bfcf1b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:30:25 devstack sudo[85345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 10 12:30:25 devstack sudo[85345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:30:26 devstack sudo[85345]: pam_unix(sudo:session): session closed for user root
Jul 10 12:30:26 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-66feed6c-9af0-4792-83bb-d9ca9bfcf1b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.663s {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:30:26 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-66feed6c-9af0-4792-83bb-d9ca9bfcf1b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:30:26 devstack sudo[85359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 10 12:30:26 devstack sudo[85359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:30:27 devstack sudo[85359]: pam_unix(sudo:session): session closed for user root
Jul 10 12:30:27 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-66feed6c-9af0-4792-83bb-d9ca9bfcf1b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.652s {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:30:27 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-66feed6c-9af0-4792-83bb-d9ca9bfcf1b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:30:27 devstack sudo[85385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 10 12:30:27 devstack sudo[85385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:30:27 devstack sudo[85385]: pam_unix(sudo:session): session closed for user root
Jul 10 12:30:27 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-66feed6c-9af0-4792-83bb-d9ca9bfcf1b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.665s {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:30:27 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-66feed6c-9af0-4792-83bb-d9ca9bfcf1b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:30:27 devstack sudo[85391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 10 12:30:27 devstack sudo[85391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:30:28 devstack sudo[85391]: pam_unix(sudo:session): session closed for user root
Jul 10 12:30:28 devstack cinder-volume[76081]: DEBUG oslo_concurrency.processutils [None req-66feed6c-9af0-4792-83bb-d9ca9bfcf1b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.642s {{(pid=76081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:30:28 devstack cinder-volume[76081]: DEBUG cinder.manager [None req-66feed6c-9af0-4792-83bb-d9ca9bfcf1b7 None None] Notifying Schedulers of capabilities ... {{(pid=76081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:30:28 devstack cinder-volume[76081]: DEBUG oslo_service.periodic_task [None req-66feed6c-9af0-4792-83bb-d9ca9bfcf1b7 None None] Running periodic task VolumeManager._thread_info {{(pid=76081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:30:28 devstack cinder-volume[76081]: DEBUG cinder.volume.manager [None req-66feed6c-9af0-4792-83bb-d9ca9bfcf1b7 None None] thread count: 6 {{(pid=76081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 10 12:30:28 devstack cinder-volume[76081]: DEBUG cinder.volume.manager [None req-66feed6c-9af0-4792-83bb-d9ca9bfcf1b7 None None] thread info: [<_MainThread(MainThread, started 139277131042944)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139277019510080)>, <Thread(Thread-3 (stat_writer), started daemon 139277019479040)>, <Thread(Rabbit-heartbeat, started daemon 139277023308800)>, <Thread(Thread-5 (_runner), started daemon 139277018960448)>, <Thread(Thread-7 (_runner), started daemon 139277019028608)>] {{(pid=76081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 10 12:30:48 devstack cinder-volume[76081]: DEBUG dbcounter [-] [76081] Writing DB stats cinder:SELECT=1 {{(pid=76081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:30:48 devstack cinder-volume[76081]: DEBUG dbcounter [-] [76081] Writing DB stats cinder:UPDATE=1 {{(pid=76081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:31:00 devstack cinder-volume[75912]: INFO oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] Caught SIGTERM, stopping children
Jul 10 12:31:00 devstack cinder-volume[75912]: DEBUG oslo_concurrency.lockutils [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] Acquiring lock "singleton_lock" {{(pid=75912) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 10 12:31:00 devstack cinder-volume[75912]: DEBUG oslo_concurrency.lockutils [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] Acquired lock "singleton_lock" {{(pid=75912) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 10 12:31:00 devstack cinder-volume[75912]: DEBUG oslo_concurrency.lockutils [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] Releasing lock "singleton_lock" {{(pid=75912) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 10 12:31:00 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] Stop services. {{(pid=75912) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jul 10 12:31:00 devstack cinder-volume[75912]: DEBUG oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] Killing children. {{(pid=75912) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jul 10 12:31:00 devstack cinder-volume[75912]: INFO oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] Waiting on 1 children to exit
Jul 10 12:31:01 devstack cinder-volume[76081]: DEBUG oslo_concurrency.lockutils [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] Acquiring lock "singleton_lock" {{(pid=76081) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 10 12:31:01 devstack cinder-volume[76081]: DEBUG oslo_concurrency.lockutils [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] Acquired lock "singleton_lock" {{(pid=76081) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 10 12:31:01 devstack cinder-volume[76081]: DEBUG oslo_concurrency.lockutils [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] Releasing lock "singleton_lock" {{(pid=76081) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 10 12:31:01 devstack cinder-volume[76081]: WARNING amqp [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 10 12:31:01 devstack cinder-volume[76081]: WARNING amqp [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 10 12:31:01 devstack cinder-volume[75912]: INFO oslo_service.backend._eventlet.service [None req-b9af77bd-aba2-4c65-84ca-986d45c799b0 None None] Child 76081 exited with status 0
Jul 10 12:31:01 devstack cinder-volume[86181]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 10 12:31:01 devstack cinder-volume[86181]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 10 12:31:01 devstack cinder-volume[86181]: we strongly recommend against using it for new projects.
Jul 10 12:31:01 devstack cinder-volume[86181]: If you are already using Eventlet, we recommend migrating to a different
Jul 10 12:31:01 devstack cinder-volume[86181]: framework.  For more detail see
Jul 10 12:31:01 devstack cinder-volume[86181]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 10 12:31:01 devstack cinder-volume[86181]:   import eventlet  # noqa
Jul 10 12:31:03 devstack cinder-volume[86181]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86181) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 10 12:31:03 devstack cinder-volume[86181]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86181) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 10 12:31:03 devstack cinder-volume[86181]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86181) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 10 12:31:04 devstack cinder-volume[86181]: INFO dbcounter [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] Registered counter for database cinder
Jul 10 12:31:04 devstack cinder-volume[86181]: DEBUG oslo_db.sqlalchemy.engines [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86181) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 10 12:31:04 devstack cinder-volume[86181]: DEBUG dbcounter [-] [86181] Writer thread running {{(pid=86181) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 10 12:31:04 devstack cinder-volume[86181]: INFO cinder.rpc [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 10 12:31:04 devstack cinder-volume[86181]: INFO cinder.rpc [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 10 12:31:04 devstack cinder-volume[86181]: DEBUG oslo_db.sqlalchemy.engines [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86181) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 10 12:31:04 devstack cinder-volume[86181]: INFO cinder.volume.manager [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] Determined volume DB was empty at startup.
Jul 10 12:31:04 devstack cinder-volume[86181]: DEBUG cinder.volume.manager [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86181) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 10 12:31:04 devstack cinder-volume[86181]: INFO cinder.volume.manager [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] Service not found for updating active_backend_id, assuming default for driver init.
Jul 10 12:31:04 devstack cinder-volume[86181]: WARNING stevedore.named [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 10 12:31:04 devstack cinder-volume[86181]: WARNING castellan.key_manager [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 10 12:31:04 devstack cinder-volume[86181]: WARNING cinder.keymgr.conf_key_mgr [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 10 12:31:05 devstack cinder-volume[86181]: INFO cinder.volume.manager [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_db.sqlalchemy.engines [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86181) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 10 12:31:05 devstack cinder-volume[86181]: INFO oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] Starting 1 workers
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] Started child 86396 {{(pid=86181) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] Full set of CONF: {{(pid=86181) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] ******************************************************************************** {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] Configuration options gathered from: {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] ================================================================================ {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] allow_availability_zone_fallback = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] allow_compression_on_image_upload = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] allowed_direct_url_schemes     = [] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] api_rate_limit                 = True {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] auth_strategy                  = keystone {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_availability_zone      = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_host                   = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_name                   = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_stats_polling_interval = 60 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backup_api_class               = cinder.backup.api.API {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backup_name_template           = backup-%s {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86396]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backup_use_same_host           = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backup_use_temp_snapshot       = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] chap_password                  = **** {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] chap_username                  =  {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] cinder_internal_tenant_project_id = 0c9c778b7c8547998e00d072b68a4cdd {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] cinder_internal_tenant_user_id = 90a75ba0a10d4d158d3dd9e1f239c067 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] cluster                        = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] compression_format             = gzip {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] compute_api_class              = cinder.compute.nova.API {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] config_dir                     = [] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] config_source                  = [] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] control_exchange               = openstack {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] debug                          = True {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] default_availability_zone      = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] default_group_type             = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] default_volume_type            = QuobyteHD {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] disk_geometry                  = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] driver_client_cert             = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] driver_client_cert_key         = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] driver_data_namespace          = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] driver_ssl_cert_path           = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] driver_ssl_cert_verify         = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] driver_use_ssl                 = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] enable_new_services            = True {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] enable_unsupported_driver      = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] enabled_backends               = ['QuobyteHD'] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] enforce_multipath_for_image_xfer = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] filter_function                = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] glance_api_insecure            = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] glance_api_servers             = ['http://192.168.122.185/image'] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] glance_api_ssl_compression     = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] glance_ca_certificates_file    = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] glance_catalog_info            = image:glance:publicURL {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] glance_certfile                = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] glance_keyfile                 = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] glance_num_retries             = 3 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] glance_request_timeout         = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] goodness_function              = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] graceful_shutdown_timeout      = 5 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] group_api_class                = cinder.group.api.API {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] host                           = devstack {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] image_compress_on_upload       = True {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] image_conversion_address_space_limit = 1 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] image_conversion_cpu_limit     = 60 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] image_conversion_disable       = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] image_upload_use_cinder_backend = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] image_upload_use_internal_tenant = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] image_volume_cache_enabled     = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] image_volume_cache_max_count   = 0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] image_volume_cache_max_size_gb = 0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] init_host_max_objects_retrieval = 0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] instance_format                = [instance: %(uuid)s]  {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] iscsi_target_flags             =  {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] iscsi_write_cache              = on {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] iser_helper                    = tgtadm {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] iser_ip_address                = 192.168.122.185 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] iser_port                      = 3260 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] log_color                      = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] log_config_append              = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] log_dir                        = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] log_file                       = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] log_options                    = True {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] log_rotate_interval            = 1 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] log_rotate_interval_type       = days {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] log_rotation_type              = none {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] max_age                        = 0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] max_logfile_count              = 30 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] max_logfile_size_mb            = 200 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] max_over_subscription_ratio    = 20.0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] message_reap_interval          = 86400 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] message_ttl                    = 2592000 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] migration_create_volume_timeout_secs = 300 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] monkey_patch                   = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] monkey_patch_modules           = [] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] my_ip                          = 192.168.122.185 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] no_snapshot_gb_quota           = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] num_iser_scan_tries            = 3 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] num_shell_tries                = 3 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] num_volume_device_scan_tries   = 3 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] nvmeof_conn_info_version       = 1 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] nvmet_ns_id                    = 10 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] nvmet_port_id                  = 1 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] osapi_max_limit                = 1000 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] osapi_volume_ext_list          = [] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] osapi_volume_listen_port       = 8776 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] osapi_volume_use_ssl           = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] osapi_volume_workers           = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] per_volume_size_limit          = -1 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] periodic_fuzzy_delay           = 60 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] periodic_interval              = 60 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] public_endpoint                = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] publish_errors                 = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] quota_backup_gigabytes         = 1000 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] quota_backups                  = 10 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] quota_gigabytes                = 1000 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] quota_groups                   = 10 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] quota_snapshots                = 10 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] quota_volumes                  = 10 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] rate_limit_burst               = 0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] rate_limit_except_level        = CRITICAL {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] rate_limit_interval            = 0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] reinit_driver_count            = 3 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] replication_device             = **** {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] report_discard_supported       = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] report_interval                = 120 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] reservation_clean_interval     = 86400 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] reservation_expire             = 86400 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] reserved_image_namespaces      = [] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] reserved_percentage            = 0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] rpc_response_timeout           = 120 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] run_external_periodic_tasks    = True {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] scst_target_driver             = iscsi {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] scst_target_iqn_name           = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] service_down_time              = 720 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] shell_completion               = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86396]: INFO cinder.volume.manager [None req-4f9f79f3-0c1e-4949-9592-5bd060fed034 None None] Starting volume driver QuobyteDriver (1.1.14)
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] snapshot_name_template         = snapshot-%s {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86396]: DEBUG cinder.volume.drivers.remotefs [None req-4f9f79f3-0c1e-4949-9592-5bd060fed034 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86396) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] split_loggers                  = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] state_path                     = /opt/stack/data/cinder {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] storage_availability_zone      = nova {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] storage_protocol               = iSCSI {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] syslog_log_facility            = LOG_USER {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] target_helper                  = lioadm {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] target_ip_address              = 192.168.122.185 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] target_port                    = 3260 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] target_protocol                = iscsi {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] target_secondary_ip_addresses  = [] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] trace_flags                    = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] transport_url                  = **** {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] until_refresh                  = 0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] use_chap_auth                  = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] use_default_quota_class        = True {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] use_journal                    = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] use_json                       = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] use_multipath_for_image_xfer   = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] use_stderr                     = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] use_syslog                     = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] verify_glance_signatures       = enabled {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] volume_api_class               = cinder.volume.api.API {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] volume_backend_name            = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] volume_clear                   = zero {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] volume_clear_ionice            = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] volume_clear_size              = 0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] volume_copy_bps_limit          = 0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] volume_dd_blocksize            = 1M {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] volume_name_template           = volume-%s {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] volume_service_inithost_offload = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] volume_usage_audit_period      = month {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] zoning_mode                    = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_concurrency.disable_process_locking = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] keystone_authtoken.auth_section = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] keystone_authtoken.auth_type   = password {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] keystone_authtoken.auth_version = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] keystone_authtoken.cache       = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] keystone_authtoken.certfile    = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] keystone_authtoken.include_service_catalog = True {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] keystone_authtoken.insecure    = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] keystone_authtoken.interface   = public {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] keystone_authtoken.keyfile     = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] keystone_authtoken.memcache_password =  {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] keystone_authtoken.memcache_username =  {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] keystone_authtoken.region_name = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] keystone_authtoken.service_type = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.185/identity {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] cache.backend                  = dogpile.cache.null {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] cache.backend_argument         = **** {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] cache.backend_expiration_time  = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] cache.config_prefix            = cache.oslo {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] cache.debug_cache_backend      = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] cache.enable_retry_client      = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] cache.enable_socket_keepalive  = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] cache.enabled                  = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] cache.expiration_time          = 600 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] cache.hashclient_retry_attempts = 2 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] cache.memcache_dead_retry      = 300 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] cache.memcache_pool_maxsize    = 10 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] cache.memcache_sasl_enabled    = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] cache.password                 = **** {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] cache.proxies                  = [] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] cache.redis_db                 = 0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] cache.redis_server             = localhost:6379 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] cache.retry_attempts           = 2 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] cache.retry_delay              = 0.0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] cache.socket_keepalive_count   = 1 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] cache.socket_keepalive_idle    = 1 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] cache.socket_keepalive_interval = 1 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] cache.socket_timeout           = 1.0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] cache.tls_allowed_ciphers      = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] cache.tls_cafile               = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] cache.tls_certfile             = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] cache.tls_enabled              = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] cache.tls_keyfile              = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] cache.username                 = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] coordination.backend_url       = **** {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] database.asyncio_connection    = **** {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] database.asyncio_slave_connection = **** {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] database.backend               = sqlalchemy {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] database.connection            = **** {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] database.connection_debug      = 0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] database.connection_parameters =  {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] database.connection_recycle_time = 3600 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] database.connection_trace      = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] database.db_inc_retry_interval = True {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] database.db_max_retries        = 20 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] database.db_max_retry_interval = 10 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] database.db_retry_interval     = 1 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] database.max_overflow          = 50 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] database.max_pool_size         = 5 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] database.max_retries           = 10 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] database.mysql_wsrep_sync_wait = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] database.pool_timeout          = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] database.retry_interval        = 10 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] database.slave_connection      = **** {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] database.sqlite_synchronous    = True {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] database.synchronous_reader    = True {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] database.use_db_reconnect      = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] profiler.connection_string     = messaging:// {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] profiler.enabled               = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] profiler.es_doc_type           = notification {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] profiler.es_scroll_size        = 10000 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] profiler.es_scroll_time        = 2m {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] profiler.filter_error_trace    = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] profiler.hmac_keys             = **** {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] profiler.sentinel_service_name = mymaster {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] profiler.socket_timeout        = 0.1 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] profiler.trace_requests        = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] profiler.trace_sqlalchemy      = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] profiler_jaeger.process_tags   = {} {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] profiler_jaeger.service_name_prefix = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] profiler_otlp.service_name_prefix = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_policy.enforce_new_defaults = True {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_policy.enforce_scope      = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_policy.policy_default_rule = default {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_policy.policy_file        = policy.yaml {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] privsep_osbrick.group          = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] privsep_osbrick.helper_command = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] privsep_osbrick.user           = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] cinder_sys_admin.group         = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] cinder_sys_admin.helper_command = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] cinder_sys_admin.user          = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] service_user.auth_section      = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] service_user.auth_type         = password {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] service_user.cafile            = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] service_user.certfile          = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] service_user.collect_timing    = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] service_user.insecure          = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] service_user.keyfile           = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] service_user.send_service_user_token = True {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] service_user.split_loggers     = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] service_user.timeout           = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] glance.auth_section            = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] glance.auth_type               = password {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] glance.certfile                = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] glance.collect_timing          = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] glance.insecure                = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] glance.keyfile                 = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] glance.region_name             = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] glance.split_loggers           = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] glance.timeout                 = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.backend_availability_zone = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.chap_password = **** {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.chap_username =  {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.disk_geometry = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.driver_client_cert = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.driver_client_cert_key = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.driver_data_namespace = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.driver_use_ssl = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.extra_capabilities = {} {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.filter_function = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.goodness_function = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.iscsi_target_flags =  {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.iscsi_write_cache = on {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.iser_helper   = tgtadm {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.iser_ip_address = 192.168.122.185 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.iser_port     = 3260 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.nas_host      =  {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.nas_login     = admin {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.nas_mount_options = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.nas_password  = **** {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.nas_private_key =  {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.nas_share_path =  {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.num_shell_tries = 3 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.quobyte_volume_url = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.replication_device = **** {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.report_discard_supported = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.reserved_percentage = 0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.target_helper = tgtadm {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.target_ip_address = 192.168.122.185 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.target_port   = 3260 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.target_protocol = iscsi {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.trace_flags   = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.unique_fqdn_network = True {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.use_chap_auth = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.volume_backend_name = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.volume_clear  = zero {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.volume_clear_ionice = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.volume_clear_size = 0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_reports.file_event_handler = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_reports.log_dir           = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.backend_availability_zone = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.backend_host         = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.chap_password        = **** {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.chap_username        = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.chiscsi_conf         = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.disk_geometry        = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.driver_client_cert   = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.driver_data_namespace = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.driver_use_ssl       = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.extra_capabilities   = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.filter_function      = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.goodness_function    = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.iser_helper          = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.iser_ip_address      = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.iser_port            = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.iser_target_prefix   = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.nas_host             = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.nas_login            = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.nas_mount_options    = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.nas_password         = **** {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.nas_private_key      = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.nas_share_path       = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.nas_ssh_port         = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.num_shell_tries      = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.nvmet_port_id        = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.replication_device   = **** {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.report_discard_supported = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.reserved_percentage  = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.scst_target_driver   = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.storage_protocol     = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.target_helper        = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.target_ip_address    = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.target_port          = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.target_prefix        = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.target_protocol      = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.trace_flags          = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.use_chap_auth        = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.volume_clear         = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.volume_clear_size    = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] QuobyteHD.volumes_dir          = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86396]: DEBUG cinder.volume.drivers.quobyte [None req-4f9f79f3-0c1e-4949-9592-5bd060fed034 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86396) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86396]: WARNING cinder.volume.drivers.quobyte [None req-4f9f79f3-0c1e-4949-9592-5bd060fed034 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86396]: WARNING cinder.volume.drivers.quobyte [None req-4f9f79f3-0c1e-4949-9592-5bd060fed034 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86396]: DEBUG oslo_concurrency.processutils [None req-4f9f79f3-0c1e-4949-9592-5bd060fed034 None None] Running cmd (subprocess): mount.quobyte {{(pid=86396) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_messaging_rabbit.ssl      = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_messaging_notifications.driver = [] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_messaging_notifications.retry = -1 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] key_manager.fixed_key          = **** {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] barbican.barbican_api_version  = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] barbican.barbican_endpoint     = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] barbican.barbican_endpoint_type = public {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] barbican.barbican_region_name  = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] barbican.cafile                = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] barbican.certfile              = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] barbican.collect_timing        = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] barbican.insecure              = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] barbican.keyfile               = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] barbican.number_of_retries     = 60 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] barbican.retry_delay           = 1 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] barbican.send_service_user_token = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] barbican.split_loggers         = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] barbican.timeout               = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] barbican.verify_ssl            = True {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] barbican.verify_ssl_path       = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] barbican_service_user.auth_section = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] barbican_service_user.auth_type = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] barbican_service_user.cafile   = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] barbican_service_user.certfile = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] barbican_service_user.collect_timing = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] barbican_service_user.insecure = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] barbican_service_user.keyfile  = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] barbican_service_user.split_loggers = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] barbican_service_user.timeout  = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] vault.approle_role_id          = **** {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] vault.approle_secret_id        = **** {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] vault.kv_mountpoint            = secret {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] vault.kv_path                  = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] vault.kv_version               = 2 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] vault.namespace                = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] vault.root_token_id            = **** {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] vault.ssl_ca_crt_file          = None {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] vault.timeout                  = 60.0 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] vault.use_ssl                  = False {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:31:05 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] ******************************************************************************** {{(pid=86181) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 10 12:31:05 devstack quobyte-client[86401]: Reading configuration file: /etc/quobyte/client.cfg
Jul 10 12:31:05 devstack quobyte-client[86401]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jul 10 12:31:05 devstack cinder-volume[86396]: DEBUG oslo_concurrency.processutils [None req-4f9f79f3-0c1e-4949-9592-5bd060fed034 None None] CMD "mount.quobyte" returned: 1 in 0.085s {{(pid=86396) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:31:05 devstack cinder-volume[86396]: DEBUG oslo_concurrency.lockutils [None req-4f9f79f3-0c1e-4949-9592-5bd060fed034 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86396) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:31:05 devstack cinder-volume[86396]: DEBUG oslo_concurrency.lockutils [None req-4f9f79f3-0c1e-4949-9592-5bd060fed034 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86396) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:31:05 devstack cinder-volume[86396]: DEBUG cinder.volume.drivers.quobyte [None req-4f9f79f3-0c1e-4949-9592-5bd060fed034 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=86396) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:31:05 devstack cinder-volume[86396]: INFO cinder.volume.drivers.quobyte [None req-4f9f79f3-0c1e-4949-9592-5bd060fed034 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be ...
Jul 10 12:31:05 devstack cinder-volume[86396]: DEBUG oslo_concurrency.processutils [None req-4f9f79f3-0c1e-4949-9592-5bd060fed034 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd -c /etc/quobyte/client-cinder.cfg {{(pid=86396) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:31:05 devstack sudo[86402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd -c /etc/quobyte/client-cinder.cfg
Jul 10 12:31:05 devstack sudo[86402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:31:06 devstack sudo[86402]: pam_unix(sudo:session): session closed for user root
Jul 10 12:31:06 devstack cinder-volume[86396]: DEBUG oslo_concurrency.processutils [None req-4f9f79f3-0c1e-4949-9592-5bd060fed034 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.773s {{(pid=86396) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:31:06 devstack cinder-volume[86396]: INFO cinder.volume.drivers.quobyte [None req-4f9f79f3-0c1e-4949-9592-5bd060fed034 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be succeeded
Jul 10 12:31:06 devstack cinder-volume[86396]: DEBUG cinder.volume.drivers.quobyte [None req-4f9f79f3-0c1e-4949-9592-5bd060fed034 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=86396) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:31:06 devstack cinder-volume[86396]: DEBUG oslo_concurrency.lockutils [None req-4f9f79f3-0c1e-4949-9592-5bd060fed034 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.786s {{(pid=86396) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:31:06 devstack cinder-volume[86396]: DEBUG oslo_concurrency.processutils [None req-4f9f79f3-0c1e-4949-9592-5bd060fed034 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=86396) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:31:06 devstack sudo[86471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:31:06 devstack sudo[86471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:31:06 devstack sudo[86471]: pam_unix(sudo:session): session closed for user root
Jul 10 12:31:06 devstack cinder-volume[86396]: DEBUG oslo_concurrency.processutils [None req-4f9f79f3-0c1e-4949-9592-5bd060fed034 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.666s {{(pid=86396) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:31:06 devstack cinder-volume[86396]: INFO cinder.volume.driver [None req-4f9f79f3-0c1e-4949-9592-5bd060fed034 None None] Driver hasn't implemented _init_vendor_properties()
Jul 10 12:31:06 devstack cinder-volume[86396]: DEBUG cinder.volume.driver [None req-4f9f79f3-0c1e-4949-9592-5bd060fed034 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86396) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 10 12:31:07 devstack cinder-volume[86396]: DEBUG oslo_db.sqlalchemy.engines [None req-4f9f79f3-0c1e-4949-9592-5bd060fed034 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86396) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 10 12:31:07 devstack cinder-volume[86396]: DEBUG dbcounter [-] [86396] Writer thread running {{(pid=86396) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 10 12:31:07 devstack cinder-volume[86396]: DEBUG cinder.db.api [None req-4f9f79f3-0c1e-4949-9592-5bd060fed034 None None] Building query based on filter {{(pid=86396) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 10 12:31:07 devstack cinder-volume[86396]: DEBUG cinder.image.image_utils [None req-4f9f79f3-0c1e-4949-9592-5bd060fed034 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86396) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 10 12:31:07 devstack cinder-volume[86396]: INFO cinder.keymgr.migration [None req-04886b39-80e0-4df3-9205-4fc259f0a05a None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 10 12:31:07 devstack cinder-volume[86396]: DEBUG oslo_concurrency.lockutils [None req-4f9f79f3-0c1e-4949-9592-5bd060fed034 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86396) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:31:07 devstack cinder-volume[86396]: DEBUG oslo_concurrency.lockutils [None req-4f9f79f3-0c1e-4949-9592-5bd060fed034 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86396) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:31:07 devstack cinder-volume[86396]: DEBUG cinder.volume.drivers.quobyte [None req-4f9f79f3-0c1e-4949-9592-5bd060fed034 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=86396) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:31:07 devstack cinder-volume[86396]: DEBUG cinder.volume.drivers.quobyte [None req-4f9f79f3-0c1e-4949-9592-5bd060fed034 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=86396) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:31:07 devstack cinder-volume[86396]: DEBUG oslo_concurrency.lockutils [None req-4f9f79f3-0c1e-4949-9592-5bd060fed034 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86396) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:31:07 devstack cinder-volume[86396]: DEBUG oslo_concurrency.processutils [None req-4f9f79f3-0c1e-4949-9592-5bd060fed034 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=86396) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:31:07 devstack sudo[86474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:31:07 devstack sudo[86474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:31:07 devstack sudo[86474]: pam_unix(sudo:session): session closed for user root
Jul 10 12:31:07 devstack cinder-volume[86396]: DEBUG oslo_concurrency.processutils [None req-4f9f79f3-0c1e-4949-9592-5bd060fed034 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.730s {{(pid=86396) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:31:07 devstack cinder-volume[86396]: DEBUG cinder.manager [None req-4f9f79f3-0c1e-4949-9592-5bd060fed034 None None] Notifying Schedulers of capabilities ... {{(pid=86396) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:31:07 devstack cinder-volume[86396]: INFO cinder.volume.manager [None req-4f9f79f3-0c1e-4949-9592-5bd060fed034 None None] Driver initialization completed successfully.
Jul 10 12:31:07 devstack cinder-volume[86396]: INFO cinder.manager [None req-4f9f79f3-0c1e-4949-9592-5bd060fed034 None None] Initiating service 3 cleanup
Jul 10 12:31:07 devstack cinder-volume[86396]: INFO cinder.manager [None req-4f9f79f3-0c1e-4949-9592-5bd060fed034 None None] Service 3 cleanup completed.
Jul 10 12:31:07 devstack cinder-volume[86396]: DEBUG cinder.service [None req-4f9f79f3-0c1e-4949-9592-5bd060fed034 None None] Creating RPC server for service cinder-volume {{(pid=86396) start /opt/stack/cinder/cinder/service.py:231}}
Jul 10 12:31:07 devstack cinder-volume[86396]: DEBUG cinder.service [None req-4f9f79f3-0c1e-4949-9592-5bd060fed034 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86396) start /opt/stack/cinder/cinder/service.py:237}}
Jul 10 12:31:08 devstack cinder-volume[86396]: INFO cinder.volume.manager [None req-4f9f79f3-0c1e-4949-9592-5bd060fed034 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jul 10 12:31:08 devstack cinder-volume[86396]: DEBUG oslo_concurrency.lockutils [None req-4f9f79f3-0c1e-4949-9592-5bd060fed034 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86396) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:31:08 devstack cinder-volume[86396]: DEBUG oslo_concurrency.lockutils [None req-4f9f79f3-0c1e-4949-9592-5bd060fed034 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86396) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:31:08 devstack cinder-volume[86396]: DEBUG cinder.volume.drivers.quobyte [None req-4f9f79f3-0c1e-4949-9592-5bd060fed034 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=86396) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:31:08 devstack cinder-volume[86396]: DEBUG cinder.volume.drivers.quobyte [None req-4f9f79f3-0c1e-4949-9592-5bd060fed034 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=86396) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:31:08 devstack cinder-volume[86396]: DEBUG oslo_concurrency.lockutils [None req-4f9f79f3-0c1e-4949-9592-5bd060fed034 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86396) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:31:08 devstack cinder-volume[86396]: DEBUG oslo_concurrency.processutils [None req-4f9f79f3-0c1e-4949-9592-5bd060fed034 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=86396) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:31:08 devstack sudo[86521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:31:08 devstack sudo[86521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:31:09 devstack sudo[86521]: pam_unix(sudo:session): session closed for user root
Jul 10 12:31:09 devstack cinder-volume[86396]: DEBUG oslo_concurrency.processutils [None req-4f9f79f3-0c1e-4949-9592-5bd060fed034 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 1.129s {{(pid=86396) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:31:09 devstack cinder-volume[86396]: INFO cinder.volume.manager [None req-4f9f79f3-0c1e-4949-9592-5bd060fed034 None None] Driver post RPC initialization completed successfully.
Jul 10 12:31:12 devstack cinder-volume[86396]: DEBUG oslo_concurrency.lockutils [None req-6ce4c428-20bc-4442-9ab7-e4988e8d5695 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86396) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:31:12 devstack cinder-volume[86396]: DEBUG oslo_concurrency.lockutils [None req-6ce4c428-20bc-4442-9ab7-e4988e8d5695 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86396) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:31:12 devstack cinder-volume[86396]: DEBUG cinder.volume.drivers.quobyte [None req-6ce4c428-20bc-4442-9ab7-e4988e8d5695 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=86396) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:31:12 devstack cinder-volume[86396]: DEBUG cinder.volume.drivers.quobyte [None req-6ce4c428-20bc-4442-9ab7-e4988e8d5695 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=86396) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:31:12 devstack cinder-volume[86396]: DEBUG oslo_concurrency.lockutils [None req-6ce4c428-20bc-4442-9ab7-e4988e8d5695 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86396) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:31:12 devstack cinder-volume[86396]: DEBUG oslo_concurrency.processutils [None req-6ce4c428-20bc-4442-9ab7-e4988e8d5695 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=86396) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:31:12 devstack sudo[86700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:31:12 devstack sudo[86700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:31:12 devstack sudo[86700]: pam_unix(sudo:session): session closed for user root
Jul 10 12:31:12 devstack cinder-volume[86396]: DEBUG oslo_concurrency.processutils [None req-6ce4c428-20bc-4442-9ab7-e4988e8d5695 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.622s {{(pid=86396) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:31:12 devstack cinder-volume[86396]: DEBUG cinder.manager [None req-6ce4c428-20bc-4442-9ab7-e4988e8d5695 None None] Notifying Schedulers of capabilities ... {{(pid=86396) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:31:15 devstack cinder-volume[86181]: DEBUG dbcounter [-] [86181] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86181) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:31:19 devstack cinder-volume[86396]: DEBUG dbcounter [-] [86396] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86396) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:31:19 devstack cinder-volume[86396]: DEBUG dbcounter [-] [86396] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=86396) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:32:09 devstack cinder-volume[86396]: DEBUG oslo_service.periodic_task [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86396) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:32:09 devstack cinder-volume[86396]: DEBUG oslo_concurrency.lockutils [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86396) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:32:09 devstack cinder-volume[86396]: DEBUG oslo_concurrency.lockutils [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86396) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:32:09 devstack cinder-volume[86396]: DEBUG cinder.volume.drivers.quobyte [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=86396) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:32:09 devstack cinder-volume[86396]: DEBUG cinder.volume.drivers.quobyte [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=86396) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:32:09 devstack cinder-volume[86396]: DEBUG oslo_concurrency.lockutils [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86396) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:32:09 devstack cinder-volume[86396]: DEBUG oslo_concurrency.processutils [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=86396) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:32:09 devstack sudo[86928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:32:09 devstack sudo[86928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:32:09 devstack sudo[86928]: pam_unix(sudo:session): session closed for user root
Jul 10 12:32:09 devstack cinder-volume[86396]: DEBUG oslo_concurrency.processutils [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.632s {{(pid=86396) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:32:09 devstack cinder-volume[86396]: DEBUG cinder.manager [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] Notifying Schedulers of capabilities ... {{(pid=86396) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:32:09 devstack cinder-volume[86396]: DEBUG oslo_service.periodic_task [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] Running periodic task VolumeManager._thread_info {{(pid=86396) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:32:09 devstack cinder-volume[86396]: DEBUG cinder.volume.manager [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] thread count: 6 {{(pid=86396) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 10 12:32:09 devstack cinder-volume[86396]: DEBUG cinder.volume.manager [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] thread info: [<_MainThread(MainThread, started 128706741944448)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128706632035072)>, <Thread(Thread-3 (stat_writer), started daemon 128706630266240)>, <Thread(Rabbit-heartbeat, started daemon 128706630214208)>, <Thread(Thread-5 (_runner), started daemon 128706628601792)>, <Thread(Thread-7 (_runner), started daemon 128706630326400)>] {{(pid=86396) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 10 12:33:09 devstack cinder-volume[86396]: DEBUG oslo_service.periodic_task [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86396) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:33:09 devstack cinder-volume[86396]: DEBUG oslo_concurrency.lockutils [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86396) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:33:09 devstack cinder-volume[86396]: DEBUG oslo_concurrency.lockutils [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86396) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:33:09 devstack cinder-volume[86396]: DEBUG cinder.volume.drivers.quobyte [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=86396) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:33:09 devstack cinder-volume[86396]: DEBUG cinder.volume.drivers.quobyte [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=86396) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:33:09 devstack cinder-volume[86396]: DEBUG oslo_concurrency.lockutils [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86396) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:33:09 devstack cinder-volume[86396]: DEBUG oslo_concurrency.processutils [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=86396) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:33:09 devstack sudo[86950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:33:09 devstack sudo[86950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:33:09 devstack sudo[86950]: pam_unix(sudo:session): session closed for user root
Jul 10 12:33:09 devstack cinder-volume[86396]: DEBUG oslo_concurrency.processutils [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.647s {{(pid=86396) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:33:09 devstack cinder-volume[86396]: DEBUG cinder.manager [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] Notifying Schedulers of capabilities ... {{(pid=86396) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:33:09 devstack cinder-volume[86396]: DEBUG oslo_service.periodic_task [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] Running periodic task VolumeManager._thread_info {{(pid=86396) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:33:09 devstack cinder-volume[86396]: DEBUG cinder.volume.manager [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] thread count: 6 {{(pid=86396) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 10 12:33:09 devstack cinder-volume[86396]: DEBUG cinder.volume.manager [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] thread info: [<_MainThread(MainThread, started 128706741944448)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128706632035072)>, <Thread(Thread-3 (stat_writer), started daemon 128706630266240)>, <Thread(Rabbit-heartbeat, started daemon 128706630214208)>, <Thread(Thread-5 (_runner), started daemon 128706628601792)>, <Thread(Thread-7 (_runner), started daemon 128706630326400)>] {{(pid=86396) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 10 12:33:19 devstack cinder-volume[86396]: DEBUG dbcounter [-] [86396] Writing DB stats cinder:SELECT=1 {{(pid=86396) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:33:19 devstack cinder-volume[86396]: DEBUG dbcounter [-] [86396] Writing DB stats cinder:UPDATE=1 {{(pid=86396) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:34:09 devstack cinder-volume[86396]: DEBUG oslo_service.periodic_task [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86396) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:34:09 devstack cinder-volume[86396]: DEBUG oslo_concurrency.lockutils [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86396) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:34:09 devstack cinder-volume[86396]: DEBUG oslo_concurrency.lockutils [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86396) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:34:09 devstack cinder-volume[86396]: DEBUG cinder.volume.drivers.quobyte [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=86396) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:34:09 devstack cinder-volume[86396]: DEBUG cinder.volume.drivers.quobyte [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=86396) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:34:09 devstack cinder-volume[86396]: DEBUG oslo_concurrency.lockutils [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86396) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:34:09 devstack cinder-volume[86396]: DEBUG oslo_concurrency.processutils [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=86396) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:34:09 devstack sudo[87009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:34:09 devstack sudo[87009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:34:09 devstack sudo[87009]: pam_unix(sudo:session): session closed for user root
Jul 10 12:34:09 devstack cinder-volume[86396]: DEBUG oslo_concurrency.processutils [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.633s {{(pid=86396) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:34:09 devstack cinder-volume[86396]: DEBUG cinder.manager [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] Notifying Schedulers of capabilities ... {{(pid=86396) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:34:09 devstack cinder-volume[86396]: DEBUG oslo_service.periodic_task [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] Running periodic task VolumeManager._thread_info {{(pid=86396) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:34:09 devstack cinder-volume[86396]: DEBUG cinder.volume.manager [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] thread count: 6 {{(pid=86396) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 10 12:34:09 devstack cinder-volume[86396]: DEBUG cinder.volume.manager [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] thread info: [<_MainThread(MainThread, started 128706741944448)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128706632035072)>, <Thread(Thread-3 (stat_writer), started daemon 128706630266240)>, <Thread(Rabbit-heartbeat, started daemon 128706630214208)>, <Thread(Thread-5 (_runner), started daemon 128706628601792)>, <Thread(Thread-7 (_runner), started daemon 128706630326400)>] {{(pid=86396) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 10 12:35:09 devstack cinder-volume[86396]: DEBUG oslo_service.periodic_task [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86396) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:35:09 devstack cinder-volume[86396]: DEBUG oslo_concurrency.lockutils [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86396) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:35:09 devstack cinder-volume[86396]: DEBUG oslo_concurrency.lockutils [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86396) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:35:09 devstack cinder-volume[86396]: DEBUG cinder.volume.drivers.quobyte [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=86396) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:35:09 devstack cinder-volume[86396]: DEBUG cinder.volume.drivers.quobyte [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=86396) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:35:09 devstack cinder-volume[86396]: DEBUG oslo_concurrency.lockutils [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86396) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:35:09 devstack cinder-volume[86396]: DEBUG oslo_concurrency.processutils [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=86396) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:35:09 devstack sudo[87075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:35:09 devstack sudo[87075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:35:09 devstack sudo[87075]: pam_unix(sudo:session): session closed for user root
Jul 10 12:35:09 devstack cinder-volume[86396]: DEBUG oslo_concurrency.processutils [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.634s {{(pid=86396) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:35:09 devstack cinder-volume[86396]: DEBUG cinder.manager [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] Notifying Schedulers of capabilities ... {{(pid=86396) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:35:19 devstack cinder-volume[86396]: DEBUG dbcounter [-] [86396] Writing DB stats cinder:SELECT=1 {{(pid=86396) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:35:19 devstack cinder-volume[86396]: DEBUG dbcounter [-] [86396] Writing DB stats cinder:UPDATE=1 {{(pid=86396) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:36:09 devstack cinder-volume[86396]: DEBUG oslo_service.periodic_task [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86396) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:36:09 devstack cinder-volume[86396]: DEBUG oslo_concurrency.lockutils [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86396) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:36:09 devstack cinder-volume[86396]: DEBUG oslo_concurrency.lockutils [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86396) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:36:09 devstack cinder-volume[86396]: DEBUG cinder.volume.drivers.quobyte [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=86396) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:36:09 devstack cinder-volume[86396]: DEBUG cinder.volume.drivers.quobyte [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=86396) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:36:09 devstack cinder-volume[86396]: DEBUG oslo_concurrency.lockutils [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86396) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:36:09 devstack cinder-volume[86396]: DEBUG oslo_concurrency.processutils [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=86396) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:36:09 devstack sudo[87148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:36:09 devstack sudo[87148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:36:09 devstack sudo[87148]: pam_unix(sudo:session): session closed for user root
Jul 10 12:36:09 devstack cinder-volume[86396]: DEBUG oslo_concurrency.processutils [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.641s {{(pid=86396) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:36:09 devstack cinder-volume[86396]: DEBUG cinder.manager [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] Notifying Schedulers of capabilities ... {{(pid=86396) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:36:09 devstack cinder-volume[86396]: DEBUG oslo_service.periodic_task [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] Running periodic task VolumeManager._thread_info {{(pid=86396) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:36:09 devstack cinder-volume[86396]: DEBUG cinder.volume.manager [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] thread count: 6 {{(pid=86396) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 10 12:36:09 devstack cinder-volume[86396]: DEBUG cinder.volume.manager [None req-45288468-f01e-457f-b73c-93e8238554b9 None None] thread info: [<_MainThread(MainThread, started 128706741944448)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128706632035072)>, <Thread(Thread-3 (stat_writer), started daemon 128706630266240)>, <Thread(Rabbit-heartbeat, started daemon 128706630214208)>, <Thread(Thread-5 (_runner), started daemon 128706628601792)>, <Thread(Thread-7 (_runner), started daemon 128706630326400)>] {{(pid=86396) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 10 12:36:10 devstack cinder-volume[86181]: INFO oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] Caught SIGTERM, stopping children
Jul 10 12:36:10 devstack cinder-volume[86181]: DEBUG oslo_concurrency.lockutils [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] Acquiring lock "singleton_lock" {{(pid=86181) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 10 12:36:10 devstack cinder-volume[86181]: DEBUG oslo_concurrency.lockutils [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] Acquired lock "singleton_lock" {{(pid=86181) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 10 12:36:10 devstack cinder-volume[86181]: DEBUG oslo_concurrency.lockutils [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] Releasing lock "singleton_lock" {{(pid=86181) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 10 12:36:10 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] Stop services. {{(pid=86181) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jul 10 12:36:10 devstack cinder-volume[86181]: DEBUG oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] Killing children. {{(pid=86181) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jul 10 12:36:10 devstack cinder-volume[86181]: INFO oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] Waiting on 1 children to exit
Jul 10 12:36:13 devstack cinder-volume[86396]: DEBUG oslo_concurrency.lockutils [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] Acquiring lock "singleton_lock" {{(pid=86396) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 10 12:36:13 devstack cinder-volume[86396]: DEBUG oslo_concurrency.lockutils [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] Acquired lock "singleton_lock" {{(pid=86396) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 10 12:36:13 devstack cinder-volume[86396]: DEBUG oslo_concurrency.lockutils [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] Releasing lock "singleton_lock" {{(pid=86396) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 10 12:36:13 devstack cinder-volume[86396]: WARNING amqp [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 10 12:36:13 devstack cinder-volume[86396]: WARNING amqp [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 10 12:36:13 devstack cinder-volume[86181]: INFO oslo_service.backend._eventlet.service [None req-32176cf6-dfaf-4ddd-8085-01904c2fe656 None None] Child 86396 exited with status 0
Jul 10 12:36:13 devstack cinder-volume[87253]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 10 12:36:13 devstack cinder-volume[87253]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 10 12:36:13 devstack cinder-volume[87253]: we strongly recommend against using it for new projects.
Jul 10 12:36:13 devstack cinder-volume[87253]: If you are already using Eventlet, we recommend migrating to a different
Jul 10 12:36:13 devstack cinder-volume[87253]: framework.  For more detail see
Jul 10 12:36:13 devstack cinder-volume[87253]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 10 12:36:13 devstack cinder-volume[87253]:   import eventlet  # noqa
Jul 10 12:36:16 devstack cinder-volume[87253]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87253) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 10 12:36:16 devstack cinder-volume[87253]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87253) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 10 12:36:16 devstack cinder-volume[87253]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87253) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 10 12:36:17 devstack cinder-volume[87253]: INFO dbcounter [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] Registered counter for database cinder
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_db.sqlalchemy.engines [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87253) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG dbcounter [-] [87253] Writer thread running {{(pid=87253) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 10 12:36:17 devstack cinder-volume[87253]: INFO cinder.rpc [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 10 12:36:17 devstack cinder-volume[87253]: INFO cinder.rpc [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_db.sqlalchemy.engines [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87253) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 10 12:36:17 devstack cinder-volume[87253]: INFO cinder.volume.manager [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] Determined volume DB was empty at startup.
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG cinder.volume.manager [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87253) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 10 12:36:17 devstack cinder-volume[87253]: WARNING stevedore.named [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 10 12:36:17 devstack cinder-volume[87253]: WARNING castellan.key_manager [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 10 12:36:17 devstack cinder-volume[87253]: WARNING cinder.keymgr.conf_key_mgr [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 10 12:36:17 devstack cinder-volume[87253]: INFO cinder.volume.manager [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_db.sqlalchemy.engines [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87253) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 10 12:36:17 devstack cinder-volume[87253]: INFO oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] Starting 1 workers
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] Started child 87378 {{(pid=87253) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] Full set of CONF: {{(pid=87253) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] ******************************************************************************** {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] Configuration options gathered from: {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] ================================================================================ {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] allow_availability_zone_fallback = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87378]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] allow_compression_on_image_upload = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] allowed_direct_url_schemes     = [] {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] api_rate_limit                 = True {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] auth_strategy                  = keystone {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_availability_zone      = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_host                   = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_name                   = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_stats_polling_interval = 60 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backup_api_class               = cinder.backup.api.API {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backup_name_template           = backup-%s {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backup_use_same_host           = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backup_use_temp_snapshot       = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] chap_password                  = **** {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] chap_username                  =  {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] cinder_internal_tenant_project_id = 0c9c778b7c8547998e00d072b68a4cdd {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] cinder_internal_tenant_user_id = 90a75ba0a10d4d158d3dd9e1f239c067 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] cluster                        = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] compression_format             = gzip {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] compute_api_class              = cinder.compute.nova.API {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] config_dir                     = [] {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] config_source                  = [] {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] control_exchange               = openstack {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] debug                          = True {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] default_availability_zone      = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] default_group_type             = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] default_volume_type            = QuobyteHD {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] disk_geometry                  = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] driver_client_cert             = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] driver_client_cert_key         = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] driver_data_namespace          = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] driver_ssl_cert_path           = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] driver_ssl_cert_verify         = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] driver_use_ssl                 = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] enable_new_services            = True {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] enable_unsupported_driver      = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] enabled_backends               = ['QuobyteHD'] {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] enforce_multipath_for_image_xfer = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] filter_function                = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] glance_api_insecure            = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] glance_api_servers             = ['http://192.168.122.185/image'] {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] glance_api_ssl_compression     = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] glance_ca_certificates_file    = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] glance_catalog_info            = image:glance:publicURL {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] glance_certfile                = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] glance_keyfile                 = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] glance_num_retries             = 3 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] glance_request_timeout         = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] goodness_function              = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] graceful_shutdown_timeout      = 5 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] group_api_class                = cinder.group.api.API {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] host                           = devstack {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] image_compress_on_upload       = True {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] image_conversion_address_space_limit = 1 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] image_conversion_cpu_limit     = 60 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] image_conversion_disable       = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] image_upload_use_cinder_backend = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] image_upload_use_internal_tenant = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] image_volume_cache_enabled     = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] image_volume_cache_max_count   = 0 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] image_volume_cache_max_size_gb = 0 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] init_host_max_objects_retrieval = 0 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] instance_format                = [instance: %(uuid)s]  {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] iscsi_target_flags             =  {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] iscsi_write_cache              = on {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] iser_helper                    = tgtadm {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] iser_ip_address                = 192.168.122.185 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] iser_port                      = 3260 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] log_color                      = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] log_config_append              = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] log_dir                        = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] log_file                       = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] log_options                    = True {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] log_rotate_interval            = 1 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] log_rotate_interval_type       = days {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] log_rotation_type              = none {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-50106623-5fbe-4cfb-9155-88253cd189ba None None] Starting volume driver QuobyteDriver (1.1.14)
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-50106623-5fbe-4cfb-9155-88253cd189ba None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87378) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] max_age                        = 0 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] max_logfile_count              = 30 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] max_logfile_size_mb            = 200 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] max_over_subscription_ratio    = 20.0 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] message_reap_interval          = 86400 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] message_ttl                    = 2592000 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] migration_create_volume_timeout_secs = 300 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] monkey_patch                   = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] monkey_patch_modules           = [] {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] my_ip                          = 192.168.122.185 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] no_snapshot_gb_quota           = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] num_iser_scan_tries            = 3 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] num_shell_tries                = 3 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] num_volume_device_scan_tries   = 3 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] nvmeof_conn_info_version       = 1 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] nvmet_ns_id                    = 10 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] nvmet_port_id                  = 1 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] osapi_max_limit                = 1000 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] osapi_volume_ext_list          = [] {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] osapi_volume_listen_port       = 8776 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] osapi_volume_use_ssl           = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] osapi_volume_workers           = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] per_volume_size_limit          = -1 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] periodic_fuzzy_delay           = 60 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] periodic_interval              = 60 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] public_endpoint                = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] publish_errors                 = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] quota_backup_gigabytes         = 1000 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] quota_backups                  = 10 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] quota_gigabytes                = 1000 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] quota_groups                   = 10 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] quota_snapshots                = 10 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] quota_volumes                  = 10 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] rate_limit_burst               = 0 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] rate_limit_except_level        = CRITICAL {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] rate_limit_interval            = 0 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] reinit_driver_count            = 3 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] replication_device             = **** {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] report_discard_supported       = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] report_interval                = 120 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] reservation_clean_interval     = 86400 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] reservation_expire             = 86400 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] reserved_image_namespaces      = [] {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] reserved_percentage            = 0 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] rpc_response_timeout           = 120 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] run_external_periodic_tasks    = True {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] scst_target_driver             = iscsi {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] scst_target_iqn_name           = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] service_down_time              = 720 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] shell_completion               = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] snapshot_name_template         = snapshot-%s {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] split_loggers                  = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] state_path                     = /opt/stack/data/cinder {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] storage_availability_zone      = nova {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] storage_protocol               = iSCSI {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] syslog_log_facility            = LOG_USER {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] target_helper                  = lioadm {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] target_ip_address              = 192.168.122.185 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] target_port                    = 3260 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] target_protocol                = iscsi {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] target_secondary_ip_addresses  = [] {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] trace_flags                    = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] transport_url                  = **** {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] until_refresh                  = 0 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] use_chap_auth                  = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] use_default_quota_class        = True {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] use_journal                    = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] use_json                       = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] use_multipath_for_image_xfer   = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] use_stderr                     = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] use_syslog                     = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] verify_glance_signatures       = enabled {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] volume_api_class               = cinder.volume.api.API {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] volume_backend_name            = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] volume_clear                   = zero {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] volume_clear_ionice            = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] volume_clear_size              = 0 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] volume_copy_bps_limit          = 0 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] volume_dd_blocksize            = 1M {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] volume_name_template           = volume-%s {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] volume_service_inithost_offload = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] volume_usage_audit_period      = month {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] zoning_mode                    = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_concurrency.disable_process_locking = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] keystone_authtoken.auth_section = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] keystone_authtoken.auth_type   = password {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] keystone_authtoken.auth_version = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] keystone_authtoken.cache       = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] keystone_authtoken.certfile    = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] keystone_authtoken.include_service_catalog = True {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] keystone_authtoken.insecure    = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] keystone_authtoken.interface   = public {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] keystone_authtoken.keyfile     = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] keystone_authtoken.memcache_password =  {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] keystone_authtoken.memcache_username =  {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] keystone_authtoken.region_name = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] keystone_authtoken.service_type = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.185/identity {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] cache.backend                  = dogpile.cache.null {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] cache.backend_argument         = **** {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] cache.backend_expiration_time  = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] cache.config_prefix            = cache.oslo {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] cache.debug_cache_backend      = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] cache.enable_retry_client      = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] cache.enable_socket_keepalive  = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] cache.enabled                  = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] cache.expiration_time          = 600 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] cache.hashclient_retry_attempts = 2 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] cache.memcache_dead_retry      = 300 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] cache.memcache_pool_maxsize    = 10 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] cache.memcache_sasl_enabled    = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] cache.password                 = **** {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] cache.proxies                  = [] {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] cache.redis_db                 = 0 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] cache.redis_server             = localhost:6379 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] cache.retry_attempts           = 2 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] cache.retry_delay              = 0.0 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] cache.socket_keepalive_count   = 1 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] cache.socket_keepalive_idle    = 1 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] cache.socket_keepalive_interval = 1 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] cache.socket_timeout           = 1.0 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] cache.tls_allowed_ciphers      = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] cache.tls_cafile               = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] cache.tls_certfile             = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] cache.tls_enabled              = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] cache.tls_keyfile              = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] cache.username                 = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] coordination.backend_url       = **** {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] database.asyncio_connection    = **** {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] database.asyncio_slave_connection = **** {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] database.backend               = sqlalchemy {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] database.connection            = **** {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] database.connection_debug      = 0 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] database.connection_parameters =  {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-50106623-5fbe-4cfb-9155-88253cd189ba None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87378) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jul 10 12:36:17 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.quobyte [None req-50106623-5fbe-4cfb-9155-88253cd189ba None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] database.connection_recycle_time = 3600 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.quobyte [None req-50106623-5fbe-4cfb-9155-88253cd189ba None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] database.connection_trace      = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] database.db_inc_retry_interval = True {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] database.db_max_retries        = 20 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] database.db_max_retry_interval = 10 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-50106623-5fbe-4cfb-9155-88253cd189ba None None] Running cmd (subprocess): mount.quobyte {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] database.db_retry_interval     = 1 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] database.max_overflow          = 50 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] database.max_pool_size         = 5 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] database.max_retries           = 10 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] database.mysql_wsrep_sync_wait = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] database.pool_timeout          = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] database.retry_interval        = 10 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] database.slave_connection      = **** {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] database.sqlite_synchronous    = True {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] database.synchronous_reader    = True {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] database.use_db_reconnect      = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] profiler.connection_string     = messaging:// {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] profiler.enabled               = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] profiler.es_doc_type           = notification {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] profiler.es_scroll_size        = 10000 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] profiler.es_scroll_time        = 2m {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] profiler.filter_error_trace    = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] profiler.hmac_keys             = **** {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] profiler.sentinel_service_name = mymaster {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] profiler.socket_timeout        = 0.1 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] profiler.trace_requests        = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] profiler.trace_sqlalchemy      = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] profiler_jaeger.process_tags   = {} {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] profiler_jaeger.service_name_prefix = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] profiler_otlp.service_name_prefix = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_policy.enforce_new_defaults = True {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_policy.enforce_scope      = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_policy.policy_default_rule = default {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_policy.policy_file        = policy.yaml {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] privsep_osbrick.group          = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] privsep_osbrick.helper_command = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] privsep_osbrick.user           = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] cinder_sys_admin.group         = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] cinder_sys_admin.helper_command = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] cinder_sys_admin.user          = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] service_user.auth_section      = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] service_user.auth_type         = password {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] service_user.cafile            = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] service_user.certfile          = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] service_user.collect_timing    = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] service_user.insecure          = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] service_user.keyfile           = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] service_user.send_service_user_token = True {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] service_user.split_loggers     = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] service_user.timeout           = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] glance.auth_section            = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] glance.auth_type               = password {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] glance.certfile                = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] glance.collect_timing          = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] glance.insecure                = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] glance.keyfile                 = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] glance.region_name             = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] glance.split_loggers           = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] glance.timeout                 = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.backend_availability_zone = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.chap_password = **** {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.chap_username =  {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.disk_geometry = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.driver_client_cert = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.driver_client_cert_key = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.driver_data_namespace = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.driver_use_ssl = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.extra_capabilities = {} {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.filter_function = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.goodness_function = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.iscsi_target_flags =  {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.iscsi_write_cache = on {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.iser_helper   = tgtadm {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.iser_ip_address = 192.168.122.185 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.iser_port     = 3260 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.nas_host      =  {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.nas_login     = admin {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.nas_mount_options = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.nas_password  = **** {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.nas_private_key =  {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.nas_share_path =  {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.num_shell_tries = 3 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack quobyte-client[87379]: Reading configuration file: /etc/quobyte/client.cfg
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.quobyte_volume_url = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.replication_device = **** {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.report_discard_supported = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.reserved_percentage = 0 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack quobyte-client[87379]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.target_helper = tgtadm {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.target_ip_address = 192.168.122.185 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.target_port   = 3260 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.target_protocol = iscsi {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.trace_flags   = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.unique_fqdn_network = True {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.use_chap_auth = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.volume_backend_name = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.volume_clear  = zero {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.volume_clear_ionice = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.volume_clear_size = 0 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_reports.file_event_handler = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_reports.log_dir           = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.backend_availability_zone = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.backend_host         = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.chap_password        = **** {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.chap_username        = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.chiscsi_conf         = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.disk_geometry        = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.driver_client_cert   = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.driver_data_namespace = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.driver_use_ssl       = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.extra_capabilities   = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-50106623-5fbe-4cfb-9155-88253cd189ba None None] CMD "mount.quobyte" returned: 1 in 0.059s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.filter_function      = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.goodness_function    = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-50106623-5fbe-4cfb-9155-88253cd189ba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-50106623-5fbe-4cfb-9155-88253cd189ba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-50106623-5fbe-4cfb-9155-88253cd189ba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.iser_helper          = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.iser_ip_address      = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.iser_port            = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.iser_target_prefix   = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.nas_host             = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.nas_login            = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.nas_mount_options    = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.nas_password         = **** {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.nas_private_key      = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.nas_share_path       = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.nas_ssh_port         = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-50106623-5fbe-4cfb-9155-88253cd189ba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-50106623-5fbe-4cfb-9155-88253cd189ba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.num_shell_tries      = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-50106623-5fbe-4cfb-9155-88253cd189ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.nvmet_port_id        = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.replication_device   = **** {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.report_discard_supported = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.reserved_percentage  = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.scst_target_driver   = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.storage_protocol     = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.target_helper        = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.target_ip_address    = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.target_port          = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.target_prefix        = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.target_protocol      = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.trace_flags          = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.use_chap_auth        = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.volume_clear         = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.volume_clear_size    = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] QuobyteHD.volumes_dir          = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack sudo[87381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack sudo[87381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_messaging_rabbit.ssl      = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_messaging_notifications.driver = [] {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_messaging_notifications.retry = -1 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] key_manager.fixed_key          = **** {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] barbican.barbican_api_version  = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] barbican.barbican_endpoint     = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] barbican.barbican_endpoint_type = public {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] barbican.barbican_region_name  = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] barbican.cafile                = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] barbican.certfile              = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] barbican.collect_timing        = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] barbican.insecure              = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] barbican.keyfile               = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] barbican.number_of_retries     = 60 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] barbican.retry_delay           = 1 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] barbican.send_service_user_token = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] barbican.split_loggers         = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] barbican.timeout               = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] barbican.verify_ssl            = True {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] barbican.verify_ssl_path       = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] barbican_service_user.auth_section = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] barbican_service_user.auth_type = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] barbican_service_user.cafile   = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] barbican_service_user.certfile = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] barbican_service_user.collect_timing = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] barbican_service_user.insecure = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] barbican_service_user.keyfile  = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] barbican_service_user.split_loggers = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] barbican_service_user.timeout  = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] vault.approle_role_id          = **** {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] vault.approle_secret_id        = **** {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] vault.kv_mountpoint            = secret {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] vault.kv_path                  = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] vault.kv_version               = 2 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] vault.namespace                = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] vault.root_token_id            = **** {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] vault.ssl_ca_crt_file          = None {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] vault.timeout                  = 60.0 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] vault.use_ssl                  = False {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 10 12:36:17 devstack cinder-volume[87253]: DEBUG oslo_service.backend._eventlet.service [None req-716614bf-f6e2-48bc-864d-ba0dd23f45d4 None None] ******************************************************************************** {{(pid=87253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 10 12:36:18 devstack sudo[87381]: pam_unix(sudo:session): session closed for user root
Jul 10 12:36:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-50106623-5fbe-4cfb-9155-88253cd189ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.620s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:36:18 devstack cinder-volume[87378]: INFO cinder.volume.driver [None req-50106623-5fbe-4cfb-9155-88253cd189ba None None] Driver hasn't implemented _init_vendor_properties()
Jul 10 12:36:18 devstack cinder-volume[87378]: DEBUG cinder.volume.driver [None req-50106623-5fbe-4cfb-9155-88253cd189ba None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.750259399414, 'free_capacity_gb': 1775.750259399414, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87378) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 10 12:36:18 devstack cinder-volume[87378]: DEBUG oslo_db.sqlalchemy.engines [None req-50106623-5fbe-4cfb-9155-88253cd189ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87378) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 10 12:36:18 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writer thread running {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 10 12:36:18 devstack cinder-volume[87378]: DEBUG cinder.db.api [None req-50106623-5fbe-4cfb-9155-88253cd189ba None None] Building query based on filter {{(pid=87378) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 10 12:36:18 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-50106623-5fbe-4cfb-9155-88253cd189ba None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87378) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 10 12:36:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-50106623-5fbe-4cfb-9155-88253cd189ba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:36:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-50106623-5fbe-4cfb-9155-88253cd189ba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:36:18 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-50106623-5fbe-4cfb-9155-88253cd189ba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:36:18 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-50106623-5fbe-4cfb-9155-88253cd189ba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:36:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-50106623-5fbe-4cfb-9155-88253cd189ba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:36:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-50106623-5fbe-4cfb-9155-88253cd189ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:36:18 devstack cinder-volume[87378]: INFO cinder.keymgr.migration [None req-4bdbf662-a5ce-4ea2-a84c-aea1cea7f560 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 10 12:36:18 devstack sudo[87386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:36:18 devstack sudo[87386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:36:19 devstack sudo[87386]: pam_unix(sudo:session): session closed for user root
Jul 10 12:36:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-50106623-5fbe-4cfb-9155-88253cd189ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.598s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:36:19 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-50106623-5fbe-4cfb-9155-88253cd189ba None None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:36:19 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-50106623-5fbe-4cfb-9155-88253cd189ba None None] Driver initialization completed successfully.
Jul 10 12:36:19 devstack cinder-volume[87378]: INFO cinder.manager [None req-50106623-5fbe-4cfb-9155-88253cd189ba None None] Initiating service 3 cleanup
Jul 10 12:36:19 devstack cinder-volume[87378]: INFO cinder.manager [None req-50106623-5fbe-4cfb-9155-88253cd189ba None None] Service 3 cleanup completed.
Jul 10 12:36:19 devstack cinder-volume[87378]: DEBUG cinder.service [None req-50106623-5fbe-4cfb-9155-88253cd189ba None None] Creating RPC server for service cinder-volume {{(pid=87378) start /opt/stack/cinder/cinder/service.py:231}}
Jul 10 12:36:19 devstack cinder-volume[87378]: DEBUG cinder.service [None req-50106623-5fbe-4cfb-9155-88253cd189ba None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87378) start /opt/stack/cinder/cinder/service.py:237}}
Jul 10 12:36:19 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-50106623-5fbe-4cfb-9155-88253cd189ba None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jul 10 12:36:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-50106623-5fbe-4cfb-9155-88253cd189ba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:36:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-50106623-5fbe-4cfb-9155-88253cd189ba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:36:19 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-50106623-5fbe-4cfb-9155-88253cd189ba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:36:19 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-50106623-5fbe-4cfb-9155-88253cd189ba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:36:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-50106623-5fbe-4cfb-9155-88253cd189ba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:36:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-50106623-5fbe-4cfb-9155-88253cd189ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:36:19 devstack sudo[87392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:36:19 devstack sudo[87392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:36:19 devstack sudo[87392]: pam_unix(sudo:session): session closed for user root
Jul 10 12:36:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-50106623-5fbe-4cfb-9155-88253cd189ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.592s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:36:19 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-50106623-5fbe-4cfb-9155-88253cd189ba None None] Driver post RPC initialization completed successfully.
Jul 10 12:36:27 devstack cinder-volume[87253]: DEBUG dbcounter [-] [87253] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87253) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:36:29 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:36:29 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:SELECT=3 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:37:12 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager._thread_info {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:37:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread count: 6 {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 10 12:37:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread info: [<_MainThread(MainThread, started 128233544536192)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128233445424704)>, <Thread(Thread-3 (stat_writer), started daemon 128233435118528)>, <Thread(Rabbit-heartbeat, started daemon 128233435718016)>, <Thread(Thread-5 (_runner), started daemon 128233432624448)>, <Thread(Thread-7 (_runner), started daemon 128233432674688)>] {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 10 12:37:39 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-a62137b3-8deb-4357-a365-9fbedef9ebad tempest-DeleteServersTestJSON-214782097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:37:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a62137b3-8deb-4357-a365-9fbedef9ebad tempest-DeleteServersTestJSON-214782097 None] Flow 'volume_create_manager' (bf8be4f4-ae1c-4231-8478-c6dc29690424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:37:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a62137b3-8deb-4357-a365-9fbedef9ebad tempest-DeleteServersTestJSON-214782097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3557ba4-f75d-4326-a0f4-debc9549e6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:37:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a62137b3-8deb-4357-a365-9fbedef9ebad tempest-DeleteServersTestJSON-214782097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3557ba4-f75d-4326-a0f4-debc9549e6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-496675590',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62e1b330-df3a-495e-9692-0d2e51d76800,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='272273c6d592414896ec6966bb5d6600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:37:39Z,use_quota=True,user_id='c962e5c7df794707bcfc47ee8b848ac9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:37:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a62137b3-8deb-4357-a365-9fbedef9ebad tempest-DeleteServersTestJSON-214782097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (468f674c-9b5e-4bf0-a9ff-273e4c3d68bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:37:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a62137b3-8deb-4357-a365-9fbedef9ebad tempest-DeleteServersTestJSON-214782097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (468f674c-9b5e-4bf0-a9ff-273e4c3d68bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:37:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a62137b3-8deb-4357-a365-9fbedef9ebad tempest-DeleteServersTestJSON-214782097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88a33361-0243-4eb7-baa7-168eb3281f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:37:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a62137b3-8deb-4357-a365-9fbedef9ebad tempest-DeleteServersTestJSON-214782097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88a33361-0243-4eb7-baa7-168eb3281f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62e1b330-df3a-495e-9692-0d2e51d76800', 'volume_name': 'volume-62e1b330-df3a-495e-9692-0d2e51d76800', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:37:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a62137b3-8deb-4357-a365-9fbedef9ebad tempest-DeleteServersTestJSON-214782097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50ec4d3c-468e-4eda-be9a-8ec10fb3c73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:37:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a62137b3-8deb-4357-a365-9fbedef9ebad tempest-DeleteServersTestJSON-214782097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50ec4d3c-468e-4eda-be9a-8ec10fb3c73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:37:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a62137b3-8deb-4357-a365-9fbedef9ebad tempest-DeleteServersTestJSON-214782097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c53e5b09-5fb6-4144-99a3-2b7836c3ec69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:37:39 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-a62137b3-8deb-4357-a365-9fbedef9ebad tempest-DeleteServersTestJSON-214782097 None] Volume 62e1b330-df3a-495e-9692-0d2e51d76800: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62e1b330-df3a-495e-9692-0d2e51d76800', 'volume_size': 1}
Jul 10 12:37:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a62137b3-8deb-4357-a365-9fbedef9ebad tempest-DeleteServersTestJSON-214782097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:37:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a62137b3-8deb-4357-a365-9fbedef9ebad tempest-DeleteServersTestJSON-214782097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:37:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-a62137b3-8deb-4357-a365-9fbedef9ebad tempest-DeleteServersTestJSON-214782097 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-496675590',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62e1b330-df3a-495e-9692-0d2e51d76800,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='272273c6d592414896ec6966bb5d6600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:37:39Z,use_quota=True,user_id='c962e5c7df794707bcfc47ee8b848ac9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:37:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-a62137b3-8deb-4357-a365-9fbedef9ebad tempest-DeleteServersTestJSON-214782097 None] Creating volume 62e1b330-df3a-495e-9692-0d2e51d76800 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:37:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a62137b3-8deb-4357-a365-9fbedef9ebad tempest-DeleteServersTestJSON-214782097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:37:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a62137b3-8deb-4357-a365-9fbedef9ebad tempest-DeleteServersTestJSON-214782097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:37:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-a62137b3-8deb-4357-a365-9fbedef9ebad tempest-DeleteServersTestJSON-214782097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:37:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-a62137b3-8deb-4357-a365-9fbedef9ebad tempest-DeleteServersTestJSON-214782097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:37:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a62137b3-8deb-4357-a365-9fbedef9ebad tempest-DeleteServersTestJSON-214782097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:37:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-a62137b3-8deb-4357-a365-9fbedef9ebad tempest-DeleteServersTestJSON-214782097 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:37:39 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-a62137b3-8deb-4357-a365-9fbedef9ebad tempest-DeleteServersTestJSON-214782097 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:37:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a62137b3-8deb-4357-a365-9fbedef9ebad tempest-DeleteServersTestJSON-214782097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-62e1b330-df3a-495e-9692-0d2e51d76800 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:37:39 devstack sudo[87986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-62e1b330-df3a-495e-9692-0d2e51d76800 1073741824
Jul 10 12:37:39 devstack sudo[87986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:37:42 devstack sudo[87986]: pam_unix(sudo:session): session closed for user root
Jul 10 12:37:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a62137b3-8deb-4357-a365-9fbedef9ebad tempest-DeleteServersTestJSON-214782097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-62e1b330-df3a-495e-9692-0d2e51d76800 1073741824" returned: 0 in 2.671s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:37:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a62137b3-8deb-4357-a365-9fbedef9ebad tempest-DeleteServersTestJSON-214782097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-62e1b330-df3a-495e-9692-0d2e51d76800 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:37:42 devstack sudo[88366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-62e1b330-df3a-495e-9692-0d2e51d76800
Jul 10 12:37:42 devstack sudo[88366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:37:43 devstack sudo[88366]: pam_unix(sudo:session): session closed for user root
Jul 10 12:37:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a62137b3-8deb-4357-a365-9fbedef9ebad tempest-DeleteServersTestJSON-214782097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-62e1b330-df3a-495e-9692-0d2e51d76800" returned: 0 in 1.381s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:37:43 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-a62137b3-8deb-4357-a365-9fbedef9ebad tempest-DeleteServersTestJSON-214782097 None] <== create_volume: return (4225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:37:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a62137b3-8deb-4357-a365-9fbedef9ebad tempest-DeleteServersTestJSON-214782097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.243s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:37:43 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a62137b3-8deb-4357-a365-9fbedef9ebad tempest-DeleteServersTestJSON-214782097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c53e5b09-5fb6-4144-99a3-2b7836c3ec69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62e1b330-df3a-495e-9692-0d2e51d76800', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:37:43 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a62137b3-8deb-4357-a365-9fbedef9ebad tempest-DeleteServersTestJSON-214782097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e94bbced-9d0c-4284-ad96-7eabc9b69b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:37:43 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-a62137b3-8deb-4357-a365-9fbedef9ebad tempest-DeleteServersTestJSON-214782097 None] Volume volume-62e1b330-df3a-495e-9692-0d2e51d76800 (62e1b330-df3a-495e-9692-0d2e51d76800): created successfully
Jul 10 12:37:43 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a62137b3-8deb-4357-a365-9fbedef9ebad tempest-DeleteServersTestJSON-214782097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e94bbced-9d0c-4284-ad96-7eabc9b69b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:37:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a62137b3-8deb-4357-a365-9fbedef9ebad tempest-DeleteServersTestJSON-214782097 None] Flow 'volume_create_manager' (bf8be4f4-ae1c-4231-8478-c6dc29690424) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:37:44 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-a62137b3-8deb-4357-a365-9fbedef9ebad tempest-DeleteServersTestJSON-214782097 None] Created volume successfully.
Jul 10 12:37:47 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-3158efc3-4ec5-4db3-8c89-4472a82ea4c9 tempest-VolumesAdminNegativeTest-556567162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:37:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3158efc3-4ec5-4db3-8c89-4472a82ea4c9 tempest-VolumesAdminNegativeTest-556567162 None] Flow 'volume_create_manager' (6330138e-0b90-4681-878e-78cb71ed7d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:37:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3158efc3-4ec5-4db3-8c89-4472a82ea4c9 tempest-VolumesAdminNegativeTest-556567162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ac7a6f9-1e25-42bc-b9a7-9392f41b74ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:37:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3158efc3-4ec5-4db3-8c89-4472a82ea4c9 tempest-VolumesAdminNegativeTest-556567162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ac7a6f9-1e25-42bc-b9a7-9392f41b74ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:37:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-402633402',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=182f51b1-1f5d-482c-b683-00e13947530b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56a1d9515fff47f6a5ed93be8646808f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:37:47Z,use_quota=True,user_id='2159c5b1e8b7497385da0c6c2b8db3f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:37:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3158efc3-4ec5-4db3-8c89-4472a82ea4c9 tempest-VolumesAdminNegativeTest-556567162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee716fb6-d80f-40d2-aced-9a496181cf03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:37:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3158efc3-4ec5-4db3-8c89-4472a82ea4c9 tempest-VolumesAdminNegativeTest-556567162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee716fb6-d80f-40d2-aced-9a496181cf03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:37:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3158efc3-4ec5-4db3-8c89-4472a82ea4c9 tempest-VolumesAdminNegativeTest-556567162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcf505b1-4472-4357-a29c-95fd16a88733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:37:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3158efc3-4ec5-4db3-8c89-4472a82ea4c9 tempest-VolumesAdminNegativeTest-556567162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcf505b1-4472-4357-a29c-95fd16a88733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '182f51b1-1f5d-482c-b683-00e13947530b', 'volume_name': 'volume-182f51b1-1f5d-482c-b683-00e13947530b', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:37:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3158efc3-4ec5-4db3-8c89-4472a82ea4c9 tempest-VolumesAdminNegativeTest-556567162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f22a261-94af-49f2-9d07-47ddc1f8013e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:37:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3158efc3-4ec5-4db3-8c89-4472a82ea4c9 tempest-VolumesAdminNegativeTest-556567162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f22a261-94af-49f2-9d07-47ddc1f8013e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:37:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3158efc3-4ec5-4db3-8c89-4472a82ea4c9 tempest-VolumesAdminNegativeTest-556567162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0d55742-ad58-4fb5-a923-94892bf8f017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:37:47 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-3158efc3-4ec5-4db3-8c89-4472a82ea4c9 tempest-VolumesAdminNegativeTest-556567162 None] Volume 182f51b1-1f5d-482c-b683-00e13947530b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-182f51b1-1f5d-482c-b683-00e13947530b', 'volume_size': 1}
Jul 10 12:37:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3158efc3-4ec5-4db3-8c89-4472a82ea4c9 tempest-VolumesAdminNegativeTest-556567162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:37:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3158efc3-4ec5-4db3-8c89-4472a82ea4c9 tempest-VolumesAdminNegativeTest-556567162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:37:47 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3158efc3-4ec5-4db3-8c89-4472a82ea4c9 tempest-VolumesAdminNegativeTest-556567162 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:37:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-402633402',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=182f51b1-1f5d-482c-b683-00e13947530b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56a1d9515fff47f6a5ed93be8646808f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:37:47Z,use_quota=True,user_id='2159c5b1e8b7497385da0c6c2b8db3f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:37:47 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-3158efc3-4ec5-4db3-8c89-4472a82ea4c9 tempest-VolumesAdminNegativeTest-556567162 None] Creating volume 182f51b1-1f5d-482c-b683-00e13947530b {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:37:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3158efc3-4ec5-4db3-8c89-4472a82ea4c9 tempest-VolumesAdminNegativeTest-556567162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:37:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3158efc3-4ec5-4db3-8c89-4472a82ea4c9 tempest-VolumesAdminNegativeTest-556567162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:37:47 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3158efc3-4ec5-4db3-8c89-4472a82ea4c9 tempest-VolumesAdminNegativeTest-556567162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:37:47 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3158efc3-4ec5-4db3-8c89-4472a82ea4c9 tempest-VolumesAdminNegativeTest-556567162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:37:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3158efc3-4ec5-4db3-8c89-4472a82ea4c9 tempest-VolumesAdminNegativeTest-556567162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:37:47 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3158efc3-4ec5-4db3-8c89-4472a82ea4c9 tempest-VolumesAdminNegativeTest-556567162 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:37:47 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-3158efc3-4ec5-4db3-8c89-4472a82ea4c9 tempest-VolumesAdminNegativeTest-556567162 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:37:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3158efc3-4ec5-4db3-8c89-4472a82ea4c9 tempest-VolumesAdminNegativeTest-556567162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-182f51b1-1f5d-482c-b683-00e13947530b 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:37:47 devstack sudo[88384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-182f51b1-1f5d-482c-b683-00e13947530b 1073741824
Jul 10 12:37:47 devstack sudo[88384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:37:49 devstack sudo[88384]: pam_unix(sudo:session): session closed for user root
Jul 10 12:37:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3158efc3-4ec5-4db3-8c89-4472a82ea4c9 tempest-VolumesAdminNegativeTest-556567162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-182f51b1-1f5d-482c-b683-00e13947530b 1073741824" returned: 0 in 1.440s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:37:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3158efc3-4ec5-4db3-8c89-4472a82ea4c9 tempest-VolumesAdminNegativeTest-556567162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-182f51b1-1f5d-482c-b683-00e13947530b {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:37:49 devstack sudo[88423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-182f51b1-1f5d-482c-b683-00e13947530b
Jul 10 12:37:49 devstack sudo[88423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:37:50 devstack sudo[88423]: pam_unix(sudo:session): session closed for user root
Jul 10 12:37:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3158efc3-4ec5-4db3-8c89-4472a82ea4c9 tempest-VolumesAdminNegativeTest-556567162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-182f51b1-1f5d-482c-b683-00e13947530b" returned: 0 in 1.222s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:37:50 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3158efc3-4ec5-4db3-8c89-4472a82ea4c9 tempest-VolumesAdminNegativeTest-556567162 None] <== create_volume: return (2787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:37:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3158efc3-4ec5-4db3-8c89-4472a82ea4c9 tempest-VolumesAdminNegativeTest-556567162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.789s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:37:50 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3158efc3-4ec5-4db3-8c89-4472a82ea4c9 tempest-VolumesAdminNegativeTest-556567162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0d55742-ad58-4fb5-a923-94892bf8f017) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-182f51b1-1f5d-482c-b683-00e13947530b', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:37:50 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3158efc3-4ec5-4db3-8c89-4472a82ea4c9 tempest-VolumesAdminNegativeTest-556567162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b71fd240-9a43-43c4-8831-91873eb48de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:37:50 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-3158efc3-4ec5-4db3-8c89-4472a82ea4c9 tempest-VolumesAdminNegativeTest-556567162 None] Volume volume-182f51b1-1f5d-482c-b683-00e13947530b (182f51b1-1f5d-482c-b683-00e13947530b): created successfully
Jul 10 12:37:50 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3158efc3-4ec5-4db3-8c89-4472a82ea4c9 tempest-VolumesAdminNegativeTest-556567162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b71fd240-9a43-43c4-8831-91873eb48de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:37:50 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3158efc3-4ec5-4db3-8c89-4472a82ea4c9 tempest-VolumesAdminNegativeTest-556567162 None] Flow 'volume_create_manager' (6330138e-0b90-4681-878e-78cb71ed7d12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:37:50 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-3158efc3-4ec5-4db3-8c89-4472a82ea4c9 tempest-VolumesAdminNegativeTest-556567162 None] Created volume successfully.
Jul 10 12:37:51 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fe36e03f-b83d-47de-ac20-9c5c8e805ec3 tempest-VolumesAdminNegativeTest-556567162 None] Acquiring lock "cinder-182f51b1-1f5d-482c-b683-00e13947530b-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:37:51 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fe36e03f-b83d-47de-ac20-9c5c8e805ec3 tempest-VolumesAdminNegativeTest-556567162 None] Lock "cinder-182f51b1-1f5d-482c-b683-00e13947530b-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:37:51 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fe36e03f-b83d-47de-ac20-9c5c8e805ec3 tempest-VolumesAdminNegativeTest-556567162 None] Acquiring lock "cinder-quobyte-182f51b1-1f5d-482c-b683-00e13947530b" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:37:51 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fe36e03f-b83d-47de-ac20-9c5c8e805ec3 tempest-VolumesAdminNegativeTest-556567162 None] Lock "cinder-quobyte-182f51b1-1f5d-482c-b683-00e13947530b" acquired by "delete_volume" :: waited 0.031s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:37:51 devstack cinder-volume[87378]: INFO oslo.privsep.daemon [None req-fe36e03f-b83d-47de-ac20-9c5c8e805ec3 tempest-VolumesAdminNegativeTest-556567162 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpsvyjk9mx/privsep.sock']
Jul 10 12:37:51 devstack sudo[88462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpsvyjk9mx/privsep.sock
Jul 10 12:37:51 devstack sudo[88462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:37:52 devstack cinder-volume[87378]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Jul 10 12:37:52 devstack cinder-volume[87378]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 10 12:37:52 devstack cinder-volume[87378]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jul 10 12:37:52 devstack cinder-volume[87378]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 10 12:37:52 devstack cinder-volume[87378]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jul 10 12:37:52 devstack cinder-volume[87378]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jul 10 12:37:52 devstack cinder-volume[87378]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 10 12:37:52 devstack cinder-volume[87378]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 10 12:37:52 devstack cinder-volume[87378]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Jul 10 12:37:52 devstack cinder-volume[87378]: WARNING py.warnings [req-21025cd9-a483-4aad-a74d-c9038214b87a req-1b79d341-6ad0-4578-b9c5-f042eadf2b7f tempest-DeleteServersTestJSON-214782097 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment".  Apply join condition(s) between each element to resolve.
Jul 10 12:37:52 devstack cinder-volume[87378]:   .first()
Jul 10 12:37:52 devstack cinder-volume[87378]: 
Jul 10 12:37:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-21025cd9-a483-4aad-a74d-c9038214b87a req-1b79d341-6ad0-4578-b9c5-f042eadf2b7f tempest-DeleteServersTestJSON-214782097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:37:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-21025cd9-a483-4aad-a74d-c9038214b87a req-1b79d341-6ad0-4578-b9c5-f042eadf2b7f tempest-DeleteServersTestJSON-214782097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:37:53 devstack cinder-volume[87378]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
Jul 10 12:37:53 devstack cinder-volume[87378]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 10 12:37:53 devstack cinder-volume[87378]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jul 10 12:37:53 devstack cinder-volume[87378]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 10 12:37:53 devstack cinder-volume[87378]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jul 10 12:37:53 devstack cinder-volume[87378]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jul 10 12:37:53 devstack cinder-volume[87378]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 10 12:37:53 devstack cinder-volume[87378]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 10 12:37:53 devstack cinder-volume[87378]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
Jul 10 12:37:53 devstack sudo[88462]: pam_unix(sudo:session): session closed for user root
Jul 10 12:37:53 devstack cinder-volume[87378]: INFO oslo.privsep.daemon [None req-fe36e03f-b83d-47de-ac20-9c5c8e805ec3 tempest-VolumesAdminNegativeTest-556567162 None] Spawned new privsep daemon via rootwrap
Jul 10 12:37:53 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [None req-fe36e03f-b83d-47de-ac20-9c5c8e805ec3 tempest-VolumesAdminNegativeTest-556567162 None] Accepted privsep connection to /tmp/tmpsvyjk9mx/privsep.sock {{(pid=87378) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Jul 10 12:37:53 devstack cinder-volume[87378]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 10 12:37:53 devstack cinder-volume[87378]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 10 12:37:53 devstack cinder-volume[87378]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jul 10 12:37:53 devstack cinder-volume[87378]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88478
Jul 10 12:37:53 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[581c9634-1963-42c6-b435-3d53563393be]: (2,) {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:37:53 devstack cinder-volume[87378]: WARNING oslo_privsep.priv_context [req-21025cd9-a483-4aad-a74d-c9038214b87a req-1b79d341-6ad0-4578-b9c5-f042eadf2b7f tempest-DeleteServersTestJSON-214782097 None] privsep daemon already running
Jul 10 12:37:53 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b65d7a8-a9c6-42ac-981a-0f681b03f092]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:37:53 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[007611b7-8248-4333-af52-dc614cfe904d]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:37:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fe36e03f-b83d-47de-ac20-9c5c8e805ec3 tempest-VolumesAdminNegativeTest-556567162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-182f51b1-1f5d-482c-b683-00e13947530b {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:37:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-21025cd9-a483-4aad-a74d-c9038214b87a req-1b79d341-6ad0-4578-b9c5-f042eadf2b7f tempest-DeleteServersTestJSON-214782097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-62e1b330-df3a-495e-9692-0d2e51d76800 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:37:53 devstack sudo[88481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-182f51b1-1f5d-482c-b683-00e13947530b
Jul 10 12:37:53 devstack sudo[88481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:37:53 devstack sudo[88482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-62e1b330-df3a-495e-9692-0d2e51d76800
Jul 10 12:37:53 devstack sudo[88482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:37:54 devstack sudo[88482]: pam_unix(sudo:session): session closed for user root
Jul 10 12:37:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-21025cd9-a483-4aad-a74d-c9038214b87a req-1b79d341-6ad0-4578-b9c5-f042eadf2b7f tempest-DeleteServersTestJSON-214782097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-62e1b330-df3a-495e-9692-0d2e51d76800" returned: 0 in 1.025s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:37:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-21025cd9-a483-4aad-a74d-c9038214b87a req-1b79d341-6ad0-4578-b9c5-f042eadf2b7f tempest-DeleteServersTestJSON-214782097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.851s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:37:54 devstack sudo[88481]: pam_unix(sudo:session): session closed for user root
Jul 10 12:37:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-21025cd9-a483-4aad-a74d-c9038214b87a req-1b79d341-6ad0-4578-b9c5-f042eadf2b7f tempest-DeleteServersTestJSON-214782097 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be', 'name': 'volume-62e1b330-df3a-495e-9692-0d2e51d76800', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '274a5a19-2e83-4095-b019-11631c6bdbf8', 'enforce_multipath': True} {{(pid=87378) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 10 12:37:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fe36e03f-b83d-47de-ac20-9c5c8e805ec3 tempest-VolumesAdminNegativeTest-556567162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-182f51b1-1f5d-482c-b683-00e13947530b" returned: 0 in 1.163s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:37:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fe36e03f-b83d-47de-ac20-9c5c8e805ec3 tempest-VolumesAdminNegativeTest-556567162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-182f51b1-1f5d-482c-b683-00e13947530b {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:37:54 devstack sudo[88494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-182f51b1-1f5d-482c-b683-00e13947530b
Jul 10 12:37:54 devstack sudo[88494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:37:55 devstack cinder-volume[87378]: INFO cinder.volume.manager [req-21025cd9-a483-4aad-a74d-c9038214b87a req-1b79d341-6ad0-4578-b9c5-f042eadf2b7f tempest-DeleteServersTestJSON-214782097 None] attachment_update completed successfully.
Jul 10 12:37:55 devstack sudo[88494]: pam_unix(sudo:session): session closed for user root
Jul 10 12:37:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fe36e03f-b83d-47de-ac20-9c5c8e805ec3 tempest-VolumesAdminNegativeTest-556567162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-182f51b1-1f5d-482c-b683-00e13947530b" returned: 0 in 0.817s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:37:55 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fe36e03f-b83d-47de-ac20-9c5c8e805ec3 tempest-VolumesAdminNegativeTest-556567162 None] Lock "cinder-quobyte-182f51b1-1f5d-482c-b683-00e13947530b" released by "delete_volume" :: held 4.021s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:37:55 devstack cinder-volume[87378]: WARNING cinder.quota [None req-fe36e03f-b83d-47de-ac20-9c5c8e805ec3 tempest-VolumesAdminNegativeTest-556567162 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 10 12:37:55 devstack cinder-volume[87378]: WARNING cinder.quota [None req-fe36e03f-b83d-47de-ac20-9c5c8e805ec3 tempest-VolumesAdminNegativeTest-556567162 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 10 12:37:55 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-fe36e03f-b83d-47de-ac20-9c5c8e805ec3 tempest-VolumesAdminNegativeTest-556567162 None] Created reservations ['cb5c870b-2a2e-4f60-b1f0-941455d6ea05', 'e0696f79-90f8-4c79-9bc4-17a9aca642ad', 'ff80199b-c4d1-466a-9063-3e1031bb2b7a', '92428d19-e9d1-447d-8e91-d555b86a7ff7'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:37:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-fe36e03f-b83d-47de-ac20-9c5c8e805ec3 tempest-VolumesAdminNegativeTest-556567162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:37:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-fe36e03f-b83d-47de-ac20-9c5c8e805ec3 tempest-VolumesAdminNegativeTest-556567162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:37:56 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-fe36e03f-b83d-47de-ac20-9c5c8e805ec3 tempest-VolumesAdminNegativeTest-556567162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:37:56 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-fe36e03f-b83d-47de-ac20-9c5c8e805ec3 tempest-VolumesAdminNegativeTest-556567162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:37:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-fe36e03f-b83d-47de-ac20-9c5c8e805ec3 tempest-VolumesAdminNegativeTest-556567162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:37:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fe36e03f-b83d-47de-ac20-9c5c8e805ec3 tempest-VolumesAdminNegativeTest-556567162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:37:56 devstack sudo[88565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:37:56 devstack sudo[88565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:37:57 devstack sudo[88565]: pam_unix(sudo:session): session closed for user root
Jul 10 12:37:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fe36e03f-b83d-47de-ac20-9c5c8e805ec3 tempest-VolumesAdminNegativeTest-556567162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 1.103s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:37:57 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-fe36e03f-b83d-47de-ac20-9c5c8e805ec3 tempest-VolumesAdminNegativeTest-556567162 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:37:57 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-fe36e03f-b83d-47de-ac20-9c5c8e805ec3 tempest-VolumesAdminNegativeTest-556567162 None] Deleted volume successfully.
Jul 10 12:37:57 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fe36e03f-b83d-47de-ac20-9c5c8e805ec3 tempest-VolumesAdminNegativeTest-556567162 None] Lock "cinder-182f51b1-1f5d-482c-b683-00e13947530b-delete_volume" released by "delete_volume" :: held 5.512s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:38:03 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [req-ae0346d3-a979-4ab8-afd1-97b70d22f2b3 req-9217ae93-8c55-4182-8272-29c411e4b079 tempest-VolumesGetTestJSON-167718473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:38:03 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-ae0346d3-a979-4ab8-afd1-97b70d22f2b3 req-9217ae93-8c55-4182-8272-29c411e4b079 tempest-VolumesGetTestJSON-167718473 None] Flow 'volume_create_manager' (904c4fd4-51c0-403c-a494-48d09350d6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:38:03 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-ae0346d3-a979-4ab8-afd1-97b70d22f2b3 req-9217ae93-8c55-4182-8272-29c411e4b079 tempest-VolumesGetTestJSON-167718473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33724b0f-54f8-46f3-a470-d8b5ce5b1660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:38:03 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-ae0346d3-a979-4ab8-afd1-97b70d22f2b3 req-9217ae93-8c55-4182-8272-29c411e4b079 tempest-VolumesGetTestJSON-167718473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33724b0f-54f8-46f3-a470-d8b5ce5b1660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:38:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1902419477',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f23eefcb-f5c2-4466-a965-cd0bc0b466e5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7c8514a73cf44298b1f162c58c1f14fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:38:03Z,use_quota=True,user_id='3da5eda5ece84117979d3d3ecc8339a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:38:03 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-ae0346d3-a979-4ab8-afd1-97b70d22f2b3 req-9217ae93-8c55-4182-8272-29c411e4b079 tempest-VolumesGetTestJSON-167718473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daa0ac00-768e-4fc0-855d-0f03eac92124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:38:03 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-ae0346d3-a979-4ab8-afd1-97b70d22f2b3 req-9217ae93-8c55-4182-8272-29c411e4b079 tempest-VolumesGetTestJSON-167718473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daa0ac00-768e-4fc0-855d-0f03eac92124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:38:03 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-ae0346d3-a979-4ab8-afd1-97b70d22f2b3 req-9217ae93-8c55-4182-8272-29c411e4b079 tempest-VolumesGetTestJSON-167718473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b549747e-44ce-4f1c-9a7b-f32d8112d6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:38:03 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-ae0346d3-a979-4ab8-afd1-97b70d22f2b3 req-9217ae93-8c55-4182-8272-29c411e4b079 tempest-VolumesGetTestJSON-167718473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b549747e-44ce-4f1c-9a7b-f32d8112d6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f23eefcb-f5c2-4466-a965-cd0bc0b466e5', 'volume_name': 'volume-f23eefcb-f5c2-4466-a965-cd0bc0b466e5', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:38:03 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-ae0346d3-a979-4ab8-afd1-97b70d22f2b3 req-9217ae93-8c55-4182-8272-29c411e4b079 tempest-VolumesGetTestJSON-167718473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0556c05-9568-49b6-9b46-ad0e58a02636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:38:03 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-ae0346d3-a979-4ab8-afd1-97b70d22f2b3 req-9217ae93-8c55-4182-8272-29c411e4b079 tempest-VolumesGetTestJSON-167718473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0556c05-9568-49b6-9b46-ad0e58a02636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:38:03 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-ae0346d3-a979-4ab8-afd1-97b70d22f2b3 req-9217ae93-8c55-4182-8272-29c411e4b079 tempest-VolumesGetTestJSON-167718473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a16242d3-044d-4c75-a1c5-dd4c64e6fa44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:38:03 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [req-ae0346d3-a979-4ab8-afd1-97b70d22f2b3 req-9217ae93-8c55-4182-8272-29c411e4b079 tempest-VolumesGetTestJSON-167718473 None] Volume f23eefcb-f5c2-4466-a965-cd0bc0b466e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f23eefcb-f5c2-4466-a965-cd0bc0b466e5', 'volume_size': 1}
Jul 10 12:38:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-ae0346d3-a979-4ab8-afd1-97b70d22f2b3 req-9217ae93-8c55-4182-8272-29c411e4b079 tempest-VolumesGetTestJSON-167718473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:38:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-ae0346d3-a979-4ab8-afd1-97b70d22f2b3 req-9217ae93-8c55-4182-8272-29c411e4b079 tempest-VolumesGetTestJSON-167718473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:38:03 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [req-ae0346d3-a979-4ab8-afd1-97b70d22f2b3 req-9217ae93-8c55-4182-8272-29c411e4b079 tempest-VolumesGetTestJSON-167718473 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:38:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1902419477',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f23eefcb-f5c2-4466-a965-cd0bc0b466e5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7c8514a73cf44298b1f162c58c1f14fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:38:03Z,use_quota=True,user_id='3da5eda5ece84117979d3d3ecc8339a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:38:03 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [req-ae0346d3-a979-4ab8-afd1-97b70d22f2b3 req-9217ae93-8c55-4182-8272-29c411e4b079 tempest-VolumesGetTestJSON-167718473 None] Creating volume f23eefcb-f5c2-4466-a965-cd0bc0b466e5 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:38:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-ae0346d3-a979-4ab8-afd1-97b70d22f2b3 req-9217ae93-8c55-4182-8272-29c411e4b079 tempest-VolumesGetTestJSON-167718473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:38:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-ae0346d3-a979-4ab8-afd1-97b70d22f2b3 req-9217ae93-8c55-4182-8272-29c411e4b079 tempest-VolumesGetTestJSON-167718473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:38:03 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [req-ae0346d3-a979-4ab8-afd1-97b70d22f2b3 req-9217ae93-8c55-4182-8272-29c411e4b079 tempest-VolumesGetTestJSON-167718473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:38:03 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [req-ae0346d3-a979-4ab8-afd1-97b70d22f2b3 req-9217ae93-8c55-4182-8272-29c411e4b079 tempest-VolumesGetTestJSON-167718473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:38:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-ae0346d3-a979-4ab8-afd1-97b70d22f2b3 req-9217ae93-8c55-4182-8272-29c411e4b079 tempest-VolumesGetTestJSON-167718473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:38:03 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [req-ae0346d3-a979-4ab8-afd1-97b70d22f2b3 req-9217ae93-8c55-4182-8272-29c411e4b079 tempest-VolumesGetTestJSON-167718473 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:38:03 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [req-ae0346d3-a979-4ab8-afd1-97b70d22f2b3 req-9217ae93-8c55-4182-8272-29c411e4b079 tempest-VolumesGetTestJSON-167718473 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:38:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-ae0346d3-a979-4ab8-afd1-97b70d22f2b3 req-9217ae93-8c55-4182-8272-29c411e4b079 tempest-VolumesGetTestJSON-167718473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f23eefcb-f5c2-4466-a965-cd0bc0b466e5 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:38:03 devstack sudo[88972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f23eefcb-f5c2-4466-a965-cd0bc0b466e5 1073741824
Jul 10 12:38:03 devstack sudo[88972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:38:04 devstack sudo[88972]: pam_unix(sudo:session): session closed for user root
Jul 10 12:38:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-ae0346d3-a979-4ab8-afd1-97b70d22f2b3 req-9217ae93-8c55-4182-8272-29c411e4b079 tempest-VolumesGetTestJSON-167718473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f23eefcb-f5c2-4466-a965-cd0bc0b466e5 1073741824" returned: 0 in 0.909s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:38:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-ae0346d3-a979-4ab8-afd1-97b70d22f2b3 req-9217ae93-8c55-4182-8272-29c411e4b079 tempest-VolumesGetTestJSON-167718473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f23eefcb-f5c2-4466-a965-cd0bc0b466e5 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:38:04 devstack sudo[88983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f23eefcb-f5c2-4466-a965-cd0bc0b466e5
Jul 10 12:38:04 devstack sudo[88983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:38:04 devstack cinder-volume[87378]: INFO cinder.volume.manager [req-12185200-84eb-4058-83cd-187e6eb0e9bd req-5e371987-33a6-4cbd-bdc7-b5ecef0ef56c tempest-DeleteServersTestJSON-214782097 None] Terminate volume connection completed successfully.
Jul 10 12:38:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-12185200-84eb-4058-83cd-187e6eb0e9bd req-5e371987-33a6-4cbd-bdc7-b5ecef0ef56c tempest-DeleteServersTestJSON-214782097 None] Deleting attachment 274a5a19-2e83-4095-b019-11631c6bdbf8. {{(pid=87378) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 10 12:38:04 devstack sudo[88983]: pam_unix(sudo:session): session closed for user root
Jul 10 12:38:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-ae0346d3-a979-4ab8-afd1-97b70d22f2b3 req-9217ae93-8c55-4182-8272-29c411e4b079 tempest-VolumesGetTestJSON-167718473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f23eefcb-f5c2-4466-a965-cd0bc0b466e5" returned: 0 in 0.796s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:38:04 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [req-ae0346d3-a979-4ab8-afd1-97b70d22f2b3 req-9217ae93-8c55-4182-8272-29c411e4b079 tempest-VolumesGetTestJSON-167718473 None] <== create_volume: return (1758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:38:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-ae0346d3-a979-4ab8-afd1-97b70d22f2b3 req-9217ae93-8c55-4182-8272-29c411e4b079 tempest-VolumesGetTestJSON-167718473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.760s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:38:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-ae0346d3-a979-4ab8-afd1-97b70d22f2b3 req-9217ae93-8c55-4182-8272-29c411e4b079 tempest-VolumesGetTestJSON-167718473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a16242d3-044d-4c75-a1c5-dd4c64e6fa44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f23eefcb-f5c2-4466-a965-cd0bc0b466e5', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:38:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-ae0346d3-a979-4ab8-afd1-97b70d22f2b3 req-9217ae93-8c55-4182-8272-29c411e4b079 tempest-VolumesGetTestJSON-167718473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (530a8bd2-a588-49fe-8573-9e30cc6d20cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:38:04 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [req-ae0346d3-a979-4ab8-afd1-97b70d22f2b3 req-9217ae93-8c55-4182-8272-29c411e4b079 tempest-VolumesGetTestJSON-167718473 None] Volume volume-f23eefcb-f5c2-4466-a965-cd0bc0b466e5 (f23eefcb-f5c2-4466-a965-cd0bc0b466e5): created successfully
Jul 10 12:38:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-ae0346d3-a979-4ab8-afd1-97b70d22f2b3 req-9217ae93-8c55-4182-8272-29c411e4b079 tempest-VolumesGetTestJSON-167718473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (530a8bd2-a588-49fe-8573-9e30cc6d20cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:38:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-ae0346d3-a979-4ab8-afd1-97b70d22f2b3 req-9217ae93-8c55-4182-8272-29c411e4b079 tempest-VolumesGetTestJSON-167718473 None] Flow 'volume_create_manager' (904c4fd4-51c0-403c-a494-48d09350d6e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:38:04 devstack cinder-volume[87378]: INFO cinder.volume.manager [req-ae0346d3-a979-4ab8-afd1-97b70d22f2b3 req-9217ae93-8c55-4182-8272-29c411e4b079 tempest-VolumesGetTestJSON-167718473 None] Created volume successfully.
Jul 10 12:38:05 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-eea4849e-097c-411a-a5d2-8bda9e6578ee tempest-ServerActionsTestOtherA-1596451723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:38:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-eea4849e-097c-411a-a5d2-8bda9e6578ee tempest-ServerActionsTestOtherA-1596451723 None] Flow 'volume_create_manager' (332f3634-102b-474c-a37e-6c13f50862ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:38:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-eea4849e-097c-411a-a5d2-8bda9e6578ee tempest-ServerActionsTestOtherA-1596451723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9ce4ebc-74eb-43fb-9a03-b807d3a8fd3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:38:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-eea4849e-097c-411a-a5d2-8bda9e6578ee tempest-ServerActionsTestOtherA-1596451723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9ce4ebc-74eb-43fb-9a03-b807d3a8fd3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1249872216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22d1db9a-cea2-41e8-8d05-56498576704c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='260704e024b64736ae1efed35d0f572c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:38:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:38:05Z,use_quota=True,user_id='e9e77fb0ebe74c20b423f54e35024870',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:38:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-eea4849e-097c-411a-a5d2-8bda9e6578ee tempest-ServerActionsTestOtherA-1596451723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71dd9897-91d4-441f-91d2-56f64a38cb8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:38:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-eea4849e-097c-411a-a5d2-8bda9e6578ee tempest-ServerActionsTestOtherA-1596451723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71dd9897-91d4-441f-91d2-56f64a38cb8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:38:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-eea4849e-097c-411a-a5d2-8bda9e6578ee tempest-ServerActionsTestOtherA-1596451723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (938e14dd-dc2c-4035-93c9-f0e50d56b201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:38:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-eea4849e-097c-411a-a5d2-8bda9e6578ee tempest-ServerActionsTestOtherA-1596451723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (938e14dd-dc2c-4035-93c9-f0e50d56b201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22d1db9a-cea2-41e8-8d05-56498576704c', 'volume_name': 'volume-22d1db9a-cea2-41e8-8d05-56498576704c', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:38:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-eea4849e-097c-411a-a5d2-8bda9e6578ee tempest-ServerActionsTestOtherA-1596451723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f1a4b16-a449-417e-827c-ef62f058eb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:38:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-eea4849e-097c-411a-a5d2-8bda9e6578ee tempest-ServerActionsTestOtherA-1596451723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f1a4b16-a449-417e-827c-ef62f058eb45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:38:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-eea4849e-097c-411a-a5d2-8bda9e6578ee tempest-ServerActionsTestOtherA-1596451723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a85ffd8d-ef39-4748-a609-8e3d3412a7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:38:05 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-eea4849e-097c-411a-a5d2-8bda9e6578ee tempest-ServerActionsTestOtherA-1596451723 None] Volume 22d1db9a-cea2-41e8-8d05-56498576704c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22d1db9a-cea2-41e8-8d05-56498576704c', 'volume_size': 1}
Jul 10 12:38:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-eea4849e-097c-411a-a5d2-8bda9e6578ee tempest-ServerActionsTestOtherA-1596451723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:38:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-eea4849e-097c-411a-a5d2-8bda9e6578ee tempest-ServerActionsTestOtherA-1596451723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:38:05 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-eea4849e-097c-411a-a5d2-8bda9e6578ee tempest-ServerActionsTestOtherA-1596451723 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1249872216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22d1db9a-cea2-41e8-8d05-56498576704c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='260704e024b64736ae1efed35d0f572c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:38:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:38:05Z,use_quota=True,user_id='e9e77fb0ebe74c20b423f54e35024870',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:38:05 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-eea4849e-097c-411a-a5d2-8bda9e6578ee tempest-ServerActionsTestOtherA-1596451723 None] Creating volume 22d1db9a-cea2-41e8-8d05-56498576704c {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:38:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-eea4849e-097c-411a-a5d2-8bda9e6578ee tempest-ServerActionsTestOtherA-1596451723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:38:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-eea4849e-097c-411a-a5d2-8bda9e6578ee tempest-ServerActionsTestOtherA-1596451723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:38:05 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-eea4849e-097c-411a-a5d2-8bda9e6578ee tempest-ServerActionsTestOtherA-1596451723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:38:05 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-eea4849e-097c-411a-a5d2-8bda9e6578ee tempest-ServerActionsTestOtherA-1596451723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:38:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-eea4849e-097c-411a-a5d2-8bda9e6578ee tempest-ServerActionsTestOtherA-1596451723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:38:05 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-eea4849e-097c-411a-a5d2-8bda9e6578ee tempest-ServerActionsTestOtherA-1596451723 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:38:05 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-eea4849e-097c-411a-a5d2-8bda9e6578ee tempest-ServerActionsTestOtherA-1596451723 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:38:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-eea4849e-097c-411a-a5d2-8bda9e6578ee tempest-ServerActionsTestOtherA-1596451723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22d1db9a-cea2-41e8-8d05-56498576704c 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:38:05 devstack sudo[88989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22d1db9a-cea2-41e8-8d05-56498576704c 1073741824
Jul 10 12:38:05 devstack sudo[88989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:38:05 devstack cinder-volume[87378]: DEBUG cinder.coordination [req-b3f07ee2-6be5-4328-b97f-135bad808bd3 req-e321429a-4fdf-445c-ab12-da466220bcdd tempest-VolumesGetTestJSON-167718473 None] Acquiring lock "cinder-f23eefcb-f5c2-4466-a965-cd0bc0b466e5-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:38:05 devstack cinder-volume[87378]: DEBUG cinder.coordination [req-b3f07ee2-6be5-4328-b97f-135bad808bd3 req-e321429a-4fdf-445c-ab12-da466220bcdd tempest-VolumesGetTestJSON-167718473 None] Lock "cinder-f23eefcb-f5c2-4466-a965-cd0bc0b466e5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:38:05 devstack cinder-volume[87378]: DEBUG cinder.coordination [req-b3f07ee2-6be5-4328-b97f-135bad808bd3 req-e321429a-4fdf-445c-ab12-da466220bcdd tempest-VolumesGetTestJSON-167718473 None] Acquiring lock "cinder-quobyte-f23eefcb-f5c2-4466-a965-cd0bc0b466e5" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:38:05 devstack cinder-volume[87378]: DEBUG cinder.coordination [req-b3f07ee2-6be5-4328-b97f-135bad808bd3 req-e321429a-4fdf-445c-ab12-da466220bcdd tempest-VolumesGetTestJSON-167718473 None] Lock "cinder-quobyte-f23eefcb-f5c2-4466-a965-cd0bc0b466e5" acquired by "delete_volume" :: waited 0.018s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:38:05 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab424f5-edbe-472d-926e-45e23589b420]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:38:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-b3f07ee2-6be5-4328-b97f-135bad808bd3 req-e321429a-4fdf-445c-ab12-da466220bcdd tempest-VolumesGetTestJSON-167718473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f23eefcb-f5c2-4466-a965-cd0bc0b466e5 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:38:05 devstack sudo[88991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f23eefcb-f5c2-4466-a965-cd0bc0b466e5
Jul 10 12:38:05 devstack sudo[88991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:38:06 devstack sudo[88989]: pam_unix(sudo:session): session closed for user root
Jul 10 12:38:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-eea4849e-097c-411a-a5d2-8bda9e6578ee tempest-ServerActionsTestOtherA-1596451723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22d1db9a-cea2-41e8-8d05-56498576704c 1073741824" returned: 0 in 1.274s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:38:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-eea4849e-097c-411a-a5d2-8bda9e6578ee tempest-ServerActionsTestOtherA-1596451723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22d1db9a-cea2-41e8-8d05-56498576704c {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:38:06 devstack sudo[88999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22d1db9a-cea2-41e8-8d05-56498576704c
Jul 10 12:38:06 devstack sudo[88999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:38:06 devstack sudo[88991]: pam_unix(sudo:session): session closed for user root
Jul 10 12:38:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-b3f07ee2-6be5-4328-b97f-135bad808bd3 req-e321429a-4fdf-445c-ab12-da466220bcdd tempest-VolumesGetTestJSON-167718473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f23eefcb-f5c2-4466-a965-cd0bc0b466e5" returned: 0 in 1.030s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:38:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-b3f07ee2-6be5-4328-b97f-135bad808bd3 req-e321429a-4fdf-445c-ab12-da466220bcdd tempest-VolumesGetTestJSON-167718473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f23eefcb-f5c2-4466-a965-cd0bc0b466e5 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:38:06 devstack sudo[89001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f23eefcb-f5c2-4466-a965-cd0bc0b466e5
Jul 10 12:38:06 devstack sudo[89001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:38:07 devstack sudo[88999]: pam_unix(sudo:session): session closed for user root
Jul 10 12:38:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-eea4849e-097c-411a-a5d2-8bda9e6578ee tempest-ServerActionsTestOtherA-1596451723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22d1db9a-cea2-41e8-8d05-56498576704c" returned: 0 in 0.945s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:38:07 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-eea4849e-097c-411a-a5d2-8bda9e6578ee tempest-ServerActionsTestOtherA-1596451723 None] <== create_volume: return (2293ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:38:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-eea4849e-097c-411a-a5d2-8bda9e6578ee tempest-ServerActionsTestOtherA-1596451723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.301s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:38:07 devstack sudo[89001]: pam_unix(sudo:session): session closed for user root
Jul 10 12:38:07 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-eea4849e-097c-411a-a5d2-8bda9e6578ee tempest-ServerActionsTestOtherA-1596451723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a85ffd8d-ef39-4748-a609-8e3d3412a7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22d1db9a-cea2-41e8-8d05-56498576704c', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:38:07 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-eea4849e-097c-411a-a5d2-8bda9e6578ee tempest-ServerActionsTestOtherA-1596451723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f9f1be4-4797-4d52-8753-c4b2a70c1613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:38:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-b3f07ee2-6be5-4328-b97f-135bad808bd3 req-e321429a-4fdf-445c-ab12-da466220bcdd tempest-VolumesGetTestJSON-167718473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f23eefcb-f5c2-4466-a965-cd0bc0b466e5" returned: 0 in 0.912s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:38:07 devstack cinder-volume[87378]: DEBUG cinder.coordination [req-b3f07ee2-6be5-4328-b97f-135bad808bd3 req-e321429a-4fdf-445c-ab12-da466220bcdd tempest-VolumesGetTestJSON-167718473 None] Lock "cinder-quobyte-f23eefcb-f5c2-4466-a965-cd0bc0b466e5" released by "delete_volume" :: held 2.006s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:38:07 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-eea4849e-097c-411a-a5d2-8bda9e6578ee tempest-ServerActionsTestOtherA-1596451723 None] Volume volume-22d1db9a-cea2-41e8-8d05-56498576704c (22d1db9a-cea2-41e8-8d05-56498576704c): created successfully
Jul 10 12:38:07 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-eea4849e-097c-411a-a5d2-8bda9e6578ee tempest-ServerActionsTestOtherA-1596451723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f9f1be4-4797-4d52-8753-c4b2a70c1613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:38:07 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-eea4849e-097c-411a-a5d2-8bda9e6578ee tempest-ServerActionsTestOtherA-1596451723 None] Flow 'volume_create_manager' (332f3634-102b-474c-a37e-6c13f50862ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:38:07 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-eea4849e-097c-411a-a5d2-8bda9e6578ee tempest-ServerActionsTestOtherA-1596451723 None] Created volume successfully.
Jul 10 12:38:07 devstack cinder-volume[87378]: DEBUG cinder.quota [req-b3f07ee2-6be5-4328-b97f-135bad808bd3 req-e321429a-4fdf-445c-ab12-da466220bcdd tempest-VolumesGetTestJSON-167718473 None] Created reservations ['a91c8032-069e-41ec-be10-499a42324685', '8eb5e619-4eba-4a79-b609-6246122f2c49', 'f74105c6-7561-4d54-8db2-df12d2e11057', '8b77d860-ee94-4137-b8f1-7df9718f0658'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:38:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-b3f07ee2-6be5-4328-b97f-135bad808bd3 req-e321429a-4fdf-445c-ab12-da466220bcdd tempest-VolumesGetTestJSON-167718473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:38:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-b3f07ee2-6be5-4328-b97f-135bad808bd3 req-e321429a-4fdf-445c-ab12-da466220bcdd tempest-VolumesGetTestJSON-167718473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:38:07 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [req-b3f07ee2-6be5-4328-b97f-135bad808bd3 req-e321429a-4fdf-445c-ab12-da466220bcdd tempest-VolumesGetTestJSON-167718473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:38:07 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [req-b3f07ee2-6be5-4328-b97f-135bad808bd3 req-e321429a-4fdf-445c-ab12-da466220bcdd tempest-VolumesGetTestJSON-167718473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:38:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-b3f07ee2-6be5-4328-b97f-135bad808bd3 req-e321429a-4fdf-445c-ab12-da466220bcdd tempest-VolumesGetTestJSON-167718473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:38:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-b3f07ee2-6be5-4328-b97f-135bad808bd3 req-e321429a-4fdf-445c-ab12-da466220bcdd tempest-VolumesGetTestJSON-167718473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:38:08 devstack sudo[89006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:38:08 devstack sudo[89006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:38:08 devstack sudo[89006]: pam_unix(sudo:session): session closed for user root
Jul 10 12:38:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-b3f07ee2-6be5-4328-b97f-135bad808bd3 req-e321429a-4fdf-445c-ab12-da466220bcdd tempest-VolumesGetTestJSON-167718473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 1.021s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:38:08 devstack cinder-volume[87378]: DEBUG cinder.manager [req-b3f07ee2-6be5-4328-b97f-135bad808bd3 req-e321429a-4fdf-445c-ab12-da466220bcdd tempest-VolumesGetTestJSON-167718473 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:38:09 devstack cinder-volume[87378]: INFO cinder.volume.manager [req-b3f07ee2-6be5-4328-b97f-135bad808bd3 req-e321429a-4fdf-445c-ab12-da466220bcdd tempest-VolumesGetTestJSON-167718473 None] Deleted volume successfully.
Jul 10 12:38:09 devstack cinder-volume[87378]: DEBUG cinder.coordination [req-b3f07ee2-6be5-4328-b97f-135bad808bd3 req-e321429a-4fdf-445c-ab12-da466220bcdd tempest-VolumesGetTestJSON-167718473 None] Lock "cinder-f23eefcb-f5c2-4466-a965-cd0bc0b466e5-delete_volume" released by "delete_volume" :: held 3.395s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:38:09 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f21ac83b-43e9-4b2f-a27c-5c82e92bb867 tempest-DeleteServersTestJSON-214782097 None] Acquiring lock "cinder-62e1b330-df3a-495e-9692-0d2e51d76800-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:38:09 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f21ac83b-43e9-4b2f-a27c-5c82e92bb867 tempest-DeleteServersTestJSON-214782097 None] Lock "cinder-62e1b330-df3a-495e-9692-0d2e51d76800-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:38:09 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f21ac83b-43e9-4b2f-a27c-5c82e92bb867 tempest-DeleteServersTestJSON-214782097 None] Acquiring lock "cinder-quobyte-62e1b330-df3a-495e-9692-0d2e51d76800" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:38:09 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f21ac83b-43e9-4b2f-a27c-5c82e92bb867 tempest-DeleteServersTestJSON-214782097 None] Lock "cinder-quobyte-62e1b330-df3a-495e-9692-0d2e51d76800" acquired by "delete_volume" :: waited 0.026s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:38:09 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a90188-a833-4d36-8b66-87dbbecbc7fd]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:38:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f21ac83b-43e9-4b2f-a27c-5c82e92bb867 tempest-DeleteServersTestJSON-214782097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-62e1b330-df3a-495e-9692-0d2e51d76800 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:38:09 devstack sudo[89014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-62e1b330-df3a-495e-9692-0d2e51d76800
Jul 10 12:38:09 devstack sudo[89014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:38:10 devstack sudo[89014]: pam_unix(sudo:session): session closed for user root
Jul 10 12:38:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f21ac83b-43e9-4b2f-a27c-5c82e92bb867 tempest-DeleteServersTestJSON-214782097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-62e1b330-df3a-495e-9692-0d2e51d76800" returned: 0 in 0.955s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:38:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f21ac83b-43e9-4b2f-a27c-5c82e92bb867 tempest-DeleteServersTestJSON-214782097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-62e1b330-df3a-495e-9692-0d2e51d76800 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:38:10 devstack sudo[89022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-62e1b330-df3a-495e-9692-0d2e51d76800
Jul 10 12:38:10 devstack sudo[89022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:38:11 devstack sudo[89022]: pam_unix(sudo:session): session closed for user root
Jul 10 12:38:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f21ac83b-43e9-4b2f-a27c-5c82e92bb867 tempest-DeleteServersTestJSON-214782097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-62e1b330-df3a-495e-9692-0d2e51d76800" returned: 0 in 0.735s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:38:11 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f21ac83b-43e9-4b2f-a27c-5c82e92bb867 tempest-DeleteServersTestJSON-214782097 None] Lock "cinder-quobyte-62e1b330-df3a-495e-9692-0d2e51d76800" released by "delete_volume" :: held 1.759s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:38:11 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-f21ac83b-43e9-4b2f-a27c-5c82e92bb867 tempest-DeleteServersTestJSON-214782097 None] Created reservations ['d1255175-4e45-438f-8526-7f865dce7e96', '4faac8fc-e075-4ee4-af74-7b1fe344731f', 'a191f0f3-e960-4334-a71a-2182e2b29fdc', '3fc09b52-f541-4732-9a8a-d9f42ab3aca2'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:38:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f21ac83b-43e9-4b2f-a27c-5c82e92bb867 tempest-DeleteServersTestJSON-214782097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:38:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f21ac83b-43e9-4b2f-a27c-5c82e92bb867 tempest-DeleteServersTestJSON-214782097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:38:11 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-f21ac83b-43e9-4b2f-a27c-5c82e92bb867 tempest-DeleteServersTestJSON-214782097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:38:11 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-f21ac83b-43e9-4b2f-a27c-5c82e92bb867 tempest-DeleteServersTestJSON-214782097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:38:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f21ac83b-43e9-4b2f-a27c-5c82e92bb867 tempest-DeleteServersTestJSON-214782097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:38:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f21ac83b-43e9-4b2f-a27c-5c82e92bb867 tempest-DeleteServersTestJSON-214782097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:38:11 devstack sudo[89026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:38:11 devstack sudo[89026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:38:12 devstack sudo[89026]: pam_unix(sudo:session): session closed for user root
Jul 10 12:38:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f21ac83b-43e9-4b2f-a27c-5c82e92bb867 tempest-DeleteServersTestJSON-214782097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.780s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:38:12 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-f21ac83b-43e9-4b2f-a27c-5c82e92bb867 tempest-DeleteServersTestJSON-214782097 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:38:12 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-f21ac83b-43e9-4b2f-a27c-5c82e92bb867 tempest-DeleteServersTestJSON-214782097 None] Deleted volume successfully.
Jul 10 12:38:12 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f21ac83b-43e9-4b2f-a27c-5c82e92bb867 tempest-DeleteServersTestJSON-214782097 None] Lock "cinder-62e1b330-df3a-495e-9692-0d2e51d76800-delete_volume" released by "delete_volume" :: held 2.949s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:38:12 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:38:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:38:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:38:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:38:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:38:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:38:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:38:13 devstack sudo[89066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:38:13 devstack sudo[89066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:38:13 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-44dd4214-1425-4d38-93f2-ad58c62d74a0 tempest-VolumesTestJSON-502298121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:38:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-44dd4214-1425-4d38-93f2-ad58c62d74a0 tempest-VolumesTestJSON-502298121 None] Flow 'volume_create_manager' (b48919ac-2544-45c1-984d-ea7ce6ae33e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:38:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-44dd4214-1425-4d38-93f2-ad58c62d74a0 tempest-VolumesTestJSON-502298121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ed95f99-0e85-4181-9aff-ce5ce98df7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:38:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-44dd4214-1425-4d38-93f2-ad58c62d74a0 tempest-VolumesTestJSON-502298121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ed95f99-0e85-4181-9aff-ce5ce98df7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1784900109',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57982841-7fc2-4572-afd4-d323d202700f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='85b4d97bf6b14e93864d751f6eab6f6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:38:14Z,use_quota=True,user_id='65ad2bb6bec647bfa6f0913f633bc365',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:38:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-44dd4214-1425-4d38-93f2-ad58c62d74a0 tempest-VolumesTestJSON-502298121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b9ba152-f30e-4e39-b418-441e10188bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:38:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-44dd4214-1425-4d38-93f2-ad58c62d74a0 tempest-VolumesTestJSON-502298121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b9ba152-f30e-4e39-b418-441e10188bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:38:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-44dd4214-1425-4d38-93f2-ad58c62d74a0 tempest-VolumesTestJSON-502298121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ea2f24a-5f9e-4e26-864e-9e01b38d3518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:38:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-44dd4214-1425-4d38-93f2-ad58c62d74a0 tempest-VolumesTestJSON-502298121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ea2f24a-5f9e-4e26-864e-9e01b38d3518) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57982841-7fc2-4572-afd4-d323d202700f', 'volume_name': 'volume-57982841-7fc2-4572-afd4-d323d202700f', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:38:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-44dd4214-1425-4d38-93f2-ad58c62d74a0 tempest-VolumesTestJSON-502298121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e53a29d-2253-499e-afba-9cbeadd017f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:38:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-44dd4214-1425-4d38-93f2-ad58c62d74a0 tempest-VolumesTestJSON-502298121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e53a29d-2253-499e-afba-9cbeadd017f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:38:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-44dd4214-1425-4d38-93f2-ad58c62d74a0 tempest-VolumesTestJSON-502298121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42aa0248-e0cd-4700-9c9c-129bb730da50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:38:13 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-44dd4214-1425-4d38-93f2-ad58c62d74a0 tempest-VolumesTestJSON-502298121 None] Volume 57982841-7fc2-4572-afd4-d323d202700f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57982841-7fc2-4572-afd4-d323d202700f', 'volume_size': 1}
Jul 10 12:38:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-44dd4214-1425-4d38-93f2-ad58c62d74a0 tempest-VolumesTestJSON-502298121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:38:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-44dd4214-1425-4d38-93f2-ad58c62d74a0 tempest-VolumesTestJSON-502298121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:38:13 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-44dd4214-1425-4d38-93f2-ad58c62d74a0 tempest-VolumesTestJSON-502298121 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1784900109',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57982841-7fc2-4572-afd4-d323d202700f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='85b4d97bf6b14e93864d751f6eab6f6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:38:14Z,use_quota=True,user_id='65ad2bb6bec647bfa6f0913f633bc365',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:38:13 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-44dd4214-1425-4d38-93f2-ad58c62d74a0 tempest-VolumesTestJSON-502298121 None] Creating volume 57982841-7fc2-4572-afd4-d323d202700f {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:38:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-44dd4214-1425-4d38-93f2-ad58c62d74a0 tempest-VolumesTestJSON-502298121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:38:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-44dd4214-1425-4d38-93f2-ad58c62d74a0 tempest-VolumesTestJSON-502298121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:38:13 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-44dd4214-1425-4d38-93f2-ad58c62d74a0 tempest-VolumesTestJSON-502298121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:38:13 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-44dd4214-1425-4d38-93f2-ad58c62d74a0 tempest-VolumesTestJSON-502298121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:38:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-44dd4214-1425-4d38-93f2-ad58c62d74a0 tempest-VolumesTestJSON-502298121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:38:13 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-44dd4214-1425-4d38-93f2-ad58c62d74a0 tempest-VolumesTestJSON-502298121 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:38:13 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-44dd4214-1425-4d38-93f2-ad58c62d74a0 tempest-VolumesTestJSON-502298121 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:38:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-44dd4214-1425-4d38-93f2-ad58c62d74a0 tempest-VolumesTestJSON-502298121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57982841-7fc2-4572-afd4-d323d202700f 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:38:13 devstack sudo[89069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57982841-7fc2-4572-afd4-d323d202700f 1073741824
Jul 10 12:38:13 devstack sudo[89069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:38:13 devstack sudo[89066]: pam_unix(sudo:session): session closed for user root
Jul 10 12:38:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 1.018s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:38:13 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:38:13 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager._thread_info {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:38:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread count: 8 {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 10 12:38:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread info: [<_MainThread(MainThread, started 128233544536192)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128233445424704)>, <Thread(Thread-3 (stat_writer), started daemon 128233435118528)>, <Thread(Rabbit-heartbeat, started daemon 128233435718016)>, <Thread(Thread-5 (_runner), started daemon 128233432624448)>, <Thread(Thread-7 (_runner), started daemon 128233432674688)>, <Thread(fd_logger, started daemon 128233428569472)>, <Thread(privsep_reader, started daemon 128233429417088)>] {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 10 12:38:14 devstack sudo[89069]: pam_unix(sudo:session): session closed for user root
Jul 10 12:38:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-44dd4214-1425-4d38-93f2-ad58c62d74a0 tempest-VolumesTestJSON-502298121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57982841-7fc2-4572-afd4-d323d202700f 1073741824" returned: 0 in 1.039s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:38:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-44dd4214-1425-4d38-93f2-ad58c62d74a0 tempest-VolumesTestJSON-502298121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57982841-7fc2-4572-afd4-d323d202700f {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:38:14 devstack sudo[89078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57982841-7fc2-4572-afd4-d323d202700f
Jul 10 12:38:14 devstack sudo[89078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:38:15 devstack sudo[89078]: pam_unix(sudo:session): session closed for user root
Jul 10 12:38:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-44dd4214-1425-4d38-93f2-ad58c62d74a0 tempest-VolumesTestJSON-502298121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57982841-7fc2-4572-afd4-d323d202700f" returned: 0 in 0.739s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:38:15 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-44dd4214-1425-4d38-93f2-ad58c62d74a0 tempest-VolumesTestJSON-502298121 None] <== create_volume: return (1856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:38:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-44dd4214-1425-4d38-93f2-ad58c62d74a0 tempest-VolumesTestJSON-502298121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.860s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:38:15 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-44dd4214-1425-4d38-93f2-ad58c62d74a0 tempest-VolumesTestJSON-502298121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42aa0248-e0cd-4700-9c9c-129bb730da50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57982841-7fc2-4572-afd4-d323d202700f', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:38:15 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-44dd4214-1425-4d38-93f2-ad58c62d74a0 tempest-VolumesTestJSON-502298121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4022c9c5-3704-4053-aaf7-22b270f7a89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:38:15 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-44dd4214-1425-4d38-93f2-ad58c62d74a0 tempest-VolumesTestJSON-502298121 None] Volume volume-57982841-7fc2-4572-afd4-d323d202700f (57982841-7fc2-4572-afd4-d323d202700f): created successfully
Jul 10 12:38:15 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-44dd4214-1425-4d38-93f2-ad58c62d74a0 tempest-VolumesTestJSON-502298121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4022c9c5-3704-4053-aaf7-22b270f7a89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:38:15 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-44dd4214-1425-4d38-93f2-ad58c62d74a0 tempest-VolumesTestJSON-502298121 None] Flow 'volume_create_manager' (b48919ac-2544-45c1-984d-ea7ce6ae33e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:38:15 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-44dd4214-1425-4d38-93f2-ad58c62d74a0 tempest-VolumesTestJSON-502298121 None] Created volume successfully.
Jul 10 12:38:17 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c317c01-ee30-42ea-883d-47e74878242d tempest-VolumesTestJSON-502298121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:38:17 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0c317c01-ee30-42ea-883d-47e74878242d tempest-VolumesTestJSON-502298121 None] Flow 'volume_create_manager' (de58a83b-c893-4203-ae2a-1e80d56530f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:38:17 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0c317c01-ee30-42ea-883d-47e74878242d tempest-VolumesTestJSON-502298121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (411c8552-174c-4322-94eb-3773d13abef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:38:17 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0c317c01-ee30-42ea-883d-47e74878242d tempest-VolumesTestJSON-502298121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (411c8552-174c-4322-94eb-3773d13abef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:38:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1297738131',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc71668f-a4a1-46af-ae27-01e2c27aa44b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='85b4d97bf6b14e93864d751f6eab6f6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:38:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:38:17Z,use_quota=True,user_id='65ad2bb6bec647bfa6f0913f633bc365',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:38:17 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0c317c01-ee30-42ea-883d-47e74878242d tempest-VolumesTestJSON-502298121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (242c402f-35ab-45d2-9c74-7ab58c6a66aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:38:17 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0c317c01-ee30-42ea-883d-47e74878242d tempest-VolumesTestJSON-502298121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (242c402f-35ab-45d2-9c74-7ab58c6a66aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:38:17 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0c317c01-ee30-42ea-883d-47e74878242d tempest-VolumesTestJSON-502298121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee189488-fa5a-4e5b-bd13-3932a224e7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:38:17 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0c317c01-ee30-42ea-883d-47e74878242d tempest-VolumesTestJSON-502298121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee189488-fa5a-4e5b-bd13-3932a224e7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc71668f-a4a1-46af-ae27-01e2c27aa44b', 'volume_name': 'volume-fc71668f-a4a1-46af-ae27-01e2c27aa44b', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:38:17 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0c317c01-ee30-42ea-883d-47e74878242d tempest-VolumesTestJSON-502298121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (507b4678-e13c-4e16-a470-631757724cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:38:17 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0c317c01-ee30-42ea-883d-47e74878242d tempest-VolumesTestJSON-502298121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (507b4678-e13c-4e16-a470-631757724cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:38:17 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0c317c01-ee30-42ea-883d-47e74878242d tempest-VolumesTestJSON-502298121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2387e548-7065-43ea-8917-a526fedc1f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:38:17 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-0c317c01-ee30-42ea-883d-47e74878242d tempest-VolumesTestJSON-502298121 None] Volume fc71668f-a4a1-46af-ae27-01e2c27aa44b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc71668f-a4a1-46af-ae27-01e2c27aa44b', 'volume_size': 1}
Jul 10 12:38:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0c317c01-ee30-42ea-883d-47e74878242d tempest-VolumesTestJSON-502298121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:38:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0c317c01-ee30-42ea-883d-47e74878242d tempest-VolumesTestJSON-502298121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:38:17 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-0c317c01-ee30-42ea-883d-47e74878242d tempest-VolumesTestJSON-502298121 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:38:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1297738131',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc71668f-a4a1-46af-ae27-01e2c27aa44b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='85b4d97bf6b14e93864d751f6eab6f6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:38:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:38:17Z,use_quota=True,user_id='65ad2bb6bec647bfa6f0913f633bc365',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:38:17 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-0c317c01-ee30-42ea-883d-47e74878242d tempest-VolumesTestJSON-502298121 None] Creating volume fc71668f-a4a1-46af-ae27-01e2c27aa44b {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:38:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0c317c01-ee30-42ea-883d-47e74878242d tempest-VolumesTestJSON-502298121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:38:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0c317c01-ee30-42ea-883d-47e74878242d tempest-VolumesTestJSON-502298121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:38:17 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-0c317c01-ee30-42ea-883d-47e74878242d tempest-VolumesTestJSON-502298121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:38:17 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-0c317c01-ee30-42ea-883d-47e74878242d tempest-VolumesTestJSON-502298121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:38:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0c317c01-ee30-42ea-883d-47e74878242d tempest-VolumesTestJSON-502298121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:38:17 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-0c317c01-ee30-42ea-883d-47e74878242d tempest-VolumesTestJSON-502298121 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:38:17 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-0c317c01-ee30-42ea-883d-47e74878242d tempest-VolumesTestJSON-502298121 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:38:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0c317c01-ee30-42ea-883d-47e74878242d tempest-VolumesTestJSON-502298121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fc71668f-a4a1-46af-ae27-01e2c27aa44b 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:38:17 devstack sudo[89100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fc71668f-a4a1-46af-ae27-01e2c27aa44b 1073741824
Jul 10 12:38:17 devstack sudo[89100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:38:18 devstack sudo[89100]: pam_unix(sudo:session): session closed for user root
Jul 10 12:38:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0c317c01-ee30-42ea-883d-47e74878242d tempest-VolumesTestJSON-502298121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fc71668f-a4a1-46af-ae27-01e2c27aa44b 1073741824" returned: 0 in 1.109s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:38:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0c317c01-ee30-42ea-883d-47e74878242d tempest-VolumesTestJSON-502298121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fc71668f-a4a1-46af-ae27-01e2c27aa44b {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:38:18 devstack sudo[89117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fc71668f-a4a1-46af-ae27-01e2c27aa44b
Jul 10 12:38:18 devstack sudo[89117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:38:19 devstack sudo[89117]: pam_unix(sudo:session): session closed for user root
Jul 10 12:38:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0c317c01-ee30-42ea-883d-47e74878242d tempest-VolumesTestJSON-502298121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fc71668f-a4a1-46af-ae27-01e2c27aa44b" returned: 0 in 0.892s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:38:19 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-0c317c01-ee30-42ea-883d-47e74878242d tempest-VolumesTestJSON-502298121 None] <== create_volume: return (2043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:38:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0c317c01-ee30-42ea-883d-47e74878242d tempest-VolumesTestJSON-502298121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.046s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:38:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0c317c01-ee30-42ea-883d-47e74878242d tempest-VolumesTestJSON-502298121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2387e548-7065-43ea-8917-a526fedc1f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc71668f-a4a1-46af-ae27-01e2c27aa44b', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:38:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0c317c01-ee30-42ea-883d-47e74878242d tempest-VolumesTestJSON-502298121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (854a8668-123d-4998-877f-d385312ad5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:38:19 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-0c317c01-ee30-42ea-883d-47e74878242d tempest-VolumesTestJSON-502298121 None] Volume volume-fc71668f-a4a1-46af-ae27-01e2c27aa44b (fc71668f-a4a1-46af-ae27-01e2c27aa44b): created successfully
Jul 10 12:38:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0c317c01-ee30-42ea-883d-47e74878242d tempest-VolumesTestJSON-502298121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (854a8668-123d-4998-877f-d385312ad5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:38:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0c317c01-ee30-42ea-883d-47e74878242d tempest-VolumesTestJSON-502298121 None] Flow 'volume_create_manager' (de58a83b-c893-4203-ae2a-1e80d56530f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:38:19 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-0c317c01-ee30-42ea-883d-47e74878242d tempest-VolumesTestJSON-502298121 None] Created volume successfully.
Jul 10 12:38:21 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-3848d551-4d62-4085-a279-92af11cbb7bc tempest-VolumesTestJSON-502298121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:38:21 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3848d551-4d62-4085-a279-92af11cbb7bc tempest-VolumesTestJSON-502298121 None] Flow 'volume_create_manager' (6adda0b2-4f81-47bd-9ebc-fd8dec129c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:38:21 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3848d551-4d62-4085-a279-92af11cbb7bc tempest-VolumesTestJSON-502298121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85604e9b-9508-493c-978c-04714ffecf23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:38:21 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3848d551-4d62-4085-a279-92af11cbb7bc tempest-VolumesTestJSON-502298121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85604e9b-9508-493c-978c-04714ffecf23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:38:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1218951708',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54305a8b-2281-4119-aad8-9ed9d5fbbbc9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='85b4d97bf6b14e93864d751f6eab6f6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:38:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:38:21Z,use_quota=True,user_id='65ad2bb6bec647bfa6f0913f633bc365',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:38:21 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3848d551-4d62-4085-a279-92af11cbb7bc tempest-VolumesTestJSON-502298121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f11e48e-7039-4636-8ae0-56e4fdfeee21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:38:21 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3848d551-4d62-4085-a279-92af11cbb7bc tempest-VolumesTestJSON-502298121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f11e48e-7039-4636-8ae0-56e4fdfeee21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:38:21 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3848d551-4d62-4085-a279-92af11cbb7bc tempest-VolumesTestJSON-502298121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72fe3a94-7e27-4a5e-bff7-772461836a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:38:21 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3848d551-4d62-4085-a279-92af11cbb7bc tempest-VolumesTestJSON-502298121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72fe3a94-7e27-4a5e-bff7-772461836a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54305a8b-2281-4119-aad8-9ed9d5fbbbc9', 'volume_name': 'volume-54305a8b-2281-4119-aad8-9ed9d5fbbbc9', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:38:21 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3848d551-4d62-4085-a279-92af11cbb7bc tempest-VolumesTestJSON-502298121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f73117-ee0c-4ebf-9318-1bca85f120e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:38:21 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3848d551-4d62-4085-a279-92af11cbb7bc tempest-VolumesTestJSON-502298121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f73117-ee0c-4ebf-9318-1bca85f120e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:38:21 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3848d551-4d62-4085-a279-92af11cbb7bc tempest-VolumesTestJSON-502298121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09ccc2a5-8e9e-443f-bc24-3c1dca32396d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:38:21 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-3848d551-4d62-4085-a279-92af11cbb7bc tempest-VolumesTestJSON-502298121 None] Volume 54305a8b-2281-4119-aad8-9ed9d5fbbbc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54305a8b-2281-4119-aad8-9ed9d5fbbbc9', 'volume_size': 1}
Jul 10 12:38:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3848d551-4d62-4085-a279-92af11cbb7bc tempest-VolumesTestJSON-502298121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:38:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3848d551-4d62-4085-a279-92af11cbb7bc tempest-VolumesTestJSON-502298121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:38:21 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3848d551-4d62-4085-a279-92af11cbb7bc tempest-VolumesTestJSON-502298121 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:38:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1218951708',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54305a8b-2281-4119-aad8-9ed9d5fbbbc9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='85b4d97bf6b14e93864d751f6eab6f6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:38:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:38:21Z,use_quota=True,user_id='65ad2bb6bec647bfa6f0913f633bc365',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:38:21 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-3848d551-4d62-4085-a279-92af11cbb7bc tempest-VolumesTestJSON-502298121 None] Creating volume 54305a8b-2281-4119-aad8-9ed9d5fbbbc9 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:38:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3848d551-4d62-4085-a279-92af11cbb7bc tempest-VolumesTestJSON-502298121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:38:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3848d551-4d62-4085-a279-92af11cbb7bc tempest-VolumesTestJSON-502298121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:38:21 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3848d551-4d62-4085-a279-92af11cbb7bc tempest-VolumesTestJSON-502298121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:38:21 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3848d551-4d62-4085-a279-92af11cbb7bc tempest-VolumesTestJSON-502298121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:38:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3848d551-4d62-4085-a279-92af11cbb7bc tempest-VolumesTestJSON-502298121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:38:21 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3848d551-4d62-4085-a279-92af11cbb7bc tempest-VolumesTestJSON-502298121 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:38:21 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-3848d551-4d62-4085-a279-92af11cbb7bc tempest-VolumesTestJSON-502298121 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:38:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3848d551-4d62-4085-a279-92af11cbb7bc tempest-VolumesTestJSON-502298121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-54305a8b-2281-4119-aad8-9ed9d5fbbbc9 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:38:21 devstack sudo[89121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-54305a8b-2281-4119-aad8-9ed9d5fbbbc9 1073741824
Jul 10 12:38:21 devstack sudo[89121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:38:22 devstack sudo[89121]: pam_unix(sudo:session): session closed for user root
Jul 10 12:38:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3848d551-4d62-4085-a279-92af11cbb7bc tempest-VolumesTestJSON-502298121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-54305a8b-2281-4119-aad8-9ed9d5fbbbc9 1073741824" returned: 0 in 1.219s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:38:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3848d551-4d62-4085-a279-92af11cbb7bc tempest-VolumesTestJSON-502298121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-54305a8b-2281-4119-aad8-9ed9d5fbbbc9 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:38:22 devstack sudo[89145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-54305a8b-2281-4119-aad8-9ed9d5fbbbc9
Jul 10 12:38:22 devstack sudo[89145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:38:23 devstack sudo[89145]: pam_unix(sudo:session): session closed for user root
Jul 10 12:38:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3848d551-4d62-4085-a279-92af11cbb7bc tempest-VolumesTestJSON-502298121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-54305a8b-2281-4119-aad8-9ed9d5fbbbc9" returned: 0 in 0.864s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:38:23 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3848d551-4d62-4085-a279-92af11cbb7bc tempest-VolumesTestJSON-502298121 None] <== create_volume: return (2149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:38:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3848d551-4d62-4085-a279-92af11cbb7bc tempest-VolumesTestJSON-502298121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.152s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:38:23 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3848d551-4d62-4085-a279-92af11cbb7bc tempest-VolumesTestJSON-502298121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09ccc2a5-8e9e-443f-bc24-3c1dca32396d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54305a8b-2281-4119-aad8-9ed9d5fbbbc9', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:38:23 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3848d551-4d62-4085-a279-92af11cbb7bc tempest-VolumesTestJSON-502298121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1040ef76-8356-4984-8048-f5f1863c42b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:38:23 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-3848d551-4d62-4085-a279-92af11cbb7bc tempest-VolumesTestJSON-502298121 None] Volume volume-54305a8b-2281-4119-aad8-9ed9d5fbbbc9 (54305a8b-2281-4119-aad8-9ed9d5fbbbc9): created successfully
Jul 10 12:38:23 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3848d551-4d62-4085-a279-92af11cbb7bc tempest-VolumesTestJSON-502298121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1040ef76-8356-4984-8048-f5f1863c42b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:38:23 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3848d551-4d62-4085-a279-92af11cbb7bc tempest-VolumesTestJSON-502298121 None] Flow 'volume_create_manager' (6adda0b2-4f81-47bd-9ebc-fd8dec129c1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:38:23 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-3848d551-4d62-4085-a279-92af11cbb7bc tempest-VolumesTestJSON-502298121 None] Created volume successfully.
Jul 10 12:38:26 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-802849fa-6894-453a-a227-c79e32bda8c7 tempest-VolumesTestJSON-502298121 None] Acquiring lock "cinder-54305a8b-2281-4119-aad8-9ed9d5fbbbc9-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:38:26 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-802849fa-6894-453a-a227-c79e32bda8c7 tempest-VolumesTestJSON-502298121 None] Lock "cinder-54305a8b-2281-4119-aad8-9ed9d5fbbbc9-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:38:26 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-802849fa-6894-453a-a227-c79e32bda8c7 tempest-VolumesTestJSON-502298121 None] Acquiring lock "cinder-quobyte-54305a8b-2281-4119-aad8-9ed9d5fbbbc9" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:38:26 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-802849fa-6894-453a-a227-c79e32bda8c7 tempest-VolumesTestJSON-502298121 None] Lock "cinder-quobyte-54305a8b-2281-4119-aad8-9ed9d5fbbbc9" acquired by "delete_volume" :: waited 0.031s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:38:26 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89a37d6-9cb9-4114-ac3b-81df996d80b9]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:38:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-802849fa-6894-453a-a227-c79e32bda8c7 tempest-VolumesTestJSON-502298121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-54305a8b-2281-4119-aad8-9ed9d5fbbbc9 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:38:26 devstack sudo[89173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-54305a8b-2281-4119-aad8-9ed9d5fbbbc9
Jul 10 12:38:26 devstack sudo[89173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:38:27 devstack sudo[89173]: pam_unix(sudo:session): session closed for user root
Jul 10 12:38:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-802849fa-6894-453a-a227-c79e32bda8c7 tempest-VolumesTestJSON-502298121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-54305a8b-2281-4119-aad8-9ed9d5fbbbc9" returned: 0 in 1.177s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:38:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-802849fa-6894-453a-a227-c79e32bda8c7 tempest-VolumesTestJSON-502298121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-54305a8b-2281-4119-aad8-9ed9d5fbbbc9 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:38:27 devstack sudo[89178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-54305a8b-2281-4119-aad8-9ed9d5fbbbc9
Jul 10 12:38:27 devstack sudo[89178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:38:28 devstack sudo[89178]: pam_unix(sudo:session): session closed for user root
Jul 10 12:38:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-802849fa-6894-453a-a227-c79e32bda8c7 tempest-VolumesTestJSON-502298121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-54305a8b-2281-4119-aad8-9ed9d5fbbbc9" returned: 0 in 0.743s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:38:28 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-802849fa-6894-453a-a227-c79e32bda8c7 tempest-VolumesTestJSON-502298121 None] Lock "cinder-quobyte-54305a8b-2281-4119-aad8-9ed9d5fbbbc9" released by "delete_volume" :: held 1.993s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:38:28 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-802849fa-6894-453a-a227-c79e32bda8c7 tempest-VolumesTestJSON-502298121 None] Created reservations ['7515d854-7626-4653-b189-386e98aefc0a', '1c196ff0-e28d-4e1b-804d-2d82da5ed41e', 'a193ade9-0b37-4b02-a047-087cde061275', 'de36de55-9f67-4a95-a79b-c31549f9bef1'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:38:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-802849fa-6894-453a-a227-c79e32bda8c7 tempest-VolumesTestJSON-502298121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:38:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-802849fa-6894-453a-a227-c79e32bda8c7 tempest-VolumesTestJSON-502298121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:38:28 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-802849fa-6894-453a-a227-c79e32bda8c7 tempest-VolumesTestJSON-502298121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:38:28 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-802849fa-6894-453a-a227-c79e32bda8c7 tempest-VolumesTestJSON-502298121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:38:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-802849fa-6894-453a-a227-c79e32bda8c7 tempest-VolumesTestJSON-502298121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:38:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-802849fa-6894-453a-a227-c79e32bda8c7 tempest-VolumesTestJSON-502298121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:38:29 devstack sudo[89182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:38:29 devstack sudo[89182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:38:30 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-ef301f55-9465-4098-a860-73a755279a07 tempest-VolumesTestJSON-502298121 None] Acquiring lock "cinder-fc71668f-a4a1-46af-ae27-01e2c27aa44b-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:38:30 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-ef301f55-9465-4098-a860-73a755279a07 tempest-VolumesTestJSON-502298121 None] Lock "cinder-fc71668f-a4a1-46af-ae27-01e2c27aa44b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:38:30 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:UPDATE=58,cinder:SELECT=37,cinder:INSERT=11,cinder:DELETE=5 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:38:30 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:SELECT=46,cinder:UPDATE=53,cinder:DELETE=5,cinder:INSERT=12 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:38:30 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-ef301f55-9465-4098-a860-73a755279a07 tempest-VolumesTestJSON-502298121 None] Acquiring lock "cinder-quobyte-fc71668f-a4a1-46af-ae27-01e2c27aa44b" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:38:30 devstack sudo[89182]: pam_unix(sudo:session): session closed for user root
Jul 10 12:38:30 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-802849fa-6894-453a-a227-c79e32bda8c7 tempest-VolumesTestJSON-502298121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 1.244s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:38:30 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-802849fa-6894-453a-a227-c79e32bda8c7 tempest-VolumesTestJSON-502298121 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:38:30 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-802849fa-6894-453a-a227-c79e32bda8c7 tempest-VolumesTestJSON-502298121 None] Deleted volume successfully.
Jul 10 12:38:30 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-ef301f55-9465-4098-a860-73a755279a07 tempest-VolumesTestJSON-502298121 None] Lock "cinder-quobyte-fc71668f-a4a1-46af-ae27-01e2c27aa44b" acquired by "delete_volume" :: waited 0.061s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:38:30 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-802849fa-6894-453a-a227-c79e32bda8c7 tempest-VolumesTestJSON-502298121 None] Lock "cinder-54305a8b-2281-4119-aad8-9ed9d5fbbbc9-delete_volume" released by "delete_volume" :: held 3.752s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:38:30 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6505ac58-f3f5-4a55-9368-96077c3a6f1a]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:38:30 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ef301f55-9465-4098-a860-73a755279a07 tempest-VolumesTestJSON-502298121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fc71668f-a4a1-46af-ae27-01e2c27aa44b {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:38:30 devstack sudo[89186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fc71668f-a4a1-46af-ae27-01e2c27aa44b
Jul 10 12:38:30 devstack sudo[89186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:38:31 devstack sudo[89186]: pam_unix(sudo:session): session closed for user root
Jul 10 12:38:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ef301f55-9465-4098-a860-73a755279a07 tempest-VolumesTestJSON-502298121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fc71668f-a4a1-46af-ae27-01e2c27aa44b" returned: 0 in 1.092s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:38:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ef301f55-9465-4098-a860-73a755279a07 tempest-VolumesTestJSON-502298121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fc71668f-a4a1-46af-ae27-01e2c27aa44b {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:38:31 devstack sudo[89191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fc71668f-a4a1-46af-ae27-01e2c27aa44b
Jul 10 12:38:31 devstack sudo[89191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:38:32 devstack sudo[89191]: pam_unix(sudo:session): session closed for user root
Jul 10 12:38:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ef301f55-9465-4098-a860-73a755279a07 tempest-VolumesTestJSON-502298121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fc71668f-a4a1-46af-ae27-01e2c27aa44b" returned: 0 in 0.892s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:38:32 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-ef301f55-9465-4098-a860-73a755279a07 tempest-VolumesTestJSON-502298121 None] Lock "cinder-quobyte-fc71668f-a4a1-46af-ae27-01e2c27aa44b" released by "delete_volume" :: held 2.048s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:38:32 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-ef301f55-9465-4098-a860-73a755279a07 tempest-VolumesTestJSON-502298121 None] Created reservations ['872461ab-f918-4307-bdf1-d9ff11fd6b02', '39a53480-4967-4631-ad04-cf441845cf47', '369f50cb-f9ec-4a89-94b0-5ea3be36af64', '40eee104-8f58-4907-83dc-bce3dc068d3c'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:38:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ef301f55-9465-4098-a860-73a755279a07 tempest-VolumesTestJSON-502298121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:38:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ef301f55-9465-4098-a860-73a755279a07 tempest-VolumesTestJSON-502298121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:38:32 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-ef301f55-9465-4098-a860-73a755279a07 tempest-VolumesTestJSON-502298121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:38:32 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-ef301f55-9465-4098-a860-73a755279a07 tempest-VolumesTestJSON-502298121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:38:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ef301f55-9465-4098-a860-73a755279a07 tempest-VolumesTestJSON-502298121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:38:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ef301f55-9465-4098-a860-73a755279a07 tempest-VolumesTestJSON-502298121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:38:32 devstack sudo[89194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:38:32 devstack sudo[89194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:38:33 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1a8c4f29-45de-4374-9ef9-fe49fb742ec0 tempest-VolumesTestJSON-502298121 None] Acquiring lock "cinder-57982841-7fc2-4572-afd4-d323d202700f-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:38:33 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1a8c4f29-45de-4374-9ef9-fe49fb742ec0 tempest-VolumesTestJSON-502298121 None] Lock "cinder-57982841-7fc2-4572-afd4-d323d202700f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:38:33 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1a8c4f29-45de-4374-9ef9-fe49fb742ec0 tempest-VolumesTestJSON-502298121 None] Acquiring lock "cinder-quobyte-57982841-7fc2-4572-afd4-d323d202700f" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:38:33 devstack sudo[89194]: pam_unix(sudo:session): session closed for user root
Jul 10 12:38:33 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1a8c4f29-45de-4374-9ef9-fe49fb742ec0 tempest-VolumesTestJSON-502298121 None] Lock "cinder-quobyte-57982841-7fc2-4572-afd4-d323d202700f" acquired by "delete_volume" :: waited 0.047s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:38:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ef301f55-9465-4098-a860-73a755279a07 tempest-VolumesTestJSON-502298121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 1.287s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:38:33 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-ef301f55-9465-4098-a860-73a755279a07 tempest-VolumesTestJSON-502298121 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:38:33 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1fc928-9c1c-4754-acd0-0d004137966e]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:38:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1a8c4f29-45de-4374-9ef9-fe49fb742ec0 tempest-VolumesTestJSON-502298121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57982841-7fc2-4572-afd4-d323d202700f {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:38:33 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-ef301f55-9465-4098-a860-73a755279a07 tempest-VolumesTestJSON-502298121 None] Deleted volume successfully.
Jul 10 12:38:33 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-ef301f55-9465-4098-a860-73a755279a07 tempest-VolumesTestJSON-502298121 None] Lock "cinder-fc71668f-a4a1-46af-ae27-01e2c27aa44b-delete_volume" released by "delete_volume" :: held 3.817s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:38:34 devstack sudo[89203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57982841-7fc2-4572-afd4-d323d202700f
Jul 10 12:38:34 devstack sudo[89203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:38:34 devstack sudo[89203]: pam_unix(sudo:session): session closed for user root
Jul 10 12:38:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1a8c4f29-45de-4374-9ef9-fe49fb742ec0 tempest-VolumesTestJSON-502298121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57982841-7fc2-4572-afd4-d323d202700f" returned: 0 in 1.146s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:38:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1a8c4f29-45de-4374-9ef9-fe49fb742ec0 tempest-VolumesTestJSON-502298121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57982841-7fc2-4572-afd4-d323d202700f {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:38:35 devstack sudo[89210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57982841-7fc2-4572-afd4-d323d202700f
Jul 10 12:38:35 devstack sudo[89210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:38:35 devstack sudo[89210]: pam_unix(sudo:session): session closed for user root
Jul 10 12:38:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1a8c4f29-45de-4374-9ef9-fe49fb742ec0 tempest-VolumesTestJSON-502298121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57982841-7fc2-4572-afd4-d323d202700f" returned: 0 in 0.991s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:38:35 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1a8c4f29-45de-4374-9ef9-fe49fb742ec0 tempest-VolumesTestJSON-502298121 None] Lock "cinder-quobyte-57982841-7fc2-4572-afd4-d323d202700f" released by "delete_volume" :: held 2.214s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:38:36 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-1a8c4f29-45de-4374-9ef9-fe49fb742ec0 tempest-VolumesTestJSON-502298121 None] Created reservations ['67034891-e37c-43a7-b30d-3602058d176d', '54a18a7b-2eda-4d39-a939-86e1dd12b680', '7fb9d3c4-bf94-4501-a7f1-1170732c5d73', '44b23f59-ce64-47c3-9f09-3570dce6adc0'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:38:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1a8c4f29-45de-4374-9ef9-fe49fb742ec0 tempest-VolumesTestJSON-502298121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:38:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1a8c4f29-45de-4374-9ef9-fe49fb742ec0 tempest-VolumesTestJSON-502298121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:38:36 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-1a8c4f29-45de-4374-9ef9-fe49fb742ec0 tempest-VolumesTestJSON-502298121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:38:36 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-1a8c4f29-45de-4374-9ef9-fe49fb742ec0 tempest-VolumesTestJSON-502298121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:38:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1a8c4f29-45de-4374-9ef9-fe49fb742ec0 tempest-VolumesTestJSON-502298121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:38:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1a8c4f29-45de-4374-9ef9-fe49fb742ec0 tempest-VolumesTestJSON-502298121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:38:36 devstack sudo[89213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:38:36 devstack sudo[89213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:38:37 devstack sudo[89213]: pam_unix(sudo:session): session closed for user root
Jul 10 12:38:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1a8c4f29-45de-4374-9ef9-fe49fb742ec0 tempest-VolumesTestJSON-502298121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 1.267s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:38:37 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-1a8c4f29-45de-4374-9ef9-fe49fb742ec0 tempest-VolumesTestJSON-502298121 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:38:37 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-1a8c4f29-45de-4374-9ef9-fe49fb742ec0 tempest-VolumesTestJSON-502298121 None] Deleted volume successfully.
Jul 10 12:38:37 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1a8c4f29-45de-4374-9ef9-fe49fb742ec0 tempest-VolumesTestJSON-502298121 None] Lock "cinder-57982841-7fc2-4572-afd4-d323d202700f-delete_volume" released by "delete_volume" :: held 3.851s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:38:46 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:SELECT=10,cinder:INSERT=5,cinder:UPDATE=13 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:38:47 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:DELETE=3,cinder:SELECT=9,cinder:INSERT=3,cinder:UPDATE=18 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:38:49 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-ad272958-f272-48db-a393-96238555815b tempest-GroupsV314Test-1546354874 None] Group tempest-GroupsV314Test-Group-467642945: creating
Jul 10 12:38:49 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-ad272958-f272-48db-a393-96238555815b tempest-GroupsV314Test-1546354874 None] Group tempest-GroupsV314Test-Group-467642945: created successfully
Jul 10 12:38:49 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-ad272958-f272-48db-a393-96238555815b tempest-GroupsV314Test-1546354874 None] Create group completed successfully.
Jul 10 12:38:51 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec86c3cc-acb9-4783-8236-f7fb043a962a tempest-GroupsV314Test-1546354874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:38:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ec86c3cc-acb9-4783-8236-f7fb043a962a tempest-GroupsV314Test-1546354874 None] Flow 'volume_create_manager' (9ad78e4e-6d09-4716-9cb8-c7f9b94491d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:38:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ec86c3cc-acb9-4783-8236-f7fb043a962a tempest-GroupsV314Test-1546354874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dca09ac-b63c-42b4-8732-c9992afeff7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:38:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ec86c3cc-acb9-4783-8236-f7fb043a962a tempest-GroupsV314Test-1546354874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dca09ac-b63c-42b4-8732-c9992afeff7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2072080281',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0cd01a41-f9f8-4ef2-b96d-68e2a45b8d14,host='devstack@QuobyteHD#QuobyteHD',id=e573bd30-e897-4094-acb2-938590a607cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2ed938b1679407da355d2fe84e63fcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:38:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:38:52Z,use_quota=True,user_id='baabfc990d904426879d8a5f52eb3f86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1342c9f4-67fa-42a4-806d-77c5ae9b3b5c),volume_type_id=1342c9f4-67fa-42a4-806d-77c5ae9b3b5c)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:38:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ec86c3cc-acb9-4783-8236-f7fb043a962a tempest-GroupsV314Test-1546354874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fe1c05f-a797-4b8a-a3ce-807d86eb0304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:38:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ec86c3cc-acb9-4783-8236-f7fb043a962a tempest-GroupsV314Test-1546354874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fe1c05f-a797-4b8a-a3ce-807d86eb0304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:38:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ec86c3cc-acb9-4783-8236-f7fb043a962a tempest-GroupsV314Test-1546354874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c9a5504-8c01-4ab4-8be9-f5b839177085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:38:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ec86c3cc-acb9-4783-8236-f7fb043a962a tempest-GroupsV314Test-1546354874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c9a5504-8c01-4ab4-8be9-f5b839177085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e573bd30-e897-4094-acb2-938590a607cf', 'volume_name': 'volume-e573bd30-e897-4094-acb2-938590a607cf', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:38:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ec86c3cc-acb9-4783-8236-f7fb043a962a tempest-GroupsV314Test-1546354874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd23d93a-b4d1-4767-b6b6-fd1768a1663e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:38:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ec86c3cc-acb9-4783-8236-f7fb043a962a tempest-GroupsV314Test-1546354874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd23d93a-b4d1-4767-b6b6-fd1768a1663e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:38:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ec86c3cc-acb9-4783-8236-f7fb043a962a tempest-GroupsV314Test-1546354874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bb63b79-6e1a-4e32-8238-d28cbf278c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:38:51 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-ec86c3cc-acb9-4783-8236-f7fb043a962a tempest-GroupsV314Test-1546354874 None] Volume e573bd30-e897-4094-acb2-938590a607cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e573bd30-e897-4094-acb2-938590a607cf', 'volume_size': 1}
Jul 10 12:38:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ec86c3cc-acb9-4783-8236-f7fb043a962a tempest-GroupsV314Test-1546354874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:38:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ec86c3cc-acb9-4783-8236-f7fb043a962a tempest-GroupsV314Test-1546354874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:38:51 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-ec86c3cc-acb9-4783-8236-f7fb043a962a tempest-GroupsV314Test-1546354874 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=0cd01a41-f9f8-4ef2-b96d-68e2a45b8d14,created_at=2026-07-10T10:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2072080281',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0cd01a41-f9f8-4ef2-b96d-68e2a45b8d14,host='devstack@QuobyteHD#QuobyteHD',id=e573bd30-e897-4094-acb2-938590a607cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2ed938b1679407da355d2fe84e63fcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:38:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:38:52Z,use_quota=True,user_id='baabfc990d904426879d8a5f52eb3f86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1342c9f4-67fa-42a4-806d-77c5ae9b3b5c),volume_type_id=1342c9f4-67fa-42a4-806d-77c5ae9b3b5c)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:38:51 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-ec86c3cc-acb9-4783-8236-f7fb043a962a tempest-GroupsV314Test-1546354874 None] Creating volume e573bd30-e897-4094-acb2-938590a607cf {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:38:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ec86c3cc-acb9-4783-8236-f7fb043a962a tempest-GroupsV314Test-1546354874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:38:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ec86c3cc-acb9-4783-8236-f7fb043a962a tempest-GroupsV314Test-1546354874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:38:51 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-ec86c3cc-acb9-4783-8236-f7fb043a962a tempest-GroupsV314Test-1546354874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:38:51 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-ec86c3cc-acb9-4783-8236-f7fb043a962a tempest-GroupsV314Test-1546354874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:38:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ec86c3cc-acb9-4783-8236-f7fb043a962a tempest-GroupsV314Test-1546354874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:38:51 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-ec86c3cc-acb9-4783-8236-f7fb043a962a tempest-GroupsV314Test-1546354874 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:38:51 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-ec86c3cc-acb9-4783-8236-f7fb043a962a tempest-GroupsV314Test-1546354874 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:38:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ec86c3cc-acb9-4783-8236-f7fb043a962a tempest-GroupsV314Test-1546354874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:38:51 devstack sudo[89276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf 1073741824
Jul 10 12:38:51 devstack sudo[89276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:38:52 devstack sudo[89276]: pam_unix(sudo:session): session closed for user root
Jul 10 12:38:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ec86c3cc-acb9-4783-8236-f7fb043a962a tempest-GroupsV314Test-1546354874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf 1073741824" returned: 0 in 1.066s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:38:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ec86c3cc-acb9-4783-8236-f7fb043a962a tempest-GroupsV314Test-1546354874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:38:53 devstack sudo[89283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf
Jul 10 12:38:53 devstack sudo[89283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:38:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-a6e41673-3024-455c-a54a-ee295a3750a9 req-66382cae-0112-4fdb-83a0-05c28ba4d2c8 tempest-ServerActionsTestOtherA-1596451723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:38:53 devstack sudo[89283]: pam_unix(sudo:session): session closed for user root
Jul 10 12:38:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ec86c3cc-acb9-4783-8236-f7fb043a962a tempest-GroupsV314Test-1546354874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf" returned: 0 in 0.776s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:38:53 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-ec86c3cc-acb9-4783-8236-f7fb043a962a tempest-GroupsV314Test-1546354874 None] <== create_volume: return (1885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:38:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ec86c3cc-acb9-4783-8236-f7fb043a962a tempest-GroupsV314Test-1546354874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.888s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:38:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-a6e41673-3024-455c-a54a-ee295a3750a9 req-66382cae-0112-4fdb-83a0-05c28ba4d2c8 tempest-ServerActionsTestOtherA-1596451723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.311s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:38:53 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b7f776-44b6-462d-a92b-b982c1a57a37]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:38:53 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ec86c3cc-acb9-4783-8236-f7fb043a962a tempest-GroupsV314Test-1546354874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bb63b79-6e1a-4e32-8238-d28cbf278c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e573bd30-e897-4094-acb2-938590a607cf', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:38:53 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ec86c3cc-acb9-4783-8236-f7fb043a962a tempest-GroupsV314Test-1546354874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccef0360-6b11-494e-a10f-88c1cd0c0747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:38:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-a6e41673-3024-455c-a54a-ee295a3750a9 req-66382cae-0112-4fdb-83a0-05c28ba4d2c8 tempest-ServerActionsTestOtherA-1596451723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22d1db9a-cea2-41e8-8d05-56498576704c {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:38:53 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-ec86c3cc-acb9-4783-8236-f7fb043a962a tempest-GroupsV314Test-1546354874 None] Volume volume-e573bd30-e897-4094-acb2-938590a607cf (e573bd30-e897-4094-acb2-938590a607cf): created successfully
Jul 10 12:38:53 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ec86c3cc-acb9-4783-8236-f7fb043a962a tempest-GroupsV314Test-1546354874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccef0360-6b11-494e-a10f-88c1cd0c0747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:38:53 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ec86c3cc-acb9-4783-8236-f7fb043a962a tempest-GroupsV314Test-1546354874 None] Flow 'volume_create_manager' (9ad78e4e-6d09-4716-9cb8-c7f9b94491d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:38:53 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-ec86c3cc-acb9-4783-8236-f7fb043a962a tempest-GroupsV314Test-1546354874 None] Created volume successfully.
Jul 10 12:38:53 devstack sudo[89294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22d1db9a-cea2-41e8-8d05-56498576704c
Jul 10 12:38:53 devstack sudo[89294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:38:54 devstack sudo[89294]: pam_unix(sudo:session): session closed for user root
Jul 10 12:38:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-a6e41673-3024-455c-a54a-ee295a3750a9 req-66382cae-0112-4fdb-83a0-05c28ba4d2c8 tempest-ServerActionsTestOtherA-1596451723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22d1db9a-cea2-41e8-8d05-56498576704c" returned: 0 in 0.833s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:38:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-a6e41673-3024-455c-a54a-ee295a3750a9 req-66382cae-0112-4fdb-83a0-05c28ba4d2c8 tempest-ServerActionsTestOtherA-1596451723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.870s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:38:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-a6e41673-3024-455c-a54a-ee295a3750a9 req-66382cae-0112-4fdb-83a0-05c28ba4d2c8 tempest-ServerActionsTestOtherA-1596451723 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be', 'name': 'volume-22d1db9a-cea2-41e8-8d05-56498576704c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0debf85f-b47e-48c1-9a7e-9cfcf7bd86c5', 'enforce_multipath': True} {{(pid=87378) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 10 12:38:54 devstack cinder-volume[87378]: INFO cinder.volume.manager [req-a6e41673-3024-455c-a54a-ee295a3750a9 req-66382cae-0112-4fdb-83a0-05c28ba4d2c8 tempest-ServerActionsTestOtherA-1596451723 None] attachment_update completed successfully.
Jul 10 12:38:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:38:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:38:55 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] Cloning volume e573bd30-e897-4094-acb2-938590a607cf to volume 9063e734-51e3-40c2-a10e-ac71698bc111
Jul 10 12:38:55 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] Creating offline snapshot e4411b48-cf47-4cc7-991e-2314dd1a0611 of volume e573bd30-e897-4094-acb2-938590a607cf {{(pid=87378) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 10 12:38:55 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[506f08e9-eae3-4297-9375-a36205719ce9]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:38:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:38:55 devstack sudo[89404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf
Jul 10 12:38:55 devstack sudo[89404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:38:56 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-935f097f-166f-486c-8f4e-6df5d77c52ad tempest-TaggedAttachmentsTest-1503143233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:38:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-935f097f-166f-486c-8f4e-6df5d77c52ad tempest-TaggedAttachmentsTest-1503143233 None] Flow 'volume_create_manager' (cabb1d0a-1d42-495c-a165-e129df283776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:38:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-935f097f-166f-486c-8f4e-6df5d77c52ad tempest-TaggedAttachmentsTest-1503143233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0b540c1-49fb-4b5b-b4af-0cfadc54cdfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:38:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-935f097f-166f-486c-8f4e-6df5d77c52ad tempest-TaggedAttachmentsTest-1503143233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0b540c1-49fb-4b5b-b4af-0cfadc54cdfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:38:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1989449446',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe46955e-3331-4ce5-8000-7964d0d129eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40e1d4dcb60b4deb94e283c2c0bd0a69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:38:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:38:56Z,use_quota=True,user_id='7576864a7833409aa3136e4d8034fd02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:38:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-935f097f-166f-486c-8f4e-6df5d77c52ad tempest-TaggedAttachmentsTest-1503143233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaf01fd2-4148-4f60-aea7-9626f2df8fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:38:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-935f097f-166f-486c-8f4e-6df5d77c52ad tempest-TaggedAttachmentsTest-1503143233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaf01fd2-4148-4f60-aea7-9626f2df8fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:38:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-935f097f-166f-486c-8f4e-6df5d77c52ad tempest-TaggedAttachmentsTest-1503143233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (054f3899-249c-4ad3-98af-e626be9094cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:38:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-935f097f-166f-486c-8f4e-6df5d77c52ad tempest-TaggedAttachmentsTest-1503143233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (054f3899-249c-4ad3-98af-e626be9094cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe46955e-3331-4ce5-8000-7964d0d129eb', 'volume_name': 'volume-fe46955e-3331-4ce5-8000-7964d0d129eb', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:38:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-935f097f-166f-486c-8f4e-6df5d77c52ad tempest-TaggedAttachmentsTest-1503143233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fcea373-934e-41e8-b011-f2bd2fcf3f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:38:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-935f097f-166f-486c-8f4e-6df5d77c52ad tempest-TaggedAttachmentsTest-1503143233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fcea373-934e-41e8-b011-f2bd2fcf3f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:38:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-935f097f-166f-486c-8f4e-6df5d77c52ad tempest-TaggedAttachmentsTest-1503143233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c292a895-a096-4200-9f0a-789cc2189cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:38:56 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-935f097f-166f-486c-8f4e-6df5d77c52ad tempest-TaggedAttachmentsTest-1503143233 None] Volume fe46955e-3331-4ce5-8000-7964d0d129eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe46955e-3331-4ce5-8000-7964d0d129eb', 'volume_size': 1}
Jul 10 12:38:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-935f097f-166f-486c-8f4e-6df5d77c52ad tempest-TaggedAttachmentsTest-1503143233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:38:56 devstack sudo[89404]: pam_unix(sudo:session): session closed for user root
Jul 10 12:38:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf" returned: 0 in 1.106s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:38:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf.e4411b48-cf47-4cc7-991e-2314dd1a0611 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:38:56 devstack sudo[89755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf.e4411b48-cf47-4cc7-991e-2314dd1a0611 1G
Jul 10 12:38:56 devstack sudo[89755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:38:57 devstack sudo[89755]: pam_unix(sudo:session): session closed for user root
Jul 10 12:38:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf.e4411b48-cf47-4cc7-991e-2314dd1a0611 1G" returned: 0 in 0.843s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:38:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e573bd30-e897-4094-acb2-938590a607cf -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf.e4411b48-cf47-4cc7-991e-2314dd1a0611 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:38:57 devstack sudo[89764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e573bd30-e897-4094-acb2-938590a607cf -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf.e4411b48-cf47-4cc7-991e-2314dd1a0611
Jul 10 12:38:57 devstack sudo[89764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:38:58 devstack sudo[89764]: pam_unix(sudo:session): session closed for user root
Jul 10 12:38:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e573bd30-e897-4094-acb2-938590a607cf -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf.e4411b48-cf47-4cc7-991e-2314dd1a0611" returned: 0 in 0.838s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:38:58 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf.e4411b48-cf47-4cc7-991e-2314dd1a0611 is being set with open permissions: ugo+rw: NotImplementedError
Jul 10 12:38:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf.e4411b48-cf47-4cc7-991e-2314dd1a0611 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:38:58 devstack sudo[89770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf.e4411b48-cf47-4cc7-991e-2314dd1a0611
Jul 10 12:38:58 devstack sudo[89770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:38:59 devstack sudo[89770]: pam_unix(sudo:session): session closed for user root
Jul 10 12:38:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf.e4411b48-cf47-4cc7-991e-2314dd1a0611" returned: 0 in 0.719s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:38:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:38:59 devstack sudo[89775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf.info
Jul 10 12:38:59 devstack sudo[89775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:38:59 devstack sudo[89775]: pam_unix(sudo:session): session closed for user root
Jul 10 12:38:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf.info" returned: 0 in 0.762s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:38:59 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 10 12:38:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:38:59 devstack sudo[89778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf.info
Jul 10 12:38:59 devstack sudo[89778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:39:00 devstack sudo[89778]: pam_unix(sudo:session): session closed for user root
Jul 10 12:39:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf.info" returned: 0 in 0.965s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:39:00 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] Acquiring lock "cinder-quobyte-9063e734-51e3-40c2-a10e-ac71698bc111" by "_copy_volume_from_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:39:00 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] Lock "cinder-quobyte-9063e734-51e3-40c2-a10e-ac71698bc111" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:39:00 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] snapshot: e4411b48-cf47-4cc7-991e-2314dd1a0611, volume: 9063e734-51e3-40c2-a10e-ac71698bc111,  {{(pid=87378) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 10 12:39:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:39:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:39:01 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:39:01 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:39:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:39:01 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95e90e9-dcac-4c40-ba22-7d94e4d8a771]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:39:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf.e4411b48-cf47-4cc7-991e-2314dd1a0611 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:39:01 devstack sudo[89786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf.e4411b48-cf47-4cc7-991e-2314dd1a0611
Jul 10 12:39:01 devstack sudo[89786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:39:01 devstack sudo[89786]: pam_unix(sudo:session): session closed for user root
Jul 10 12:39:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf.e4411b48-cf47-4cc7-991e-2314dd1a0611" returned: 0 in 0.920s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:39:01 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e573bd30-e897-4094-acb2-938590a607cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:39:01 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] will copy from snapshot at /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf {{(pid=87378) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 10 12:39:01 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] Creating direct copy from snapshot {{(pid=87378) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 10 12:39:01 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[4341f596-8054-4c6e-86fe-5a04857e69c7]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:39:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:39:02 devstack sudo[89795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf
Jul 10 12:39:02 devstack sudo[89795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:39:02 devstack sudo[89795]: pam_unix(sudo:session): session closed for user root
Jul 10 12:39:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf" returned: 0 in 0.803s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:39:02 devstack cinder-volume[87378]: DEBUG cinder.utils [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] Path /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9063e734-51e3-40c2-a10e-ac71698bc111 not found in is_blk_device check {{(pid=87378) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 10 12:39:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9063e734-51e3-40c2-a10e-ac71698bc111 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:39:02 devstack sudo[89814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9063e734-51e3-40c2-a10e-ac71698bc111
Jul 10 12:39:02 devstack sudo[89814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:39:03 devstack cinder-volume[87378]: INFO cinder.volume.manager [req-7b643025-ceaa-42ae-b27f-660e928af261 req-c402acb8-dd88-4a13-a7e6-b68edf5bfee3 tempest-ServerActionsTestOtherA-1596451723 None] Terminate volume connection completed successfully.
Jul 10 12:39:03 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-7b643025-ceaa-42ae-b27f-660e928af261 req-c402acb8-dd88-4a13-a7e6-b68edf5bfee3 tempest-ServerActionsTestOtherA-1596451723 None] Deleting attachment 0debf85f-b47e-48c1-9a7e-9cfcf7bd86c5. {{(pid=87378) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 10 12:39:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-7b643025-ceaa-42ae-b27f-660e928af261 req-81d44192-7713-4f44-95f3-4f8c8e3371d5 tempest-ServerActionsTestOtherA-1596451723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:39:11 devstack sudo[89814]: pam_unix(sudo:session): session closed for user root
Jul 10 12:39:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9063e734-51e3-40c2-a10e-ac71698bc111" returned: 0 in 8.417s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:39:11 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4bc0a03-84be-4035-a6f6-18b54b385c96]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:39:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:39:11 devstack sudo[89945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf
Jul 10 12:39:11 devstack sudo[89945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:39:12 devstack sudo[89945]: pam_unix(sudo:session): session closed for user root
Jul 10 12:39:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf" returned: 0 in 0.965s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:39:12 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] Image conversion details: src /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf, size 1024.00 MB, duration 8.42 sec, destination /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9063e734-51e3-40c2-a10e-ac71698bc111 {{(pid=87378) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 10 12:39:12 devstack cinder-volume[87378]: INFO cinder.image.image_utils [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] Converted 1024.00 MB image at 121.65 MB/s
Jul 10 12:39:12 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9063e734-51e3-40c2-a10e-ac71698bc111 is being set with open permissions: ugo+rw: NotImplementedError
Jul 10 12:39:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9063e734-51e3-40c2-a10e-ac71698bc111 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:39:12 devstack sudo[89952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9063e734-51e3-40c2-a10e-ac71698bc111
Jul 10 12:39:12 devstack sudo[89952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:39:12 devstack sudo[89952]: pam_unix(sudo:session): session closed for user root
Jul 10 12:39:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9063e734-51e3-40c2-a10e-ac71698bc111" returned: 0 in 0.643s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:39:12 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] Lock "cinder-quobyte-9063e734-51e3-40c2-a10e-ac71698bc111" released by "_copy_volume_from_snapshot" :: held 11.859s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:39:12 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] Acquiring lock "cinder-quobyte-e4411b48-cf47-4cc7-991e-2314dd1a0611" by "_delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:39:12 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] Lock "cinder-quobyte-e4411b48-cf47-4cc7-991e-2314dd1a0611" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:39:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] Deleting offline snapshot e4411b48-cf47-4cc7-991e-2314dd1a0611 of volume e573bd30-e897-4094-acb2-938590a607cf {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 10 12:39:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] snapshot_file for this snap is: volume-e573bd30-e897-4094-acb2-938590a607cf.e4411b48-cf47-4cc7-991e-2314dd1a0611 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 10 12:39:12 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6992abe1-3195-4a2b-beee-8c17fee81bd3]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:39:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf.e4411b48-cf47-4cc7-991e-2314dd1a0611 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:39:12 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:39:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:39:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:39:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:39:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:39:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:39:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:39:12 devstack sudo[89956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:39:12 devstack sudo[89956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:39:12 devstack sudo[89955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf.e4411b48-cf47-4cc7-991e-2314dd1a0611
Jul 10 12:39:12 devstack sudo[89955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:39:13 devstack sudo[89956]: pam_unix(sudo:session): session closed for user root
Jul 10 12:39:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.867s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:39:13 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:39:13 devstack sudo[89955]: pam_unix(sudo:session): session closed for user root
Jul 10 12:39:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf.e4411b48-cf47-4cc7-991e-2314dd1a0611" returned: 0 in 1.010s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:39:13 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e573bd30-e897-4094-acb2-938590a607cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:39:13 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47d1bc3-8874-4b2a-8fd4-d7577efad567]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:39:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:39:14 devstack sudo[89999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf
Jul 10 12:39:14 devstack sudo[89999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:39:14 devstack sudo[89999]: pam_unix(sudo:session): session closed for user root
Jul 10 12:39:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf" returned: 0 in 0.771s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:39:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf.e4411b48-cf47-4cc7-991e-2314dd1a0611 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:39:14 devstack sudo[90004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf.e4411b48-cf47-4cc7-991e-2314dd1a0611
Jul 10 12:39:14 devstack sudo[90004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:39:15 devstack sudo[90004]: pam_unix(sudo:session): session closed for user root
Jul 10 12:39:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf.e4411b48-cf47-4cc7-991e-2314dd1a0611" returned: 0 in 0.898s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:39:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf.e4411b48-cf47-4cc7-991e-2314dd1a0611 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:39:15 devstack sudo[90032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf.e4411b48-cf47-4cc7-991e-2314dd1a0611
Jul 10 12:39:15 devstack sudo[90032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:39:16 devstack sudo[90032]: pam_unix(sudo:session): session closed for user root
Jul 10 12:39:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf.e4411b48-cf47-4cc7-991e-2314dd1a0611" returned: 0 in 0.641s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:39:16 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] Lock "cinder-quobyte-e4411b48-cf47-4cc7-991e-2314dd1a0611" released by "_delete_snapshot" :: held 3.410s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:39:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.827s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:39:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-935f097f-166f-486c-8f4e-6df5d77c52ad tempest-TaggedAttachmentsTest-1503143233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.986s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:39:16 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-935f097f-166f-486c-8f4e-6df5d77c52ad tempest-TaggedAttachmentsTest-1503143233 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:38:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1989449446',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe46955e-3331-4ce5-8000-7964d0d129eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40e1d4dcb60b4deb94e283c2c0bd0a69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:38:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:38:56Z,use_quota=True,user_id='7576864a7833409aa3136e4d8034fd02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:39:16 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-935f097f-166f-486c-8f4e-6df5d77c52ad tempest-TaggedAttachmentsTest-1503143233 None] Creating volume fe46955e-3331-4ce5-8000-7964d0d129eb {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:39:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-935f097f-166f-486c-8f4e-6df5d77c52ad tempest-TaggedAttachmentsTest-1503143233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:39:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-935f097f-166f-486c-8f4e-6df5d77c52ad tempest-TaggedAttachmentsTest-1503143233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:39:16 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-935f097f-166f-486c-8f4e-6df5d77c52ad tempest-TaggedAttachmentsTest-1503143233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:39:16 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-935f097f-166f-486c-8f4e-6df5d77c52ad tempest-TaggedAttachmentsTest-1503143233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:39:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-935f097f-166f-486c-8f4e-6df5d77c52ad tempest-TaggedAttachmentsTest-1503143233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:39:16 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-935f097f-166f-486c-8f4e-6df5d77c52ad tempest-TaggedAttachmentsTest-1503143233 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:39:16 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-935f097f-166f-486c-8f4e-6df5d77c52ad tempest-TaggedAttachmentsTest-1503143233 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:39:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-935f097f-166f-486c-8f4e-6df5d77c52ad tempest-TaggedAttachmentsTest-1503143233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe46955e-3331-4ce5-8000-7964d0d129eb 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:39:16 devstack sudo[90035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe46955e-3331-4ce5-8000-7964d0d129eb 1073741824
Jul 10 12:39:16 devstack sudo[90035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:39:16 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-0687d860-a0eb-4cf7-b10b-e2aca8a9cf26 tempest-GroupsV314Test-1546354874 None] Create group from source-group-0cd01a41-f9f8-4ef2-b96d-68e2a45b8d14 completed successfully.
Jul 10 12:39:17 devstack sudo[90035]: pam_unix(sudo:session): session closed for user root
Jul 10 12:39:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-935f097f-166f-486c-8f4e-6df5d77c52ad tempest-TaggedAttachmentsTest-1503143233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe46955e-3331-4ce5-8000-7964d0d129eb 1073741824" returned: 0 in 1.193s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:39:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-935f097f-166f-486c-8f4e-6df5d77c52ad tempest-TaggedAttachmentsTest-1503143233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe46955e-3331-4ce5-8000-7964d0d129eb {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:39:17 devstack sudo[90063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe46955e-3331-4ce5-8000-7964d0d129eb
Jul 10 12:39:17 devstack sudo[90063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:39:17 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e0e06bfe-4069-4794-99a5-c9dfa329b134 tempest-GroupsV314Test-1546354874 None] Acquiring lock "cinder-quobyte-9063e734-51e3-40c2-a10e-ac71698bc111" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:39:17 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e0e06bfe-4069-4794-99a5-c9dfa329b134 tempest-GroupsV314Test-1546354874 None] Lock "cinder-quobyte-9063e734-51e3-40c2-a10e-ac71698bc111" acquired by "delete_volume" :: waited 0.042s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:39:17 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[500b6b75-5ca7-477b-bec9-2290f7759a27]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:39:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e0e06bfe-4069-4794-99a5-c9dfa329b134 tempest-GroupsV314Test-1546354874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9063e734-51e3-40c2-a10e-ac71698bc111 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:39:18 devstack sudo[90065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9063e734-51e3-40c2-a10e-ac71698bc111
Jul 10 12:39:18 devstack sudo[90065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:39:18 devstack sudo[90063]: pam_unix(sudo:session): session closed for user root
Jul 10 12:39:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-935f097f-166f-486c-8f4e-6df5d77c52ad tempest-TaggedAttachmentsTest-1503143233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe46955e-3331-4ce5-8000-7964d0d129eb" returned: 0 in 1.184s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:39:18 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-935f097f-166f-486c-8f4e-6df5d77c52ad tempest-TaggedAttachmentsTest-1503143233 None] <== create_volume: return (2432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:39:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-935f097f-166f-486c-8f4e-6df5d77c52ad tempest-TaggedAttachmentsTest-1503143233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.434s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:39:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-7b643025-ceaa-42ae-b27f-660e928af261 req-81d44192-7713-4f44-95f3-4f8c8e3371d5 tempest-ServerActionsTestOtherA-1596451723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.955s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:39:18 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-935f097f-166f-486c-8f4e-6df5d77c52ad tempest-TaggedAttachmentsTest-1503143233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c292a895-a096-4200-9f0a-789cc2189cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe46955e-3331-4ce5-8000-7964d0d129eb', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:39:18 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-935f097f-166f-486c-8f4e-6df5d77c52ad tempest-TaggedAttachmentsTest-1503143233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c26ae82-5f14-441e-9dbb-b85098352d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:39:18 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16780c8-855e-4e8a-8fbf-9de52f060e1f]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:39:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-7b643025-ceaa-42ae-b27f-660e928af261 req-81d44192-7713-4f44-95f3-4f8c8e3371d5 tempest-ServerActionsTestOtherA-1596451723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22d1db9a-cea2-41e8-8d05-56498576704c {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:39:18 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-935f097f-166f-486c-8f4e-6df5d77c52ad tempest-TaggedAttachmentsTest-1503143233 None] Volume volume-fe46955e-3331-4ce5-8000-7964d0d129eb (fe46955e-3331-4ce5-8000-7964d0d129eb): created successfully
Jul 10 12:39:18 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-935f097f-166f-486c-8f4e-6df5d77c52ad tempest-TaggedAttachmentsTest-1503143233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c26ae82-5f14-441e-9dbb-b85098352d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:39:18 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-935f097f-166f-486c-8f4e-6df5d77c52ad tempest-TaggedAttachmentsTest-1503143233 None] Flow 'volume_create_manager' (cabb1d0a-1d42-495c-a165-e129df283776) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:39:18 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-935f097f-166f-486c-8f4e-6df5d77c52ad tempest-TaggedAttachmentsTest-1503143233 None] Created volume successfully.
Jul 10 12:39:18 devstack sudo[90070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22d1db9a-cea2-41e8-8d05-56498576704c
Jul 10 12:39:18 devstack sudo[90070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:39:19 devstack sudo[90065]: pam_unix(sudo:session): session closed for user root
Jul 10 12:39:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e0e06bfe-4069-4794-99a5-c9dfa329b134 tempest-GroupsV314Test-1546354874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9063e734-51e3-40c2-a10e-ac71698bc111" returned: 0 in 1.267s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:39:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e0e06bfe-4069-4794-99a5-c9dfa329b134 tempest-GroupsV314Test-1546354874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9063e734-51e3-40c2-a10e-ac71698bc111 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:39:19 devstack sudo[90075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9063e734-51e3-40c2-a10e-ac71698bc111
Jul 10 12:39:19 devstack sudo[90075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:39:20 devstack sudo[90070]: pam_unix(sudo:session): session closed for user root
Jul 10 12:39:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-7b643025-ceaa-42ae-b27f-660e928af261 req-81d44192-7713-4f44-95f3-4f8c8e3371d5 tempest-ServerActionsTestOtherA-1596451723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22d1db9a-cea2-41e8-8d05-56498576704c" returned: 0 in 1.232s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:39:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-7b643025-ceaa-42ae-b27f-660e928af261 req-81d44192-7713-4f44-95f3-4f8c8e3371d5 tempest-ServerActionsTestOtherA-1596451723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.270s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:39:20 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-7b643025-ceaa-42ae-b27f-660e928af261 req-81d44192-7713-4f44-95f3-4f8c8e3371d5 tempest-ServerActionsTestOtherA-1596451723 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be', 'name': 'volume-22d1db9a-cea2-41e8-8d05-56498576704c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '918df7b1-c498-439c-9326-7bef7638972f', 'enforce_multipath': True} {{(pid=87378) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 10 12:39:20 devstack cinder-volume[87378]: INFO cinder.volume.manager [req-7b643025-ceaa-42ae-b27f-660e928af261 req-81d44192-7713-4f44-95f3-4f8c8e3371d5 tempest-ServerActionsTestOtherA-1596451723 None] attachment_update completed successfully.
Jul 10 12:39:20 devstack sudo[90075]: pam_unix(sudo:session): session closed for user root
Jul 10 12:39:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e0e06bfe-4069-4794-99a5-c9dfa329b134 tempest-GroupsV314Test-1546354874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9063e734-51e3-40c2-a10e-ac71698bc111" returned: 0 in 1.124s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:39:20 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e0e06bfe-4069-4794-99a5-c9dfa329b134 tempest-GroupsV314Test-1546354874 None] Lock "cinder-quobyte-9063e734-51e3-40c2-a10e-ac71698bc111" released by "delete_volume" :: held 2.489s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:39:20 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-e0e06bfe-4069-4794-99a5-c9dfa329b134 tempest-GroupsV314Test-1546354874 None] Created reservations ['ae27ac06-41eb-48c5-8273-e3966d90a947'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:39:20 devstack cinder-volume[87378]: WARNING cinder.quota [None req-e0e06bfe-4069-4794-99a5-c9dfa329b134 tempest-GroupsV314Test-1546354874 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1815096716 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1815096716, it is now deprecated. Please use the default quota class for default quota.
Jul 10 12:39:20 devstack cinder-volume[87378]: WARNING cinder.quota [None req-e0e06bfe-4069-4794-99a5-c9dfa329b134 tempest-GroupsV314Test-1546354874 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1815096716 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1815096716, it is now deprecated. Please use the default quota class for default quota.
Jul 10 12:39:20 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-e0e06bfe-4069-4794-99a5-c9dfa329b134 tempest-GroupsV314Test-1546354874 None] Created reservations ['622a8388-54c6-4789-a410-e05ee8181ec8', '0d7b6100-a735-454c-b35e-76a6a4327933', '2cd6b148-87fa-4c5f-b123-9cb2c853db51', 'ab9a7051-3564-4010-85ef-e3c6c99c1d31'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:39:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e0e06bfe-4069-4794-99a5-c9dfa329b134 tempest-GroupsV314Test-1546354874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:39:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e0e06bfe-4069-4794-99a5-c9dfa329b134 tempest-GroupsV314Test-1546354874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:39:20 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-e0e06bfe-4069-4794-99a5-c9dfa329b134 tempest-GroupsV314Test-1546354874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:39:20 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-e0e06bfe-4069-4794-99a5-c9dfa329b134 tempest-GroupsV314Test-1546354874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:39:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e0e06bfe-4069-4794-99a5-c9dfa329b134 tempest-GroupsV314Test-1546354874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:39:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e0e06bfe-4069-4794-99a5-c9dfa329b134 tempest-GroupsV314Test-1546354874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:39:20 devstack sudo[90082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:39:20 devstack sudo[90082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:39:21 devstack sudo[90082]: pam_unix(sudo:session): session closed for user root
Jul 10 12:39:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e0e06bfe-4069-4794-99a5-c9dfa329b134 tempest-GroupsV314Test-1546354874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.748s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:39:21 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-e0e06bfe-4069-4794-99a5-c9dfa329b134 tempest-GroupsV314Test-1546354874 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:39:21 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-e0e06bfe-4069-4794-99a5-c9dfa329b134 tempest-GroupsV314Test-1546354874 None] Delete group completed successfully.
Jul 10 12:39:22 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-ae7ca763-7621-4547-9709-3f3ee48aa050 tempest-GroupsV314Test-1546354874 None] Acquiring lock "cinder-quobyte-e573bd30-e897-4094-acb2-938590a607cf" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:39:22 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-ae7ca763-7621-4547-9709-3f3ee48aa050 tempest-GroupsV314Test-1546354874 None] Lock "cinder-quobyte-e573bd30-e897-4094-acb2-938590a607cf" acquired by "delete_volume" :: waited 0.026s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:39:22 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab58193-b479-4886-b7a1-4ab2ecd332f1]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:39:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ae7ca763-7621-4547-9709-3f3ee48aa050 tempest-GroupsV314Test-1546354874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:39:22 devstack sudo[90110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf
Jul 10 12:39:22 devstack sudo[90110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:39:23 devstack sudo[90110]: pam_unix(sudo:session): session closed for user root
Jul 10 12:39:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ae7ca763-7621-4547-9709-3f3ee48aa050 tempest-GroupsV314Test-1546354874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf" returned: 0 in 1.233s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:39:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ae7ca763-7621-4547-9709-3f3ee48aa050 tempest-GroupsV314Test-1546354874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:39:23 devstack sudo[90151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf
Jul 10 12:39:23 devstack sudo[90151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:39:24 devstack sudo[90151]: pam_unix(sudo:session): session closed for user root
Jul 10 12:39:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ae7ca763-7621-4547-9709-3f3ee48aa050 tempest-GroupsV314Test-1546354874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e573bd30-e897-4094-acb2-938590a607cf" returned: 0 in 0.744s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:39:24 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-ae7ca763-7621-4547-9709-3f3ee48aa050 tempest-GroupsV314Test-1546354874 None] Lock "cinder-quobyte-e573bd30-e897-4094-acb2-938590a607cf" released by "delete_volume" :: held 2.051s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:39:24 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-ae7ca763-7621-4547-9709-3f3ee48aa050 tempest-GroupsV314Test-1546354874 None] Created reservations ['6bd03442-6364-4284-9dd2-e7e3d9d09773'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:39:24 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-ae7ca763-7621-4547-9709-3f3ee48aa050 tempest-GroupsV314Test-1546354874 None] Created reservations ['55cf8f54-d1bf-47da-9562-eea4268a9df2', '30e0545c-43a3-4606-9ff6-5b35f79d146b', '86725b75-87a1-4d5b-a536-5faa5323630a', '2b0be096-b4dc-4df6-9355-cecf7f719c9d'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:39:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ae7ca763-7621-4547-9709-3f3ee48aa050 tempest-GroupsV314Test-1546354874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:39:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ae7ca763-7621-4547-9709-3f3ee48aa050 tempest-GroupsV314Test-1546354874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:39:24 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-ae7ca763-7621-4547-9709-3f3ee48aa050 tempest-GroupsV314Test-1546354874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:39:24 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-ae7ca763-7621-4547-9709-3f3ee48aa050 tempest-GroupsV314Test-1546354874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:39:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ae7ca763-7621-4547-9709-3f3ee48aa050 tempest-GroupsV314Test-1546354874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:39:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ae7ca763-7621-4547-9709-3f3ee48aa050 tempest-GroupsV314Test-1546354874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:39:24 devstack sudo[90224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:39:24 devstack sudo[90224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:39:25 devstack sudo[90224]: pam_unix(sudo:session): session closed for user root
Jul 10 12:39:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ae7ca763-7621-4547-9709-3f3ee48aa050 tempest-GroupsV314Test-1546354874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 1.157s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:39:25 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-ae7ca763-7621-4547-9709-3f3ee48aa050 tempest-GroupsV314Test-1546354874 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:39:25 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-ae7ca763-7621-4547-9709-3f3ee48aa050 tempest-GroupsV314Test-1546354874 None] Delete group completed successfully.
Jul 10 12:39:29 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-91be1b9b-066f-4497-bb2a-cddb2f56beff tempest-ServersNegativeTestJSON-838654712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:39:29 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-91be1b9b-066f-4497-bb2a-cddb2f56beff tempest-ServersNegativeTestJSON-838654712 None] Flow 'volume_create_manager' (f5a73225-2e2f-4ed9-abb7-c05b8eafc099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:39:29 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-91be1b9b-066f-4497-bb2a-cddb2f56beff tempest-ServersNegativeTestJSON-838654712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb6f50ed-6495-4bfa-8ea8-e69140027373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:39:30 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-91be1b9b-066f-4497-bb2a-cddb2f56beff tempest-ServersNegativeTestJSON-838654712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb6f50ed-6495-4bfa-8ea8-e69140027373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2034531757',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f853a60d-59b3-48db-84fb-befafb9c79fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61a4bd8298624cd4bceeb969ec3bb20c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:39:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:39:30Z,use_quota=True,user_id='01e320a91e9d413cbac6f723df9911c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:39:30 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-91be1b9b-066f-4497-bb2a-cddb2f56beff tempest-ServersNegativeTestJSON-838654712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fbaa417-3a82-4116-9f73-2a370f8dd6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:39:30 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-91be1b9b-066f-4497-bb2a-cddb2f56beff tempest-ServersNegativeTestJSON-838654712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fbaa417-3a82-4116-9f73-2a370f8dd6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:39:30 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-91be1b9b-066f-4497-bb2a-cddb2f56beff tempest-ServersNegativeTestJSON-838654712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (676b9ddb-b525-4b2e-99a8-2b4430849e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:39:30 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-91be1b9b-066f-4497-bb2a-cddb2f56beff tempest-ServersNegativeTestJSON-838654712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (676b9ddb-b525-4b2e-99a8-2b4430849e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f853a60d-59b3-48db-84fb-befafb9c79fd', 'volume_name': 'volume-f853a60d-59b3-48db-84fb-befafb9c79fd', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:39:30 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-91be1b9b-066f-4497-bb2a-cddb2f56beff tempest-ServersNegativeTestJSON-838654712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78a99bed-fe84-4b6c-b940-9d3ebff990aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:39:30 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-91be1b9b-066f-4497-bb2a-cddb2f56beff tempest-ServersNegativeTestJSON-838654712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78a99bed-fe84-4b6c-b940-9d3ebff990aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:39:30 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-91be1b9b-066f-4497-bb2a-cddb2f56beff tempest-ServersNegativeTestJSON-838654712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11857fd6-2338-4d94-864a-77e6a84c39fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:39:30 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-91be1b9b-066f-4497-bb2a-cddb2f56beff tempest-ServersNegativeTestJSON-838654712 None] Volume f853a60d-59b3-48db-84fb-befafb9c79fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f853a60d-59b3-48db-84fb-befafb9c79fd', 'volume_size': 1}
Jul 10 12:39:30 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-91be1b9b-066f-4497-bb2a-cddb2f56beff tempest-ServersNegativeTestJSON-838654712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:39:30 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-91be1b9b-066f-4497-bb2a-cddb2f56beff tempest-ServersNegativeTestJSON-838654712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:39:30 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-91be1b9b-066f-4497-bb2a-cddb2f56beff tempest-ServersNegativeTestJSON-838654712 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2034531757',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f853a60d-59b3-48db-84fb-befafb9c79fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61a4bd8298624cd4bceeb969ec3bb20c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:39:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:39:30Z,use_quota=True,user_id='01e320a91e9d413cbac6f723df9911c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:39:30 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-91be1b9b-066f-4497-bb2a-cddb2f56beff tempest-ServersNegativeTestJSON-838654712 None] Creating volume f853a60d-59b3-48db-84fb-befafb9c79fd {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:39:30 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-91be1b9b-066f-4497-bb2a-cddb2f56beff tempest-ServersNegativeTestJSON-838654712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:39:30 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-91be1b9b-066f-4497-bb2a-cddb2f56beff tempest-ServersNegativeTestJSON-838654712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:39:30 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-91be1b9b-066f-4497-bb2a-cddb2f56beff tempest-ServersNegativeTestJSON-838654712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:39:30 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-91be1b9b-066f-4497-bb2a-cddb2f56beff tempest-ServersNegativeTestJSON-838654712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:39:30 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-91be1b9b-066f-4497-bb2a-cddb2f56beff tempest-ServersNegativeTestJSON-838654712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:39:30 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-91be1b9b-066f-4497-bb2a-cddb2f56beff tempest-ServersNegativeTestJSON-838654712 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:39:30 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-91be1b9b-066f-4497-bb2a-cddb2f56beff tempest-ServersNegativeTestJSON-838654712 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:39:30 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-91be1b9b-066f-4497-bb2a-cddb2f56beff tempest-ServersNegativeTestJSON-838654712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f853a60d-59b3-48db-84fb-befafb9c79fd 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:39:30 devstack sudo[90587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f853a60d-59b3-48db-84fb-befafb9c79fd 1073741824
Jul 10 12:39:30 devstack sudo[90587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:39:31 devstack sudo[90587]: pam_unix(sudo:session): session closed for user root
Jul 10 12:39:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-91be1b9b-066f-4497-bb2a-cddb2f56beff tempest-ServersNegativeTestJSON-838654712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f853a60d-59b3-48db-84fb-befafb9c79fd 1073741824" returned: 0 in 1.499s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:39:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-91be1b9b-066f-4497-bb2a-cddb2f56beff tempest-ServersNegativeTestJSON-838654712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f853a60d-59b3-48db-84fb-befafb9c79fd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:39:31 devstack sudo[90593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f853a60d-59b3-48db-84fb-befafb9c79fd
Jul 10 12:39:31 devstack sudo[90593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:39:32 devstack sudo[90593]: pam_unix(sudo:session): session closed for user root
Jul 10 12:39:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-91be1b9b-066f-4497-bb2a-cddb2f56beff tempest-ServersNegativeTestJSON-838654712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f853a60d-59b3-48db-84fb-befafb9c79fd" returned: 0 in 1.108s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:39:32 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-91be1b9b-066f-4497-bb2a-cddb2f56beff tempest-ServersNegativeTestJSON-838654712 None] <== create_volume: return (2686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:39:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-91be1b9b-066f-4497-bb2a-cddb2f56beff tempest-ServersNegativeTestJSON-838654712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.689s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:39:32 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-91be1b9b-066f-4497-bb2a-cddb2f56beff tempest-ServersNegativeTestJSON-838654712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11857fd6-2338-4d94-864a-77e6a84c39fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f853a60d-59b3-48db-84fb-befafb9c79fd', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:39:32 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-91be1b9b-066f-4497-bb2a-cddb2f56beff tempest-ServersNegativeTestJSON-838654712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b787b5a-f8a0-4a19-aec4-c62a16eca6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:39:32 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-91be1b9b-066f-4497-bb2a-cddb2f56beff tempest-ServersNegativeTestJSON-838654712 None] Volume volume-f853a60d-59b3-48db-84fb-befafb9c79fd (f853a60d-59b3-48db-84fb-befafb9c79fd): created successfully
Jul 10 12:39:32 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-91be1b9b-066f-4497-bb2a-cddb2f56beff tempest-ServersNegativeTestJSON-838654712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b787b5a-f8a0-4a19-aec4-c62a16eca6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:39:32 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-91be1b9b-066f-4497-bb2a-cddb2f56beff tempest-ServersNegativeTestJSON-838654712 None] Flow 'volume_create_manager' (f5a73225-2e2f-4ed9-abb7-c05b8eafc099) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:39:32 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-91be1b9b-066f-4497-bb2a-cddb2f56beff tempest-ServersNegativeTestJSON-838654712 None] Created volume successfully.
Jul 10 12:39:35 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c36880c-1145-4223-b33f-fd35944881f6 tempest-ServersNegativeTestJSON-838654712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:39:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1c36880c-1145-4223-b33f-fd35944881f6 tempest-ServersNegativeTestJSON-838654712 None] Flow 'volume_create_manager' (167e90eb-a6a2-41d3-aa88-4e7ffbb4e9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:39:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1c36880c-1145-4223-b33f-fd35944881f6 tempest-ServersNegativeTestJSON-838654712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b0f48aa-fda5-4fc3-9fd0-ea5e8e39c56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:39:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1c36880c-1145-4223-b33f-fd35944881f6 tempest-ServersNegativeTestJSON-838654712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b0f48aa-fda5-4fc3-9fd0-ea5e8e39c56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-800877034',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9fe5870-0811-4e69-b8ed-d79ec9fb190b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61a4bd8298624cd4bceeb969ec3bb20c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:39:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:39:36Z,use_quota=True,user_id='01e320a91e9d413cbac6f723df9911c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:39:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1c36880c-1145-4223-b33f-fd35944881f6 tempest-ServersNegativeTestJSON-838654712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7b2e7f5-b5a9-4f7e-8996-d14cc3a4c009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:39:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1c36880c-1145-4223-b33f-fd35944881f6 tempest-ServersNegativeTestJSON-838654712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7b2e7f5-b5a9-4f7e-8996-d14cc3a4c009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:39:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1c36880c-1145-4223-b33f-fd35944881f6 tempest-ServersNegativeTestJSON-838654712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c03d7c7b-5b82-4347-8b61-a1138b57526c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:39:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1c36880c-1145-4223-b33f-fd35944881f6 tempest-ServersNegativeTestJSON-838654712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c03d7c7b-5b82-4347-8b61-a1138b57526c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9fe5870-0811-4e69-b8ed-d79ec9fb190b', 'volume_name': 'volume-a9fe5870-0811-4e69-b8ed-d79ec9fb190b', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:39:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1c36880c-1145-4223-b33f-fd35944881f6 tempest-ServersNegativeTestJSON-838654712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cb6f2e2-19bb-455c-a043-e19db039cc36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:39:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1c36880c-1145-4223-b33f-fd35944881f6 tempest-ServersNegativeTestJSON-838654712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cb6f2e2-19bb-455c-a043-e19db039cc36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:39:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1c36880c-1145-4223-b33f-fd35944881f6 tempest-ServersNegativeTestJSON-838654712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8353f2a9-df67-45ae-94eb-af68a69d5f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:39:35 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-1c36880c-1145-4223-b33f-fd35944881f6 tempest-ServersNegativeTestJSON-838654712 None] Volume a9fe5870-0811-4e69-b8ed-d79ec9fb190b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9fe5870-0811-4e69-b8ed-d79ec9fb190b', 'volume_size': 1}
Jul 10 12:39:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1c36880c-1145-4223-b33f-fd35944881f6 tempest-ServersNegativeTestJSON-838654712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:39:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1c36880c-1145-4223-b33f-fd35944881f6 tempest-ServersNegativeTestJSON-838654712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:39:35 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-1c36880c-1145-4223-b33f-fd35944881f6 tempest-ServersNegativeTestJSON-838654712 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-800877034',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9fe5870-0811-4e69-b8ed-d79ec9fb190b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61a4bd8298624cd4bceeb969ec3bb20c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:39:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:39:36Z,use_quota=True,user_id='01e320a91e9d413cbac6f723df9911c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:39:35 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-1c36880c-1145-4223-b33f-fd35944881f6 tempest-ServersNegativeTestJSON-838654712 None] Creating volume a9fe5870-0811-4e69-b8ed-d79ec9fb190b {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:39:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1c36880c-1145-4223-b33f-fd35944881f6 tempest-ServersNegativeTestJSON-838654712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:39:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1c36880c-1145-4223-b33f-fd35944881f6 tempest-ServersNegativeTestJSON-838654712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:39:35 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-1c36880c-1145-4223-b33f-fd35944881f6 tempest-ServersNegativeTestJSON-838654712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:39:36 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-1c36880c-1145-4223-b33f-fd35944881f6 tempest-ServersNegativeTestJSON-838654712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:39:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1c36880c-1145-4223-b33f-fd35944881f6 tempest-ServersNegativeTestJSON-838654712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:39:36 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-1c36880c-1145-4223-b33f-fd35944881f6 tempest-ServersNegativeTestJSON-838654712 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:39:36 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-1c36880c-1145-4223-b33f-fd35944881f6 tempest-ServersNegativeTestJSON-838654712 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:39:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1c36880c-1145-4223-b33f-fd35944881f6 tempest-ServersNegativeTestJSON-838654712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a9fe5870-0811-4e69-b8ed-d79ec9fb190b 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:39:36 devstack sudo[90621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a9fe5870-0811-4e69-b8ed-d79ec9fb190b 1073741824
Jul 10 12:39:36 devstack sudo[90621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:39:37 devstack sudo[90621]: pam_unix(sudo:session): session closed for user root
Jul 10 12:39:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1c36880c-1145-4223-b33f-fd35944881f6 tempest-ServersNegativeTestJSON-838654712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a9fe5870-0811-4e69-b8ed-d79ec9fb190b 1073741824" returned: 0 in 1.437s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:39:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1c36880c-1145-4223-b33f-fd35944881f6 tempest-ServersNegativeTestJSON-838654712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a9fe5870-0811-4e69-b8ed-d79ec9fb190b {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:39:37 devstack sudo[90627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a9fe5870-0811-4e69-b8ed-d79ec9fb190b
Jul 10 12:39:37 devstack sudo[90627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:39:38 devstack sudo[90627]: pam_unix(sudo:session): session closed for user root
Jul 10 12:39:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1c36880c-1145-4223-b33f-fd35944881f6 tempest-ServersNegativeTestJSON-838654712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a9fe5870-0811-4e69-b8ed-d79ec9fb190b" returned: 0 in 1.333s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:39:38 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-1c36880c-1145-4223-b33f-fd35944881f6 tempest-ServersNegativeTestJSON-838654712 None] <== create_volume: return (2827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:39:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1c36880c-1145-4223-b33f-fd35944881f6 tempest-ServersNegativeTestJSON-838654712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.832s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:39:38 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1c36880c-1145-4223-b33f-fd35944881f6 tempest-ServersNegativeTestJSON-838654712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8353f2a9-df67-45ae-94eb-af68a69d5f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9fe5870-0811-4e69-b8ed-d79ec9fb190b', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:39:38 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1c36880c-1145-4223-b33f-fd35944881f6 tempest-ServersNegativeTestJSON-838654712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16a6754c-ca03-4a02-bdeb-323620f2c2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:39:38 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-1c36880c-1145-4223-b33f-fd35944881f6 tempest-ServersNegativeTestJSON-838654712 None] Volume volume-a9fe5870-0811-4e69-b8ed-d79ec9fb190b (a9fe5870-0811-4e69-b8ed-d79ec9fb190b): created successfully
Jul 10 12:39:38 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1c36880c-1145-4223-b33f-fd35944881f6 tempest-ServersNegativeTestJSON-838654712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16a6754c-ca03-4a02-bdeb-323620f2c2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:39:38 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1c36880c-1145-4223-b33f-fd35944881f6 tempest-ServersNegativeTestJSON-838654712 None] Flow 'volume_create_manager' (167e90eb-a6a2-41d3-aa88-4e7ffbb4e9f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:39:38 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-1c36880c-1145-4223-b33f-fd35944881f6 tempest-ServersNegativeTestJSON-838654712 None] Created volume successfully.
Jul 10 12:39:40 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f4366389-fa1b-43d7-b8d0-a5660c39b7f6 tempest-ServersNegativeTestJSON-838654712 None] Acquiring lock "cinder-a9fe5870-0811-4e69-b8ed-d79ec9fb190b-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:39:40 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f4366389-fa1b-43d7-b8d0-a5660c39b7f6 tempest-ServersNegativeTestJSON-838654712 None] Lock "cinder-a9fe5870-0811-4e69-b8ed-d79ec9fb190b-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:39:40 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f4366389-fa1b-43d7-b8d0-a5660c39b7f6 tempest-ServersNegativeTestJSON-838654712 None] Acquiring lock "cinder-quobyte-a9fe5870-0811-4e69-b8ed-d79ec9fb190b" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:39:40 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f4366389-fa1b-43d7-b8d0-a5660c39b7f6 tempest-ServersNegativeTestJSON-838654712 None] Lock "cinder-quobyte-a9fe5870-0811-4e69-b8ed-d79ec9fb190b" acquired by "delete_volume" :: waited 0.032s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:39:40 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[65714b89-6bad-44f8-9f7e-54c483172c96]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:39:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f4366389-fa1b-43d7-b8d0-a5660c39b7f6 tempest-ServersNegativeTestJSON-838654712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a9fe5870-0811-4e69-b8ed-d79ec9fb190b {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:39:40 devstack sudo[90696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a9fe5870-0811-4e69-b8ed-d79ec9fb190b
Jul 10 12:39:40 devstack sudo[90696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:39:41 devstack sudo[90696]: pam_unix(sudo:session): session closed for user root
Jul 10 12:39:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f4366389-fa1b-43d7-b8d0-a5660c39b7f6 tempest-ServersNegativeTestJSON-838654712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a9fe5870-0811-4e69-b8ed-d79ec9fb190b" returned: 0 in 0.966s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:39:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f4366389-fa1b-43d7-b8d0-a5660c39b7f6 tempest-ServersNegativeTestJSON-838654712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a9fe5870-0811-4e69-b8ed-d79ec9fb190b {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:39:41 devstack sudo[90723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a9fe5870-0811-4e69-b8ed-d79ec9fb190b
Jul 10 12:39:41 devstack sudo[90723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:39:42 devstack sudo[90723]: pam_unix(sudo:session): session closed for user root
Jul 10 12:39:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f4366389-fa1b-43d7-b8d0-a5660c39b7f6 tempest-ServersNegativeTestJSON-838654712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a9fe5870-0811-4e69-b8ed-d79ec9fb190b" returned: 0 in 0.796s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:39:42 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f4366389-fa1b-43d7-b8d0-a5660c39b7f6 tempest-ServersNegativeTestJSON-838654712 None] Lock "cinder-quobyte-a9fe5870-0811-4e69-b8ed-d79ec9fb190b" released by "delete_volume" :: held 1.828s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:39:42 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-f4366389-fa1b-43d7-b8d0-a5660c39b7f6 tempest-ServersNegativeTestJSON-838654712 None] Created reservations ['6d3f1358-7789-42d1-9e61-86f43e26c223', 'ff9a71b2-2308-47e6-9944-f7ca170da9a3', '78514481-b15e-4fa1-8b29-238dbaeb4e88', 'fcb2e862-91ae-4e36-aa70-9e2553a75159'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:39:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f4366389-fa1b-43d7-b8d0-a5660c39b7f6 tempest-ServersNegativeTestJSON-838654712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:39:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f4366389-fa1b-43d7-b8d0-a5660c39b7f6 tempest-ServersNegativeTestJSON-838654712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:39:42 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-f4366389-fa1b-43d7-b8d0-a5660c39b7f6 tempest-ServersNegativeTestJSON-838654712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:39:42 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-f4366389-fa1b-43d7-b8d0-a5660c39b7f6 tempest-ServersNegativeTestJSON-838654712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:39:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f4366389-fa1b-43d7-b8d0-a5660c39b7f6 tempest-ServersNegativeTestJSON-838654712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:39:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f4366389-fa1b-43d7-b8d0-a5660c39b7f6 tempest-ServersNegativeTestJSON-838654712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:39:42 devstack sudo[90729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:39:42 devstack sudo[90729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:39:42 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-47a61b7f-9b21-43bb-a1c4-c225dda0f9a4 tempest-ServersNegativeTestJSON-838654712 None] Acquiring lock "cinder-f853a60d-59b3-48db-84fb-befafb9c79fd-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:39:42 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-47a61b7f-9b21-43bb-a1c4-c225dda0f9a4 tempest-ServersNegativeTestJSON-838654712 None] Lock "cinder-f853a60d-59b3-48db-84fb-befafb9c79fd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:39:42 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-47a61b7f-9b21-43bb-a1c4-c225dda0f9a4 tempest-ServersNegativeTestJSON-838654712 None] Acquiring lock "cinder-quobyte-f853a60d-59b3-48db-84fb-befafb9c79fd" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:39:42 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-47a61b7f-9b21-43bb-a1c4-c225dda0f9a4 tempest-ServersNegativeTestJSON-838654712 None] Lock "cinder-quobyte-f853a60d-59b3-48db-84fb-befafb9c79fd" acquired by "delete_volume" :: waited 0.027s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:39:42 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a392f1-7baf-4baf-a77f-a1730ef8bb23]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:39:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-47a61b7f-9b21-43bb-a1c4-c225dda0f9a4 tempest-ServersNegativeTestJSON-838654712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f853a60d-59b3-48db-84fb-befafb9c79fd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:39:42 devstack sudo[90731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f853a60d-59b3-48db-84fb-befafb9c79fd
Jul 10 12:39:42 devstack sudo[90731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:39:43 devstack sudo[90729]: pam_unix(sudo:session): session closed for user root
Jul 10 12:39:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f4366389-fa1b-43d7-b8d0-a5660c39b7f6 tempest-ServersNegativeTestJSON-838654712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.881s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:39:43 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-f4366389-fa1b-43d7-b8d0-a5660c39b7f6 tempest-ServersNegativeTestJSON-838654712 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:39:43 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-f4366389-fa1b-43d7-b8d0-a5660c39b7f6 tempest-ServersNegativeTestJSON-838654712 None] Deleted volume successfully.
Jul 10 12:39:43 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f4366389-fa1b-43d7-b8d0-a5660c39b7f6 tempest-ServersNegativeTestJSON-838654712 None] Lock "cinder-a9fe5870-0811-4e69-b8ed-d79ec9fb190b-delete_volume" released by "delete_volume" :: held 3.023s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:39:43 devstack sudo[90731]: pam_unix(sudo:session): session closed for user root
Jul 10 12:39:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-47a61b7f-9b21-43bb-a1c4-c225dda0f9a4 tempest-ServersNegativeTestJSON-838654712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f853a60d-59b3-48db-84fb-befafb9c79fd" returned: 0 in 1.273s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:39:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-47a61b7f-9b21-43bb-a1c4-c225dda0f9a4 tempest-ServersNegativeTestJSON-838654712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f853a60d-59b3-48db-84fb-befafb9c79fd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:39:44 devstack sudo[90737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f853a60d-59b3-48db-84fb-befafb9c79fd
Jul 10 12:39:44 devstack sudo[90737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:39:44 devstack sudo[90737]: pam_unix(sudo:session): session closed for user root
Jul 10 12:39:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-47a61b7f-9b21-43bb-a1c4-c225dda0f9a4 tempest-ServersNegativeTestJSON-838654712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f853a60d-59b3-48db-84fb-befafb9c79fd" returned: 0 in 0.834s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:39:44 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-47a61b7f-9b21-43bb-a1c4-c225dda0f9a4 tempest-ServersNegativeTestJSON-838654712 None] Lock "cinder-quobyte-f853a60d-59b3-48db-84fb-befafb9c79fd" released by "delete_volume" :: held 2.164s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:39:44 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-47a61b7f-9b21-43bb-a1c4-c225dda0f9a4 tempest-ServersNegativeTestJSON-838654712 None] Created reservations ['19fbaeea-3b04-4f7c-b265-72829129bde3', '49b0d1ed-d43b-4726-b3db-65f5db997aad', '83df25a5-f0ea-4075-bd90-29fc706135a0', '30c4f4e4-638a-4f66-a95c-e6ed340bf520'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:39:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-47a61b7f-9b21-43bb-a1c4-c225dda0f9a4 tempest-ServersNegativeTestJSON-838654712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:39:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-47a61b7f-9b21-43bb-a1c4-c225dda0f9a4 tempest-ServersNegativeTestJSON-838654712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:39:44 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-47a61b7f-9b21-43bb-a1c4-c225dda0f9a4 tempest-ServersNegativeTestJSON-838654712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:39:44 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-47a61b7f-9b21-43bb-a1c4-c225dda0f9a4 tempest-ServersNegativeTestJSON-838654712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:39:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-47a61b7f-9b21-43bb-a1c4-c225dda0f9a4 tempest-ServersNegativeTestJSON-838654712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:39:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-47a61b7f-9b21-43bb-a1c4-c225dda0f9a4 tempest-ServersNegativeTestJSON-838654712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:39:45 devstack sudo[90764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:39:45 devstack sudo[90764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:39:45 devstack sudo[90764]: pam_unix(sudo:session): session closed for user root
Jul 10 12:39:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-47a61b7f-9b21-43bb-a1c4-c225dda0f9a4 tempest-ServersNegativeTestJSON-838654712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.738s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:39:45 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-47a61b7f-9b21-43bb-a1c4-c225dda0f9a4 tempest-ServersNegativeTestJSON-838654712 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:39:45 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-47a61b7f-9b21-43bb-a1c4-c225dda0f9a4 tempest-ServersNegativeTestJSON-838654712 None] Deleted volume successfully.
Jul 10 12:39:45 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-47a61b7f-9b21-43bb-a1c4-c225dda0f9a4 tempest-ServersNegativeTestJSON-838654712 None] Lock "cinder-f853a60d-59b3-48db-84fb-befafb9c79fd-delete_volume" released by "delete_volume" :: held 3.149s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:39:52 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:SELECT=51,cinder:UPDATE=65,cinder:INSERT=12 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:39:52 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:SELECT=61,cinder:UPDATE=49,cinder:DELETE=6,cinder:INSERT=12 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:39:52 devstack cinder-volume[87378]: INFO cinder.volume.manager [req-97c11b4d-915c-4c3c-9805-b390dd88a7e9 req-567dcd83-b6f5-4dba-8926-be8d78037d73 tempest-ServerActionsTestOtherA-1596451723 None] Terminate volume connection completed successfully.
Jul 10 12:39:52 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-97c11b4d-915c-4c3c-9805-b390dd88a7e9 req-567dcd83-b6f5-4dba-8926-be8d78037d73 tempest-ServerActionsTestOtherA-1596451723 None] Deleting attachment 918df7b1-c498-439c-9326-7bef7638972f. {{(pid=87378) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 10 12:40:00 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-39679805-5e73-4e66-8eb0-c3d2aed72d7b tempest-VolumeQuotasAdminTestJSON-1611100790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:40:00 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-39679805-5e73-4e66-8eb0-c3d2aed72d7b tempest-VolumeQuotasAdminTestJSON-1611100790 None] Flow 'volume_create_manager' (f9b42e69-bff6-45bd-b2e7-58d2cfe348eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:40:00 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-39679805-5e73-4e66-8eb0-c3d2aed72d7b tempest-VolumeQuotasAdminTestJSON-1611100790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (810dc727-7afc-4b7c-bff1-b0bcccf82340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:40:00 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-39679805-5e73-4e66-8eb0-c3d2aed72d7b tempest-VolumeQuotasAdminTestJSON-1611100790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (810dc727-7afc-4b7c-bff1-b0bcccf82340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:40:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1938813742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f9a8039-d13c-4ed0-950f-2c08a54aa6f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa2cf393e70240ca9604336d03496050',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:40:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:40:00Z,use_quota=True,user_id='f7c3ca5bee8649519c41f67d34ed5014',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:40:00 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-39679805-5e73-4e66-8eb0-c3d2aed72d7b tempest-VolumeQuotasAdminTestJSON-1611100790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51a62a6e-2959-44ae-aa4c-798eacae8d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:40:00 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-39679805-5e73-4e66-8eb0-c3d2aed72d7b tempest-VolumeQuotasAdminTestJSON-1611100790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51a62a6e-2959-44ae-aa4c-798eacae8d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:40:00 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-39679805-5e73-4e66-8eb0-c3d2aed72d7b tempest-VolumeQuotasAdminTestJSON-1611100790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f611554-0d14-4c6b-9943-6424262ae606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:40:00 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-39679805-5e73-4e66-8eb0-c3d2aed72d7b tempest-VolumeQuotasAdminTestJSON-1611100790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f611554-0d14-4c6b-9943-6424262ae606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f9a8039-d13c-4ed0-950f-2c08a54aa6f7', 'volume_name': 'volume-9f9a8039-d13c-4ed0-950f-2c08a54aa6f7', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:40:00 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-39679805-5e73-4e66-8eb0-c3d2aed72d7b tempest-VolumeQuotasAdminTestJSON-1611100790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a07b803f-ff16-4b26-964e-aca2fd191447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:40:00 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-39679805-5e73-4e66-8eb0-c3d2aed72d7b tempest-VolumeQuotasAdminTestJSON-1611100790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a07b803f-ff16-4b26-964e-aca2fd191447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:40:00 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-39679805-5e73-4e66-8eb0-c3d2aed72d7b tempest-VolumeQuotasAdminTestJSON-1611100790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e90539de-1de6-42e7-b6c1-afe2a5740ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:40:00 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-39679805-5e73-4e66-8eb0-c3d2aed72d7b tempest-VolumeQuotasAdminTestJSON-1611100790 None] Volume 9f9a8039-d13c-4ed0-950f-2c08a54aa6f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f9a8039-d13c-4ed0-950f-2c08a54aa6f7', 'volume_size': 1}
Jul 10 12:40:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-39679805-5e73-4e66-8eb0-c3d2aed72d7b tempest-VolumeQuotasAdminTestJSON-1611100790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:40:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-39679805-5e73-4e66-8eb0-c3d2aed72d7b tempest-VolumeQuotasAdminTestJSON-1611100790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:40:00 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-39679805-5e73-4e66-8eb0-c3d2aed72d7b tempest-VolumeQuotasAdminTestJSON-1611100790 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:40:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1938813742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f9a8039-d13c-4ed0-950f-2c08a54aa6f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa2cf393e70240ca9604336d03496050',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:40:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:40:00Z,use_quota=True,user_id='f7c3ca5bee8649519c41f67d34ed5014',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:40:00 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-39679805-5e73-4e66-8eb0-c3d2aed72d7b tempest-VolumeQuotasAdminTestJSON-1611100790 None] Creating volume 9f9a8039-d13c-4ed0-950f-2c08a54aa6f7 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:40:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-39679805-5e73-4e66-8eb0-c3d2aed72d7b tempest-VolumeQuotasAdminTestJSON-1611100790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:40:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-39679805-5e73-4e66-8eb0-c3d2aed72d7b tempest-VolumeQuotasAdminTestJSON-1611100790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:40:00 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-39679805-5e73-4e66-8eb0-c3d2aed72d7b tempest-VolumeQuotasAdminTestJSON-1611100790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:40:00 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-39679805-5e73-4e66-8eb0-c3d2aed72d7b tempest-VolumeQuotasAdminTestJSON-1611100790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:40:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-39679805-5e73-4e66-8eb0-c3d2aed72d7b tempest-VolumeQuotasAdminTestJSON-1611100790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:40:00 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-39679805-5e73-4e66-8eb0-c3d2aed72d7b tempest-VolumeQuotasAdminTestJSON-1611100790 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:40:00 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-39679805-5e73-4e66-8eb0-c3d2aed72d7b tempest-VolumeQuotasAdminTestJSON-1611100790 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:40:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-39679805-5e73-4e66-8eb0-c3d2aed72d7b tempest-VolumeQuotasAdminTestJSON-1611100790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9f9a8039-d13c-4ed0-950f-2c08a54aa6f7 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:40:00 devstack sudo[90858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9f9a8039-d13c-4ed0-950f-2c08a54aa6f7 1073741824
Jul 10 12:40:00 devstack sudo[90858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:40:01 devstack sudo[90858]: pam_unix(sudo:session): session closed for user root
Jul 10 12:40:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-39679805-5e73-4e66-8eb0-c3d2aed72d7b tempest-VolumeQuotasAdminTestJSON-1611100790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9f9a8039-d13c-4ed0-950f-2c08a54aa6f7 1073741824" returned: 0 in 0.989s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:40:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-39679805-5e73-4e66-8eb0-c3d2aed72d7b tempest-VolumeQuotasAdminTestJSON-1611100790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9f9a8039-d13c-4ed0-950f-2c08a54aa6f7 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:40:01 devstack sudo[90866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9f9a8039-d13c-4ed0-950f-2c08a54aa6f7
Jul 10 12:40:01 devstack sudo[90866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:40:02 devstack sudo[90866]: pam_unix(sudo:session): session closed for user root
Jul 10 12:40:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-39679805-5e73-4e66-8eb0-c3d2aed72d7b tempest-VolumeQuotasAdminTestJSON-1611100790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9f9a8039-d13c-4ed0-950f-2c08a54aa6f7" returned: 0 in 0.767s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:40:02 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-39679805-5e73-4e66-8eb0-c3d2aed72d7b tempest-VolumeQuotasAdminTestJSON-1611100790 None] <== create_volume: return (1811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:40:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-39679805-5e73-4e66-8eb0-c3d2aed72d7b tempest-VolumeQuotasAdminTestJSON-1611100790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.814s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:40:02 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-39679805-5e73-4e66-8eb0-c3d2aed72d7b tempest-VolumeQuotasAdminTestJSON-1611100790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e90539de-1de6-42e7-b6c1-afe2a5740ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f9a8039-d13c-4ed0-950f-2c08a54aa6f7', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:40:02 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-39679805-5e73-4e66-8eb0-c3d2aed72d7b tempest-VolumeQuotasAdminTestJSON-1611100790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e110aa39-59a1-40a7-b472-4cd578d9c7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:40:02 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-39679805-5e73-4e66-8eb0-c3d2aed72d7b tempest-VolumeQuotasAdminTestJSON-1611100790 None] Volume volume-9f9a8039-d13c-4ed0-950f-2c08a54aa6f7 (9f9a8039-d13c-4ed0-950f-2c08a54aa6f7): created successfully
Jul 10 12:40:02 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-39679805-5e73-4e66-8eb0-c3d2aed72d7b tempest-VolumeQuotasAdminTestJSON-1611100790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e110aa39-59a1-40a7-b472-4cd578d9c7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:40:02 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-39679805-5e73-4e66-8eb0-c3d2aed72d7b tempest-VolumeQuotasAdminTestJSON-1611100790 None] Flow 'volume_create_manager' (f9b42e69-bff6-45bd-b2e7-58d2cfe348eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:40:02 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-39679805-5e73-4e66-8eb0-c3d2aed72d7b tempest-VolumeQuotasAdminTestJSON-1611100790 None] Created volume successfully.
Jul 10 12:40:02 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fdcb2fd4-a2e0-4c29-9dad-27344f81f1d4 tempest-VolumeQuotasAdminTestJSON-1611100790 None] Acquiring lock "cinder-9f9a8039-d13c-4ed0-950f-2c08a54aa6f7-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:40:02 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fdcb2fd4-a2e0-4c29-9dad-27344f81f1d4 tempest-VolumeQuotasAdminTestJSON-1611100790 None] Lock "cinder-9f9a8039-d13c-4ed0-950f-2c08a54aa6f7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:40:02 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fdcb2fd4-a2e0-4c29-9dad-27344f81f1d4 tempest-VolumeQuotasAdminTestJSON-1611100790 None] Acquiring lock "cinder-quobyte-9f9a8039-d13c-4ed0-950f-2c08a54aa6f7" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:40:02 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fdcb2fd4-a2e0-4c29-9dad-27344f81f1d4 tempest-VolumeQuotasAdminTestJSON-1611100790 None] Lock "cinder-quobyte-9f9a8039-d13c-4ed0-950f-2c08a54aa6f7" acquired by "delete_volume" :: waited 0.030s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:40:02 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c1c812-954a-4889-8751-b8e9a877f24f]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:40:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fdcb2fd4-a2e0-4c29-9dad-27344f81f1d4 tempest-VolumeQuotasAdminTestJSON-1611100790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9f9a8039-d13c-4ed0-950f-2c08a54aa6f7 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:40:03 devstack sudo[90871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9f9a8039-d13c-4ed0-950f-2c08a54aa6f7
Jul 10 12:40:03 devstack sudo[90871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:40:03 devstack sudo[90871]: pam_unix(sudo:session): session closed for user root
Jul 10 12:40:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fdcb2fd4-a2e0-4c29-9dad-27344f81f1d4 tempest-VolumeQuotasAdminTestJSON-1611100790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9f9a8039-d13c-4ed0-950f-2c08a54aa6f7" returned: 0 in 0.829s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:40:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fdcb2fd4-a2e0-4c29-9dad-27344f81f1d4 tempest-VolumeQuotasAdminTestJSON-1611100790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9f9a8039-d13c-4ed0-950f-2c08a54aa6f7 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:40:03 devstack sudo[90877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9f9a8039-d13c-4ed0-950f-2c08a54aa6f7
Jul 10 12:40:03 devstack sudo[90877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:40:04 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-ff1188d0-207d-4ab1-b6a7-bf7dc0a93f43 tempest-ServerActionsTestOtherA-1596451723 None] Acquiring lock "cinder-22d1db9a-cea2-41e8-8d05-56498576704c-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:40:04 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-ff1188d0-207d-4ab1-b6a7-bf7dc0a93f43 tempest-ServerActionsTestOtherA-1596451723 None] Lock "cinder-22d1db9a-cea2-41e8-8d05-56498576704c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:40:04 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-ff1188d0-207d-4ab1-b6a7-bf7dc0a93f43 tempest-ServerActionsTestOtherA-1596451723 None] Acquiring lock "cinder-quobyte-22d1db9a-cea2-41e8-8d05-56498576704c" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:40:04 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-ff1188d0-207d-4ab1-b6a7-bf7dc0a93f43 tempest-ServerActionsTestOtherA-1596451723 None] Lock "cinder-quobyte-22d1db9a-cea2-41e8-8d05-56498576704c" acquired by "delete_volume" :: waited 0.016s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:40:04 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e98b845-0077-42bb-af37-7df777d4abbc]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:40:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ff1188d0-207d-4ab1-b6a7-bf7dc0a93f43 tempest-ServerActionsTestOtherA-1596451723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22d1db9a-cea2-41e8-8d05-56498576704c {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:40:04 devstack sudo[90877]: pam_unix(sudo:session): session closed for user root
Jul 10 12:40:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fdcb2fd4-a2e0-4c29-9dad-27344f81f1d4 tempest-VolumeQuotasAdminTestJSON-1611100790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9f9a8039-d13c-4ed0-950f-2c08a54aa6f7" returned: 0 in 0.782s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:40:04 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fdcb2fd4-a2e0-4c29-9dad-27344f81f1d4 tempest-VolumeQuotasAdminTestJSON-1611100790 None] Lock "cinder-quobyte-9f9a8039-d13c-4ed0-950f-2c08a54aa6f7" released by "delete_volume" :: held 1.680s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:40:04 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-fdcb2fd4-a2e0-4c29-9dad-27344f81f1d4 tempest-VolumeQuotasAdminTestJSON-1611100790 None] Created reservations ['79288e19-4a8a-48c6-8ec6-1ab52f64af7e', '80f63da4-a9ba-4f54-9c44-313d5e32397e', '1015b2c8-0b31-486f-a13c-a39687f90d3c', '955b9209-25d7-453b-a66c-c76b045d1f4a'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:40:04 devstack sudo[90880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22d1db9a-cea2-41e8-8d05-56498576704c
Jul 10 12:40:04 devstack sudo[90880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:40:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-fdcb2fd4-a2e0-4c29-9dad-27344f81f1d4 tempest-VolumeQuotasAdminTestJSON-1611100790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:40:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-fdcb2fd4-a2e0-4c29-9dad-27344f81f1d4 tempest-VolumeQuotasAdminTestJSON-1611100790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:40:04 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-fdcb2fd4-a2e0-4c29-9dad-27344f81f1d4 tempest-VolumeQuotasAdminTestJSON-1611100790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:40:04 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-fdcb2fd4-a2e0-4c29-9dad-27344f81f1d4 tempest-VolumeQuotasAdminTestJSON-1611100790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:40:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-fdcb2fd4-a2e0-4c29-9dad-27344f81f1d4 tempest-VolumeQuotasAdminTestJSON-1611100790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:40:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fdcb2fd4-a2e0-4c29-9dad-27344f81f1d4 tempest-VolumeQuotasAdminTestJSON-1611100790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:40:04 devstack sudo[90882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:40:04 devstack sudo[90882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:40:05 devstack sudo[90880]: pam_unix(sudo:session): session closed for user root
Jul 10 12:40:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ff1188d0-207d-4ab1-b6a7-bf7dc0a93f43 tempest-ServerActionsTestOtherA-1596451723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22d1db9a-cea2-41e8-8d05-56498576704c" returned: 0 in 0.897s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:40:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ff1188d0-207d-4ab1-b6a7-bf7dc0a93f43 tempest-ServerActionsTestOtherA-1596451723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22d1db9a-cea2-41e8-8d05-56498576704c {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:40:05 devstack sudo[90891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22d1db9a-cea2-41e8-8d05-56498576704c
Jul 10 12:40:05 devstack sudo[90891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:40:05 devstack sudo[90882]: pam_unix(sudo:session): session closed for user root
Jul 10 12:40:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fdcb2fd4-a2e0-4c29-9dad-27344f81f1d4 tempest-VolumeQuotasAdminTestJSON-1611100790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.764s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:40:05 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-fdcb2fd4-a2e0-4c29-9dad-27344f81f1d4 tempest-VolumeQuotasAdminTestJSON-1611100790 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:40:05 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-fdcb2fd4-a2e0-4c29-9dad-27344f81f1d4 tempest-VolumeQuotasAdminTestJSON-1611100790 None] Deleted volume successfully.
Jul 10 12:40:05 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fdcb2fd4-a2e0-4c29-9dad-27344f81f1d4 tempest-VolumeQuotasAdminTestJSON-1611100790 None] Lock "cinder-9f9a8039-d13c-4ed0-950f-2c08a54aa6f7-delete_volume" released by "delete_volume" :: held 2.711s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:40:05 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-5295375b-d07e-42dc-8673-06229d5e85c7 tempest-VolumeQuotasAdminTestJSON-1611100790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:40:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5295375b-d07e-42dc-8673-06229d5e85c7 tempest-VolumeQuotasAdminTestJSON-1611100790 None] Flow 'volume_create_manager' (9c20e209-6c72-4827-b818-586acfe3a01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:40:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5295375b-d07e-42dc-8673-06229d5e85c7 tempest-VolumeQuotasAdminTestJSON-1611100790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc828f7e-ddcd-45df-bf58-e36dbc63a092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:40:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5295375b-d07e-42dc-8673-06229d5e85c7 tempest-VolumeQuotasAdminTestJSON-1611100790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc828f7e-ddcd-45df-bf58-e36dbc63a092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:40:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1036275800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45525c2a-07df-4267-80ff-f080a99152a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa2cf393e70240ca9604336d03496050',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:40:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:40:06Z,use_quota=True,user_id='f7c3ca5bee8649519c41f67d34ed5014',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:40:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5295375b-d07e-42dc-8673-06229d5e85c7 tempest-VolumeQuotasAdminTestJSON-1611100790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6693fa7b-bdf6-47cd-a764-eac3223774ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:40:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5295375b-d07e-42dc-8673-06229d5e85c7 tempest-VolumeQuotasAdminTestJSON-1611100790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6693fa7b-bdf6-47cd-a764-eac3223774ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:40:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5295375b-d07e-42dc-8673-06229d5e85c7 tempest-VolumeQuotasAdminTestJSON-1611100790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41a81726-e3d6-4cb3-aff5-c55db75a1f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:40:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5295375b-d07e-42dc-8673-06229d5e85c7 tempest-VolumeQuotasAdminTestJSON-1611100790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41a81726-e3d6-4cb3-aff5-c55db75a1f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45525c2a-07df-4267-80ff-f080a99152a1', 'volume_name': 'volume-45525c2a-07df-4267-80ff-f080a99152a1', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:40:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5295375b-d07e-42dc-8673-06229d5e85c7 tempest-VolumeQuotasAdminTestJSON-1611100790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (860c22ab-4255-4b0b-b8f0-ad8a7239e079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:40:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5295375b-d07e-42dc-8673-06229d5e85c7 tempest-VolumeQuotasAdminTestJSON-1611100790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (860c22ab-4255-4b0b-b8f0-ad8a7239e079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:40:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5295375b-d07e-42dc-8673-06229d5e85c7 tempest-VolumeQuotasAdminTestJSON-1611100790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c955a16-1393-4e1b-af87-a9637b2dc24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:40:05 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-5295375b-d07e-42dc-8673-06229d5e85c7 tempest-VolumeQuotasAdminTestJSON-1611100790 None] Volume 45525c2a-07df-4267-80ff-f080a99152a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45525c2a-07df-4267-80ff-f080a99152a1', 'volume_size': 1}
Jul 10 12:40:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5295375b-d07e-42dc-8673-06229d5e85c7 tempest-VolumeQuotasAdminTestJSON-1611100790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:40:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5295375b-d07e-42dc-8673-06229d5e85c7 tempest-VolumeQuotasAdminTestJSON-1611100790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:40:05 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5295375b-d07e-42dc-8673-06229d5e85c7 tempest-VolumeQuotasAdminTestJSON-1611100790 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:40:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1036275800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45525c2a-07df-4267-80ff-f080a99152a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa2cf393e70240ca9604336d03496050',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:40:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:40:06Z,use_quota=True,user_id='f7c3ca5bee8649519c41f67d34ed5014',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:40:05 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-5295375b-d07e-42dc-8673-06229d5e85c7 tempest-VolumeQuotasAdminTestJSON-1611100790 None] Creating volume 45525c2a-07df-4267-80ff-f080a99152a1 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:40:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5295375b-d07e-42dc-8673-06229d5e85c7 tempest-VolumeQuotasAdminTestJSON-1611100790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:40:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5295375b-d07e-42dc-8673-06229d5e85c7 tempest-VolumeQuotasAdminTestJSON-1611100790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:40:05 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5295375b-d07e-42dc-8673-06229d5e85c7 tempest-VolumeQuotasAdminTestJSON-1611100790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:40:05 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5295375b-d07e-42dc-8673-06229d5e85c7 tempest-VolumeQuotasAdminTestJSON-1611100790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:40:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5295375b-d07e-42dc-8673-06229d5e85c7 tempest-VolumeQuotasAdminTestJSON-1611100790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:40:05 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5295375b-d07e-42dc-8673-06229d5e85c7 tempest-VolumeQuotasAdminTestJSON-1611100790 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:40:05 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-5295375b-d07e-42dc-8673-06229d5e85c7 tempest-VolumeQuotasAdminTestJSON-1611100790 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:40:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5295375b-d07e-42dc-8673-06229d5e85c7 tempest-VolumeQuotasAdminTestJSON-1611100790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-45525c2a-07df-4267-80ff-f080a99152a1 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:40:05 devstack sudo[90893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-45525c2a-07df-4267-80ff-f080a99152a1 1073741824
Jul 10 12:40:05 devstack sudo[90893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:40:06 devstack sudo[90891]: pam_unix(sudo:session): session closed for user root
Jul 10 12:40:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ff1188d0-207d-4ab1-b6a7-bf7dc0a93f43 tempest-ServerActionsTestOtherA-1596451723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22d1db9a-cea2-41e8-8d05-56498576704c" returned: 0 in 1.068s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:40:06 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-ff1188d0-207d-4ab1-b6a7-bf7dc0a93f43 tempest-ServerActionsTestOtherA-1596451723 None] Lock "cinder-quobyte-22d1db9a-cea2-41e8-8d05-56498576704c" released by "delete_volume" :: held 2.015s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:40:06 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-ff1188d0-207d-4ab1-b6a7-bf7dc0a93f43 tempest-ServerActionsTestOtherA-1596451723 None] Created reservations ['e2aff39e-72a8-4604-a8a0-751b10716373', '0ddc95c4-d154-47ee-bd4a-09d69d5c972c', '22158639-f63a-4dd5-bd21-2ffc6565fbb1', '5fc384b4-05b1-4aab-be2f-e27c18e2e5cd'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:40:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ff1188d0-207d-4ab1-b6a7-bf7dc0a93f43 tempest-ServerActionsTestOtherA-1596451723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:40:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ff1188d0-207d-4ab1-b6a7-bf7dc0a93f43 tempest-ServerActionsTestOtherA-1596451723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:40:06 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-ff1188d0-207d-4ab1-b6a7-bf7dc0a93f43 tempest-ServerActionsTestOtherA-1596451723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:40:06 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-ff1188d0-207d-4ab1-b6a7-bf7dc0a93f43 tempest-ServerActionsTestOtherA-1596451723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:40:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ff1188d0-207d-4ab1-b6a7-bf7dc0a93f43 tempest-ServerActionsTestOtherA-1596451723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:40:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ff1188d0-207d-4ab1-b6a7-bf7dc0a93f43 tempest-ServerActionsTestOtherA-1596451723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:40:06 devstack sudo[90901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:40:06 devstack sudo[90901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:40:07 devstack sudo[90893]: pam_unix(sudo:session): session closed for user root
Jul 10 12:40:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5295375b-d07e-42dc-8673-06229d5e85c7 tempest-VolumeQuotasAdminTestJSON-1611100790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-45525c2a-07df-4267-80ff-f080a99152a1 1073741824" returned: 0 in 1.145s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:40:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5295375b-d07e-42dc-8673-06229d5e85c7 tempest-VolumeQuotasAdminTestJSON-1611100790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-45525c2a-07df-4267-80ff-f080a99152a1 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:40:07 devstack sudo[90905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-45525c2a-07df-4267-80ff-f080a99152a1
Jul 10 12:40:07 devstack sudo[90905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:40:07 devstack sudo[90901]: pam_unix(sudo:session): session closed for user root
Jul 10 12:40:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ff1188d0-207d-4ab1-b6a7-bf7dc0a93f43 tempest-ServerActionsTestOtherA-1596451723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.821s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:40:07 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-ff1188d0-207d-4ab1-b6a7-bf7dc0a93f43 tempest-ServerActionsTestOtherA-1596451723 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:40:07 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-ff1188d0-207d-4ab1-b6a7-bf7dc0a93f43 tempest-ServerActionsTestOtherA-1596451723 None] Deleted volume successfully.
Jul 10 12:40:07 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-ff1188d0-207d-4ab1-b6a7-bf7dc0a93f43 tempest-ServerActionsTestOtherA-1596451723 None] Lock "cinder-22d1db9a-cea2-41e8-8d05-56498576704c-delete_volume" released by "delete_volume" :: held 3.121s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:40:07 devstack sudo[90905]: pam_unix(sudo:session): session closed for user root
Jul 10 12:40:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5295375b-d07e-42dc-8673-06229d5e85c7 tempest-VolumeQuotasAdminTestJSON-1611100790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-45525c2a-07df-4267-80ff-f080a99152a1" returned: 0 in 0.730s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:40:07 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5295375b-d07e-42dc-8673-06229d5e85c7 tempest-VolumeQuotasAdminTestJSON-1611100790 None] <== create_volume: return (1942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:40:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5295375b-d07e-42dc-8673-06229d5e85c7 tempest-VolumeQuotasAdminTestJSON-1611100790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.947s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:40:07 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5295375b-d07e-42dc-8673-06229d5e85c7 tempest-VolumeQuotasAdminTestJSON-1611100790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c955a16-1393-4e1b-af87-a9637b2dc24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45525c2a-07df-4267-80ff-f080a99152a1', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:40:07 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5295375b-d07e-42dc-8673-06229d5e85c7 tempest-VolumeQuotasAdminTestJSON-1611100790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a30035b1-00aa-498d-b1b2-77598d184da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:40:07 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-5295375b-d07e-42dc-8673-06229d5e85c7 tempest-VolumeQuotasAdminTestJSON-1611100790 None] Volume volume-45525c2a-07df-4267-80ff-f080a99152a1 (45525c2a-07df-4267-80ff-f080a99152a1): created successfully
Jul 10 12:40:07 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5295375b-d07e-42dc-8673-06229d5e85c7 tempest-VolumeQuotasAdminTestJSON-1611100790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a30035b1-00aa-498d-b1b2-77598d184da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:40:07 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5295375b-d07e-42dc-8673-06229d5e85c7 tempest-VolumeQuotasAdminTestJSON-1611100790 None] Flow 'volume_create_manager' (9c20e209-6c72-4827-b818-586acfe3a01d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:40:07 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-5295375b-d07e-42dc-8673-06229d5e85c7 tempest-VolumeQuotasAdminTestJSON-1611100790 None] Created volume successfully.
Jul 10 12:40:09 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-488276a5-a226-443d-a911-c0c05324ad3b tempest-VolumeQuotasAdminTestJSON-1090198050 None] Transfer volume completed successfully.
Jul 10 12:40:10 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-605b9df5-2c6e-4226-b79b-33b32510f111 tempest-VolumeQuotasAdminTestJSON-1981710393 None] Acquiring lock "cinder-45525c2a-07df-4267-80ff-f080a99152a1-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:40:10 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-605b9df5-2c6e-4226-b79b-33b32510f111 tempest-VolumeQuotasAdminTestJSON-1981710393 None] Lock "cinder-45525c2a-07df-4267-80ff-f080a99152a1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:40:10 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-605b9df5-2c6e-4226-b79b-33b32510f111 tempest-VolumeQuotasAdminTestJSON-1981710393 None] Acquiring lock "cinder-quobyte-45525c2a-07df-4267-80ff-f080a99152a1" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:40:10 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-605b9df5-2c6e-4226-b79b-33b32510f111 tempest-VolumeQuotasAdminTestJSON-1981710393 None] Lock "cinder-quobyte-45525c2a-07df-4267-80ff-f080a99152a1" acquired by "delete_volume" :: waited 0.023s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:40:11 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c951be70-83ff-4ca1-925e-b2fc06599fcf]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:40:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-605b9df5-2c6e-4226-b79b-33b32510f111 tempest-VolumeQuotasAdminTestJSON-1981710393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-45525c2a-07df-4267-80ff-f080a99152a1 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:40:11 devstack sudo[90934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-45525c2a-07df-4267-80ff-f080a99152a1
Jul 10 12:40:11 devstack sudo[90934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:40:12 devstack sudo[90934]: pam_unix(sudo:session): session closed for user root
Jul 10 12:40:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-605b9df5-2c6e-4226-b79b-33b32510f111 tempest-VolumeQuotasAdminTestJSON-1981710393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-45525c2a-07df-4267-80ff-f080a99152a1" returned: 0 in 1.006s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:40:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-605b9df5-2c6e-4226-b79b-33b32510f111 tempest-VolumeQuotasAdminTestJSON-1981710393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-45525c2a-07df-4267-80ff-f080a99152a1 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:40:12 devstack sudo[90940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-45525c2a-07df-4267-80ff-f080a99152a1
Jul 10 12:40:12 devstack sudo[90940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:40:12 devstack sudo[90940]: pam_unix(sudo:session): session closed for user root
Jul 10 12:40:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-605b9df5-2c6e-4226-b79b-33b32510f111 tempest-VolumeQuotasAdminTestJSON-1981710393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-45525c2a-07df-4267-80ff-f080a99152a1" returned: 0 in 0.829s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:40:12 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-605b9df5-2c6e-4226-b79b-33b32510f111 tempest-VolumeQuotasAdminTestJSON-1981710393 None] Lock "cinder-quobyte-45525c2a-07df-4267-80ff-f080a99152a1" released by "delete_volume" :: held 1.886s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:40:12 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:40:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:40:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:40:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:40:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:40:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:40:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:40:12 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-605b9df5-2c6e-4226-b79b-33b32510f111 tempest-VolumeQuotasAdminTestJSON-1981710393 None] Created reservations ['1bbe3b99-9ec9-4bdf-8767-ba66addabe78', 'e668c190-113e-472a-9a33-49cbbcd969a8', '3fba24cb-0c89-4838-8756-01ccaa81bcf9', '52a5c62e-bae6-4c5a-9396-0044b419a741'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:40:12 devstack sudo[90944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:40:12 devstack sudo[90944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:40:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-605b9df5-2c6e-4226-b79b-33b32510f111 tempest-VolumeQuotasAdminTestJSON-1981710393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:40:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-605b9df5-2c6e-4226-b79b-33b32510f111 tempest-VolumeQuotasAdminTestJSON-1981710393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:40:13 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-605b9df5-2c6e-4226-b79b-33b32510f111 tempest-VolumeQuotasAdminTestJSON-1981710393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:40:13 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-605b9df5-2c6e-4226-b79b-33b32510f111 tempest-VolumeQuotasAdminTestJSON-1981710393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:40:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-605b9df5-2c6e-4226-b79b-33b32510f111 tempest-VolumeQuotasAdminTestJSON-1981710393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:40:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-605b9df5-2c6e-4226-b79b-33b32510f111 tempest-VolumeQuotasAdminTestJSON-1981710393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:40:13 devstack sudo[90947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:40:13 devstack sudo[90947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:40:13 devstack sudo[90944]: pam_unix(sudo:session): session closed for user root
Jul 10 12:40:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.800s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:40:13 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:40:13 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager._thread_info {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:40:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread count: 8 {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 10 12:40:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread info: [<_MainThread(MainThread, started 128233544536192)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128233445424704)>, <Thread(Thread-3 (stat_writer), started daemon 128233435118528)>, <Thread(Rabbit-heartbeat, started daemon 128233435718016)>, <Thread(Thread-5 (_runner), started daemon 128233432624448)>, <Thread(Thread-7 (_runner), started daemon 128233432674688)>, <Thread(fd_logger, started daemon 128233428569472)>, <Thread(privsep_reader, started daemon 128233429417088)>] {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 10 12:40:14 devstack sudo[90947]: pam_unix(sudo:session): session closed for user root
Jul 10 12:40:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-605b9df5-2c6e-4226-b79b-33b32510f111 tempest-VolumeQuotasAdminTestJSON-1981710393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 1.086s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:40:14 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-605b9df5-2c6e-4226-b79b-33b32510f111 tempest-VolumeQuotasAdminTestJSON-1981710393 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:40:14 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-605b9df5-2c6e-4226-b79b-33b32510f111 tempest-VolumeQuotasAdminTestJSON-1981710393 None] Deleted volume successfully.
Jul 10 12:40:14 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-605b9df5-2c6e-4226-b79b-33b32510f111 tempest-VolumeQuotasAdminTestJSON-1981710393 None] Lock "cinder-45525c2a-07df-4267-80ff-f080a99152a1-delete_volume" released by "delete_volume" :: held 3.325s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:40:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-d061cac6-7b68-4ead-a46f-acd63c3ba6a2 req-f5a81d7c-2ce0-4e26-a14c-332c361df9b7 tempest-TaggedAttachmentsTest-1503143233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:40:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-d061cac6-7b68-4ead-a46f-acd63c3ba6a2 req-f5a81d7c-2ce0-4e26-a14c-332c361df9b7 tempest-TaggedAttachmentsTest-1503143233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:40:22 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21bf9fa-9a6c-458f-9632-95a20af6da03]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:40:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-d061cac6-7b68-4ead-a46f-acd63c3ba6a2 req-f5a81d7c-2ce0-4e26-a14c-332c361df9b7 tempest-TaggedAttachmentsTest-1503143233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe46955e-3331-4ce5-8000-7964d0d129eb {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:40:22 devstack sudo[91061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe46955e-3331-4ce5-8000-7964d0d129eb
Jul 10 12:40:22 devstack sudo[91061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:40:22 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4ad2ec5-b27e-450d-a9d7-10cb132120dc tempest-VolumesServicesTestJSON-9570427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:40:22 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c4ad2ec5-b27e-450d-a9d7-10cb132120dc tempest-VolumesServicesTestJSON-9570427 None] Flow 'volume_create_manager' (b2664e12-c165-4cd0-8b8b-d46926fcc790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:40:22 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c4ad2ec5-b27e-450d-a9d7-10cb132120dc tempest-VolumesServicesTestJSON-9570427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44e23af9-916c-4aa5-b28c-fcaf304fc631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:40:22 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c4ad2ec5-b27e-450d-a9d7-10cb132120dc tempest-VolumesServicesTestJSON-9570427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44e23af9-916c-4aa5-b28c-fcaf304fc631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:40:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-999698955',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01837e2f-9881-445f-928b-9fcb297ac852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='274ade617e8f464299c3e949c9e0dccf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:40:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:40:23Z,use_quota=True,user_id='923070b8ebac4d1da58d677e5574c57c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:40:22 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c4ad2ec5-b27e-450d-a9d7-10cb132120dc tempest-VolumesServicesTestJSON-9570427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ca402be-e746-4f6a-9a28-b467da302c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:40:22 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c4ad2ec5-b27e-450d-a9d7-10cb132120dc tempest-VolumesServicesTestJSON-9570427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ca402be-e746-4f6a-9a28-b467da302c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:40:22 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c4ad2ec5-b27e-450d-a9d7-10cb132120dc tempest-VolumesServicesTestJSON-9570427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54fd57d6-d9f5-448c-866f-9705b13dd97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:40:22 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c4ad2ec5-b27e-450d-a9d7-10cb132120dc tempest-VolumesServicesTestJSON-9570427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54fd57d6-d9f5-448c-866f-9705b13dd97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01837e2f-9881-445f-928b-9fcb297ac852', 'volume_name': 'volume-01837e2f-9881-445f-928b-9fcb297ac852', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:40:22 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c4ad2ec5-b27e-450d-a9d7-10cb132120dc tempest-VolumesServicesTestJSON-9570427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bf9fca4-4625-4ce1-9db2-d4e81bf20e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:40:22 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c4ad2ec5-b27e-450d-a9d7-10cb132120dc tempest-VolumesServicesTestJSON-9570427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bf9fca4-4625-4ce1-9db2-d4e81bf20e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:40:22 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c4ad2ec5-b27e-450d-a9d7-10cb132120dc tempest-VolumesServicesTestJSON-9570427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1487b107-1c0f-4fd5-bfac-1d48bf6cad89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:40:22 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-c4ad2ec5-b27e-450d-a9d7-10cb132120dc tempest-VolumesServicesTestJSON-9570427 None] Volume 01837e2f-9881-445f-928b-9fcb297ac852: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01837e2f-9881-445f-928b-9fcb297ac852', 'volume_size': 1}
Jul 10 12:40:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c4ad2ec5-b27e-450d-a9d7-10cb132120dc tempest-VolumesServicesTestJSON-9570427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:40:23 devstack sudo[91061]: pam_unix(sudo:session): session closed for user root
Jul 10 12:40:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-d061cac6-7b68-4ead-a46f-acd63c3ba6a2 req-f5a81d7c-2ce0-4e26-a14c-332c361df9b7 tempest-TaggedAttachmentsTest-1503143233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe46955e-3331-4ce5-8000-7964d0d129eb" returned: 0 in 1.063s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:40:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-d061cac6-7b68-4ead-a46f-acd63c3ba6a2 req-f5a81d7c-2ce0-4e26-a14c-332c361df9b7 tempest-TaggedAttachmentsTest-1503143233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.082s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:40:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c4ad2ec5-b27e-450d-a9d7-10cb132120dc tempest-VolumesServicesTestJSON-9570427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.540s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:40:23 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-c4ad2ec5-b27e-450d-a9d7-10cb132120dc tempest-VolumesServicesTestJSON-9570427 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:40:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-999698955',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01837e2f-9881-445f-928b-9fcb297ac852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='274ade617e8f464299c3e949c9e0dccf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:40:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:40:23Z,use_quota=True,user_id='923070b8ebac4d1da58d677e5574c57c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:40:23 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-c4ad2ec5-b27e-450d-a9d7-10cb132120dc tempest-VolumesServicesTestJSON-9570427 None] Creating volume 01837e2f-9881-445f-928b-9fcb297ac852 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:40:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c4ad2ec5-b27e-450d-a9d7-10cb132120dc tempest-VolumesServicesTestJSON-9570427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:40:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c4ad2ec5-b27e-450d-a9d7-10cb132120dc tempest-VolumesServicesTestJSON-9570427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:40:23 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-c4ad2ec5-b27e-450d-a9d7-10cb132120dc tempest-VolumesServicesTestJSON-9570427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:40:23 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-c4ad2ec5-b27e-450d-a9d7-10cb132120dc tempest-VolumesServicesTestJSON-9570427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:40:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c4ad2ec5-b27e-450d-a9d7-10cb132120dc tempest-VolumesServicesTestJSON-9570427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:40:23 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-c4ad2ec5-b27e-450d-a9d7-10cb132120dc tempest-VolumesServicesTestJSON-9570427 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:40:23 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-c4ad2ec5-b27e-450d-a9d7-10cb132120dc tempest-VolumesServicesTestJSON-9570427 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:40:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c4ad2ec5-b27e-450d-a9d7-10cb132120dc tempest-VolumesServicesTestJSON-9570427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-01837e2f-9881-445f-928b-9fcb297ac852 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:40:23 devstack sudo[91069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-01837e2f-9881-445f-928b-9fcb297ac852 1073741824
Jul 10 12:40:23 devstack sudo[91069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:40:23 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-d061cac6-7b68-4ead-a46f-acd63c3ba6a2 req-f5a81d7c-2ce0-4e26-a14c-332c361df9b7 tempest-TaggedAttachmentsTest-1503143233 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be', 'name': 'volume-fe46955e-3331-4ce5-8000-7964d0d129eb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6d050240-6847-4a4b-9c96-4b3dfc58bca0', 'enforce_multipath': True} {{(pid=87378) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 10 12:40:23 devstack cinder-volume[87378]: INFO cinder.volume.manager [req-d061cac6-7b68-4ead-a46f-acd63c3ba6a2 req-f5a81d7c-2ce0-4e26-a14c-332c361df9b7 tempest-TaggedAttachmentsTest-1503143233 None] attachment_update completed successfully.
Jul 10 12:40:24 devstack sudo[91069]: pam_unix(sudo:session): session closed for user root
Jul 10 12:40:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c4ad2ec5-b27e-450d-a9d7-10cb132120dc tempest-VolumesServicesTestJSON-9570427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-01837e2f-9881-445f-928b-9fcb297ac852 1073741824" returned: 0 in 1.323s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:40:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c4ad2ec5-b27e-450d-a9d7-10cb132120dc tempest-VolumesServicesTestJSON-9570427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-01837e2f-9881-445f-928b-9fcb297ac852 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:40:24 devstack sudo[91474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-01837e2f-9881-445f-928b-9fcb297ac852
Jul 10 12:40:24 devstack sudo[91474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:40:25 devstack sudo[91474]: pam_unix(sudo:session): session closed for user root
Jul 10 12:40:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c4ad2ec5-b27e-450d-a9d7-10cb132120dc tempest-VolumesServicesTestJSON-9570427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-01837e2f-9881-445f-928b-9fcb297ac852" returned: 0 in 0.775s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:40:25 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-c4ad2ec5-b27e-450d-a9d7-10cb132120dc tempest-VolumesServicesTestJSON-9570427 None] <== create_volume: return (2173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:40:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c4ad2ec5-b27e-450d-a9d7-10cb132120dc tempest-VolumesServicesTestJSON-9570427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.178s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:40:25 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c4ad2ec5-b27e-450d-a9d7-10cb132120dc tempest-VolumesServicesTestJSON-9570427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1487b107-1c0f-4fd5-bfac-1d48bf6cad89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01837e2f-9881-445f-928b-9fcb297ac852', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:40:25 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c4ad2ec5-b27e-450d-a9d7-10cb132120dc tempest-VolumesServicesTestJSON-9570427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f07c3fa-cfcd-4ae3-8529-44a75de38bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:40:25 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-c4ad2ec5-b27e-450d-a9d7-10cb132120dc tempest-VolumesServicesTestJSON-9570427 None] Volume volume-01837e2f-9881-445f-928b-9fcb297ac852 (01837e2f-9881-445f-928b-9fcb297ac852): created successfully
Jul 10 12:40:25 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c4ad2ec5-b27e-450d-a9d7-10cb132120dc tempest-VolumesServicesTestJSON-9570427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f07c3fa-cfcd-4ae3-8529-44a75de38bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:40:25 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c4ad2ec5-b27e-450d-a9d7-10cb132120dc tempest-VolumesServicesTestJSON-9570427 None] Flow 'volume_create_manager' (b2664e12-c165-4cd0-8b8b-d46926fcc790) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:40:25 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-c4ad2ec5-b27e-450d-a9d7-10cb132120dc tempest-VolumesServicesTestJSON-9570427 None] Created volume successfully.
Jul 10 12:40:26 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-4bbab63c-0b9e-4638-8279-17c65d9e5e90 tempest-VolumesServicesTestJSON-9570427 None] Acquiring lock "cinder-01837e2f-9881-445f-928b-9fcb297ac852-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:40:26 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-4bbab63c-0b9e-4638-8279-17c65d9e5e90 tempest-VolumesServicesTestJSON-9570427 None] Lock "cinder-01837e2f-9881-445f-928b-9fcb297ac852-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:40:26 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-4bbab63c-0b9e-4638-8279-17c65d9e5e90 tempest-VolumesServicesTestJSON-9570427 None] Acquiring lock "cinder-quobyte-01837e2f-9881-445f-928b-9fcb297ac852" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:40:26 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-4bbab63c-0b9e-4638-8279-17c65d9e5e90 tempest-VolumesServicesTestJSON-9570427 None] Lock "cinder-quobyte-01837e2f-9881-445f-928b-9fcb297ac852" acquired by "delete_volume" :: waited 0.015s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:40:26 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[321dc0b5-1306-4274-81a9-bcffffcef7c5]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:40:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4bbab63c-0b9e-4638-8279-17c65d9e5e90 tempest-VolumesServicesTestJSON-9570427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-01837e2f-9881-445f-928b-9fcb297ac852 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:40:26 devstack sudo[91485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-01837e2f-9881-445f-928b-9fcb297ac852
Jul 10 12:40:26 devstack sudo[91485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:40:27 devstack sudo[91485]: pam_unix(sudo:session): session closed for user root
Jul 10 12:40:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4bbab63c-0b9e-4638-8279-17c65d9e5e90 tempest-VolumesServicesTestJSON-9570427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-01837e2f-9881-445f-928b-9fcb297ac852" returned: 0 in 0.864s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:40:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4bbab63c-0b9e-4638-8279-17c65d9e5e90 tempest-VolumesServicesTestJSON-9570427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-01837e2f-9881-445f-928b-9fcb297ac852 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:40:27 devstack sudo[91490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-01837e2f-9881-445f-928b-9fcb297ac852
Jul 10 12:40:27 devstack sudo[91490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:40:27 devstack sudo[91490]: pam_unix(sudo:session): session closed for user root
Jul 10 12:40:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4bbab63c-0b9e-4638-8279-17c65d9e5e90 tempest-VolumesServicesTestJSON-9570427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-01837e2f-9881-445f-928b-9fcb297ac852" returned: 0 in 0.747s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:40:27 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-4bbab63c-0b9e-4638-8279-17c65d9e5e90 tempest-VolumesServicesTestJSON-9570427 None] Lock "cinder-quobyte-01837e2f-9881-445f-928b-9fcb297ac852" released by "delete_volume" :: held 1.654s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:40:27 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-4bbab63c-0b9e-4638-8279-17c65d9e5e90 tempest-VolumesServicesTestJSON-9570427 None] Created reservations ['00940259-c899-4bc7-a1e6-47e62dfa22aa', '8067cfc9-ff41-411f-8e1e-c29d2641e703', '8d0dee4d-e837-4a19-ac78-35a25f1a9ff8', 'd816e633-e986-4f68-bb1d-df24bab734e1'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:40:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-4bbab63c-0b9e-4638-8279-17c65d9e5e90 tempest-VolumesServicesTestJSON-9570427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:40:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-4bbab63c-0b9e-4638-8279-17c65d9e5e90 tempest-VolumesServicesTestJSON-9570427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:40:27 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-4bbab63c-0b9e-4638-8279-17c65d9e5e90 tempest-VolumesServicesTestJSON-9570427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:40:27 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-4bbab63c-0b9e-4638-8279-17c65d9e5e90 tempest-VolumesServicesTestJSON-9570427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:40:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-4bbab63c-0b9e-4638-8279-17c65d9e5e90 tempest-VolumesServicesTestJSON-9570427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:40:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4bbab63c-0b9e-4638-8279-17c65d9e5e90 tempest-VolumesServicesTestJSON-9570427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:40:28 devstack sudo[91493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:40:28 devstack sudo[91493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:40:28 devstack sudo[91493]: pam_unix(sudo:session): session closed for user root
Jul 10 12:40:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4bbab63c-0b9e-4638-8279-17c65d9e5e90 tempest-VolumesServicesTestJSON-9570427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.836s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:40:28 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-4bbab63c-0b9e-4638-8279-17c65d9e5e90 tempest-VolumesServicesTestJSON-9570427 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:40:28 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-4bbab63c-0b9e-4638-8279-17c65d9e5e90 tempest-VolumesServicesTestJSON-9570427 None] Deleted volume successfully.
Jul 10 12:40:28 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-4bbab63c-0b9e-4638-8279-17c65d9e5e90 tempest-VolumesServicesTestJSON-9570427 None] Lock "cinder-01837e2f-9881-445f-928b-9fcb297ac852-delete_volume" released by "delete_volume" :: held 2.733s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:40:31 devstack cinder-volume[87378]: INFO cinder.volume.manager [req-8e42ddbb-d2e2-492e-89c8-8dbe6d621705 req-cfb49883-bbaa-4191-8c57-85c2d69e955e tempest-TaggedAttachmentsTest-1503143233 None] Terminate volume connection completed successfully.
Jul 10 12:40:31 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-8e42ddbb-d2e2-492e-89c8-8dbe6d621705 req-cfb49883-bbaa-4191-8c57-85c2d69e955e tempest-TaggedAttachmentsTest-1503143233 None] Deleting attachment 6d050240-6847-4a4b-9c96-4b3dfc58bca0. {{(pid=87378) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 10 12:40:41 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:UPDATE=48,cinder:SELECT=29,cinder:INSERT=10,cinder:DELETE=2 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:40:41 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:SELECT=38,cinder:UPDATE=38,cinder:DELETE=5,cinder:INSERT=9 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:40:54 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-92672ae8-f862-4286-97b8-32a328b15ff7 tempest-AttachVolumeShelveTestJSON-943029956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:40:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-92672ae8-f862-4286-97b8-32a328b15ff7 tempest-AttachVolumeShelveTestJSON-943029956 None] Flow 'volume_create_manager' (7342abec-7ae8-4e23-b1d7-7a3adbe949c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:40:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-92672ae8-f862-4286-97b8-32a328b15ff7 tempest-AttachVolumeShelveTestJSON-943029956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5f8652a-1c70-4835-a37f-6f3ea81aaf94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:40:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-92672ae8-f862-4286-97b8-32a328b15ff7 tempest-AttachVolumeShelveTestJSON-943029956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5f8652a-1c70-4835-a37f-6f3ea81aaf94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:40:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-837027892',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f010746-ac44-42c1-9e5d-a4065cb0b2df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8243f87b70c34865b9741b233324f9a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:40:55Z,use_quota=True,user_id='62fee4a970f940c5a9b2087888e0ebf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:40:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-92672ae8-f862-4286-97b8-32a328b15ff7 tempest-AttachVolumeShelveTestJSON-943029956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e702d8dd-1f29-41db-a8f5-6f6406fab316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:40:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-92672ae8-f862-4286-97b8-32a328b15ff7 tempest-AttachVolumeShelveTestJSON-943029956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e702d8dd-1f29-41db-a8f5-6f6406fab316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:40:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-92672ae8-f862-4286-97b8-32a328b15ff7 tempest-AttachVolumeShelveTestJSON-943029956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5a938e6-e88d-45d9-acf0-14a37ffb5ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:40:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-92672ae8-f862-4286-97b8-32a328b15ff7 tempest-AttachVolumeShelveTestJSON-943029956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5a938e6-e88d-45d9-acf0-14a37ffb5ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f010746-ac44-42c1-9e5d-a4065cb0b2df', 'volume_name': 'volume-4f010746-ac44-42c1-9e5d-a4065cb0b2df', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:40:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-92672ae8-f862-4286-97b8-32a328b15ff7 tempest-AttachVolumeShelveTestJSON-943029956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1ba1e0d-42bb-4b7f-8c54-e95f569119a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:40:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-92672ae8-f862-4286-97b8-32a328b15ff7 tempest-AttachVolumeShelveTestJSON-943029956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1ba1e0d-42bb-4b7f-8c54-e95f569119a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:40:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-92672ae8-f862-4286-97b8-32a328b15ff7 tempest-AttachVolumeShelveTestJSON-943029956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0804eb14-bd3c-433b-aef8-685aedf5cc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:40:54 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-92672ae8-f862-4286-97b8-32a328b15ff7 tempest-AttachVolumeShelveTestJSON-943029956 None] Volume 4f010746-ac44-42c1-9e5d-a4065cb0b2df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f010746-ac44-42c1-9e5d-a4065cb0b2df', 'volume_size': 1}
Jul 10 12:40:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-92672ae8-f862-4286-97b8-32a328b15ff7 tempest-AttachVolumeShelveTestJSON-943029956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:40:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-92672ae8-f862-4286-97b8-32a328b15ff7 tempest-AttachVolumeShelveTestJSON-943029956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:40:54 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-92672ae8-f862-4286-97b8-32a328b15ff7 tempest-AttachVolumeShelveTestJSON-943029956 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:40:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-837027892',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f010746-ac44-42c1-9e5d-a4065cb0b2df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8243f87b70c34865b9741b233324f9a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:40:55Z,use_quota=True,user_id='62fee4a970f940c5a9b2087888e0ebf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:40:54 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-92672ae8-f862-4286-97b8-32a328b15ff7 tempest-AttachVolumeShelveTestJSON-943029956 None] Creating volume 4f010746-ac44-42c1-9e5d-a4065cb0b2df {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:40:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-92672ae8-f862-4286-97b8-32a328b15ff7 tempest-AttachVolumeShelveTestJSON-943029956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:40:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-92672ae8-f862-4286-97b8-32a328b15ff7 tempest-AttachVolumeShelveTestJSON-943029956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:40:54 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-92672ae8-f862-4286-97b8-32a328b15ff7 tempest-AttachVolumeShelveTestJSON-943029956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:40:54 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-92672ae8-f862-4286-97b8-32a328b15ff7 tempest-AttachVolumeShelveTestJSON-943029956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:40:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-92672ae8-f862-4286-97b8-32a328b15ff7 tempest-AttachVolumeShelveTestJSON-943029956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:40:54 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-92672ae8-f862-4286-97b8-32a328b15ff7 tempest-AttachVolumeShelveTestJSON-943029956 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:40:54 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-92672ae8-f862-4286-97b8-32a328b15ff7 tempest-AttachVolumeShelveTestJSON-943029956 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:40:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-92672ae8-f862-4286-97b8-32a328b15ff7 tempest-AttachVolumeShelveTestJSON-943029956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4f010746-ac44-42c1-9e5d-a4065cb0b2df 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:40:54 devstack sudo[91785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4f010746-ac44-42c1-9e5d-a4065cb0b2df 1073741824
Jul 10 12:40:54 devstack sudo[91785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:40:56 devstack sudo[91785]: pam_unix(sudo:session): session closed for user root
Jul 10 12:40:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-92672ae8-f862-4286-97b8-32a328b15ff7 tempest-AttachVolumeShelveTestJSON-943029956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4f010746-ac44-42c1-9e5d-a4065cb0b2df 1073741824" returned: 0 in 1.182s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:40:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-92672ae8-f862-4286-97b8-32a328b15ff7 tempest-AttachVolumeShelveTestJSON-943029956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4f010746-ac44-42c1-9e5d-a4065cb0b2df {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:40:56 devstack sudo[91813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4f010746-ac44-42c1-9e5d-a4065cb0b2df
Jul 10 12:40:56 devstack sudo[91813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:40:57 devstack sudo[91813]: pam_unix(sudo:session): session closed for user root
Jul 10 12:40:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-92672ae8-f862-4286-97b8-32a328b15ff7 tempest-AttachVolumeShelveTestJSON-943029956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4f010746-ac44-42c1-9e5d-a4065cb0b2df" returned: 0 in 1.263s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:40:57 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-92672ae8-f862-4286-97b8-32a328b15ff7 tempest-AttachVolumeShelveTestJSON-943029956 None] <== create_volume: return (2526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:40:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-92672ae8-f862-4286-97b8-32a328b15ff7 tempest-AttachVolumeShelveTestJSON-943029956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.531s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:40:57 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-92672ae8-f862-4286-97b8-32a328b15ff7 tempest-AttachVolumeShelveTestJSON-943029956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0804eb14-bd3c-433b-aef8-685aedf5cc7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f010746-ac44-42c1-9e5d-a4065cb0b2df', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:40:57 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-92672ae8-f862-4286-97b8-32a328b15ff7 tempest-AttachVolumeShelveTestJSON-943029956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbb7b3df-cd65-47b2-b2f7-4014dccdb307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:40:57 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-92672ae8-f862-4286-97b8-32a328b15ff7 tempest-AttachVolumeShelveTestJSON-943029956 None] Volume volume-4f010746-ac44-42c1-9e5d-a4065cb0b2df (4f010746-ac44-42c1-9e5d-a4065cb0b2df): created successfully
Jul 10 12:40:57 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-92672ae8-f862-4286-97b8-32a328b15ff7 tempest-AttachVolumeShelveTestJSON-943029956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbb7b3df-cd65-47b2-b2f7-4014dccdb307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:40:57 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-92672ae8-f862-4286-97b8-32a328b15ff7 tempest-AttachVolumeShelveTestJSON-943029956 None] Flow 'volume_create_manager' (7342abec-7ae8-4e23-b1d7-7a3adbe949c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:40:57 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-92672ae8-f862-4286-97b8-32a328b15ff7 tempest-AttachVolumeShelveTestJSON-943029956 None] Created volume successfully.
Jul 10 12:40:59 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9d3b6de4-dfb9-463e-a7bb-90c7db7287be tempest-TaggedAttachmentsTest-1503143233 None] Acquiring lock "cinder-fe46955e-3331-4ce5-8000-7964d0d129eb-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:40:59 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9d3b6de4-dfb9-463e-a7bb-90c7db7287be tempest-TaggedAttachmentsTest-1503143233 None] Lock "cinder-fe46955e-3331-4ce5-8000-7964d0d129eb-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:41:00 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9d3b6de4-dfb9-463e-a7bb-90c7db7287be tempest-TaggedAttachmentsTest-1503143233 None] Acquiring lock "cinder-quobyte-fe46955e-3331-4ce5-8000-7964d0d129eb" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:41:00 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9d3b6de4-dfb9-463e-a7bb-90c7db7287be tempest-TaggedAttachmentsTest-1503143233 None] Lock "cinder-quobyte-fe46955e-3331-4ce5-8000-7964d0d129eb" acquired by "delete_volume" :: waited 0.055s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:41:00 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67e82d9-2755-4a68-a80a-337525f28fa7]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:41:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9d3b6de4-dfb9-463e-a7bb-90c7db7287be tempest-TaggedAttachmentsTest-1503143233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe46955e-3331-4ce5-8000-7964d0d129eb {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:41:00 devstack sudo[91828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe46955e-3331-4ce5-8000-7964d0d129eb
Jul 10 12:41:00 devstack sudo[91828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:41:01 devstack sudo[91828]: pam_unix(sudo:session): session closed for user root
Jul 10 12:41:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9d3b6de4-dfb9-463e-a7bb-90c7db7287be tempest-TaggedAttachmentsTest-1503143233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe46955e-3331-4ce5-8000-7964d0d129eb" returned: 0 in 1.190s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:41:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9d3b6de4-dfb9-463e-a7bb-90c7db7287be tempest-TaggedAttachmentsTest-1503143233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe46955e-3331-4ce5-8000-7964d0d129eb {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:41:01 devstack sudo[91835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe46955e-3331-4ce5-8000-7964d0d129eb
Jul 10 12:41:01 devstack sudo[91835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:41:02 devstack sudo[91835]: pam_unix(sudo:session): session closed for user root
Jul 10 12:41:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9d3b6de4-dfb9-463e-a7bb-90c7db7287be tempest-TaggedAttachmentsTest-1503143233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe46955e-3331-4ce5-8000-7964d0d129eb" returned: 0 in 1.682s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:41:02 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9d3b6de4-dfb9-463e-a7bb-90c7db7287be tempest-TaggedAttachmentsTest-1503143233 None] Lock "cinder-quobyte-fe46955e-3331-4ce5-8000-7964d0d129eb" released by "delete_volume" :: held 2.937s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:41:03 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-9d3b6de4-dfb9-463e-a7bb-90c7db7287be tempest-TaggedAttachmentsTest-1503143233 None] Created reservations ['2cd18b33-698d-4451-99bd-3d3e6e0b17d3', 'ba9d9301-17f1-4dc5-a885-adb4dd22e66a', 'b4eea01c-0788-4281-a869-3654d0f41915', 'e0e7dfa5-c2b6-46d9-b039-82f11ac8039c'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:41:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-9d3b6de4-dfb9-463e-a7bb-90c7db7287be tempest-TaggedAttachmentsTest-1503143233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:41:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-9d3b6de4-dfb9-463e-a7bb-90c7db7287be tempest-TaggedAttachmentsTest-1503143233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:41:03 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-9d3b6de4-dfb9-463e-a7bb-90c7db7287be tempest-TaggedAttachmentsTest-1503143233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:41:03 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-9d3b6de4-dfb9-463e-a7bb-90c7db7287be tempest-TaggedAttachmentsTest-1503143233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:41:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-9d3b6de4-dfb9-463e-a7bb-90c7db7287be tempest-TaggedAttachmentsTest-1503143233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:41:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9d3b6de4-dfb9-463e-a7bb-90c7db7287be tempest-TaggedAttachmentsTest-1503143233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:41:03 devstack sudo[91872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:41:03 devstack sudo[91872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:41:04 devstack sudo[91872]: pam_unix(sudo:session): session closed for user root
Jul 10 12:41:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9d3b6de4-dfb9-463e-a7bb-90c7db7287be tempest-TaggedAttachmentsTest-1503143233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 1.384s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:41:04 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-9d3b6de4-dfb9-463e-a7bb-90c7db7287be tempest-TaggedAttachmentsTest-1503143233 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:41:04 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-9d3b6de4-dfb9-463e-a7bb-90c7db7287be tempest-TaggedAttachmentsTest-1503143233 None] Deleted volume successfully.
Jul 10 12:41:04 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9d3b6de4-dfb9-463e-a7bb-90c7db7287be tempest-TaggedAttachmentsTest-1503143233 None] Lock "cinder-fe46955e-3331-4ce5-8000-7964d0d129eb-delete_volume" released by "delete_volume" :: held 4.819s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:41:12 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:41:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:41:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:41:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:41:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:41:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:41:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:41:12 devstack sudo[91925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:41:12 devstack sudo[91925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:41:13 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:SELECT=5,cinder:UPDATE=12,cinder:DELETE=1,cinder:INSERT=1 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:41:13 devstack sudo[91925]: pam_unix(sudo:session): session closed for user root
Jul 10 12:41:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 1.026s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:41:13 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:41:14 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager._thread_info {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:41:14 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread count: 8 {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 10 12:41:14 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread info: [<_MainThread(MainThread, started 128233544536192)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128233445424704)>, <Thread(Thread-3 (stat_writer), started daemon 128233435118528)>, <Thread(Rabbit-heartbeat, started daemon 128233435718016)>, <Thread(Thread-5 (_runner), started daemon 128233432624448)>, <Thread(Thread-7 (_runner), started daemon 128233432674688)>, <Thread(fd_logger, started daemon 128233428569472)>, <Thread(privsep_reader, started daemon 128233429417088)>] {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 10 12:41:14 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:UPDATE=10,cinder:SELECT=9,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:41:25 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-3f800771-143e-4727-a7c0-3bf21a780776 req-efb860e5-749d-4386-ae29-6f256db0f427 tempest-AttachVolumeShelveTestJSON-943029956 None] No connector for attachment 75cd283a-745f-4a4d-9ced-5c7129a6ed00; skipping storage backend terminate_connection call. {{(pid=87378) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Jul 10 12:41:25 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-3f800771-143e-4727-a7c0-3bf21a780776 req-efb860e5-749d-4386-ae29-6f256db0f427 tempest-AttachVolumeShelveTestJSON-943029956 None] Deleting attachment 75cd283a-745f-4a4d-9ced-5c7129a6ed00. {{(pid=87378) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 10 12:41:26 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ae092e5-445d-4d71-bf28-0c28e9128c7d tempest-ServerRescueNegativeTestJSON-545856009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:41:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2ae092e5-445d-4d71-bf28-0c28e9128c7d tempest-ServerRescueNegativeTestJSON-545856009 None] Flow 'volume_create_manager' (aa2a19b7-8b0b-43c7-b459-1b3c56202797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:41:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2ae092e5-445d-4d71-bf28-0c28e9128c7d tempest-ServerRescueNegativeTestJSON-545856009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6b0f9a9-ac35-46fd-9ac5-16b3d07acc44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:41:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2ae092e5-445d-4d71-bf28-0c28e9128c7d tempest-ServerRescueNegativeTestJSON-545856009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6b0f9a9-ac35-46fd-9ac5-16b3d07acc44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1247845226',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86d901bf-93d5-4d68-ada2-1c80b6d95b98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c038c9a996f4c3cb7c94e16e1901341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:41:26Z,use_quota=True,user_id='1264f47888d14e269b6240672fc3e69c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:41:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2ae092e5-445d-4d71-bf28-0c28e9128c7d tempest-ServerRescueNegativeTestJSON-545856009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7589c6cc-16c1-4402-88aa-b2e79b6a22c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:41:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2ae092e5-445d-4d71-bf28-0c28e9128c7d tempest-ServerRescueNegativeTestJSON-545856009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7589c6cc-16c1-4402-88aa-b2e79b6a22c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:41:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2ae092e5-445d-4d71-bf28-0c28e9128c7d tempest-ServerRescueNegativeTestJSON-545856009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db2c553a-e415-4d3b-a21e-4bf39125252d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:41:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2ae092e5-445d-4d71-bf28-0c28e9128c7d tempest-ServerRescueNegativeTestJSON-545856009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db2c553a-e415-4d3b-a21e-4bf39125252d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86d901bf-93d5-4d68-ada2-1c80b6d95b98', 'volume_name': 'volume-86d901bf-93d5-4d68-ada2-1c80b6d95b98', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:41:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2ae092e5-445d-4d71-bf28-0c28e9128c7d tempest-ServerRescueNegativeTestJSON-545856009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbf4c07f-5e72-4022-a1ca-812d8e23ee57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:41:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2ae092e5-445d-4d71-bf28-0c28e9128c7d tempest-ServerRescueNegativeTestJSON-545856009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbf4c07f-5e72-4022-a1ca-812d8e23ee57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:41:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2ae092e5-445d-4d71-bf28-0c28e9128c7d tempest-ServerRescueNegativeTestJSON-545856009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27380749-8a9b-4c0b-84ee-4908d960a904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:41:26 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-2ae092e5-445d-4d71-bf28-0c28e9128c7d tempest-ServerRescueNegativeTestJSON-545856009 None] Volume 86d901bf-93d5-4d68-ada2-1c80b6d95b98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86d901bf-93d5-4d68-ada2-1c80b6d95b98', 'volume_size': 1}
Jul 10 12:41:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2ae092e5-445d-4d71-bf28-0c28e9128c7d tempest-ServerRescueNegativeTestJSON-545856009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:41:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2ae092e5-445d-4d71-bf28-0c28e9128c7d tempest-ServerRescueNegativeTestJSON-545856009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:41:26 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-2ae092e5-445d-4d71-bf28-0c28e9128c7d tempest-ServerRescueNegativeTestJSON-545856009 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1247845226',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86d901bf-93d5-4d68-ada2-1c80b6d95b98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c038c9a996f4c3cb7c94e16e1901341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:41:26Z,use_quota=True,user_id='1264f47888d14e269b6240672fc3e69c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:41:26 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-2ae092e5-445d-4d71-bf28-0c28e9128c7d tempest-ServerRescueNegativeTestJSON-545856009 None] Creating volume 86d901bf-93d5-4d68-ada2-1c80b6d95b98 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:41:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2ae092e5-445d-4d71-bf28-0c28e9128c7d tempest-ServerRescueNegativeTestJSON-545856009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:41:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2ae092e5-445d-4d71-bf28-0c28e9128c7d tempest-ServerRescueNegativeTestJSON-545856009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:41:26 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-2ae092e5-445d-4d71-bf28-0c28e9128c7d tempest-ServerRescueNegativeTestJSON-545856009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:41:26 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-2ae092e5-445d-4d71-bf28-0c28e9128c7d tempest-ServerRescueNegativeTestJSON-545856009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:41:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2ae092e5-445d-4d71-bf28-0c28e9128c7d tempest-ServerRescueNegativeTestJSON-545856009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:41:26 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-2ae092e5-445d-4d71-bf28-0c28e9128c7d tempest-ServerRescueNegativeTestJSON-545856009 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:41:26 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-2ae092e5-445d-4d71-bf28-0c28e9128c7d tempest-ServerRescueNegativeTestJSON-545856009 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:41:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2ae092e5-445d-4d71-bf28-0c28e9128c7d tempest-ServerRescueNegativeTestJSON-545856009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-86d901bf-93d5-4d68-ada2-1c80b6d95b98 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:41:26 devstack sudo[92143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-86d901bf-93d5-4d68-ada2-1c80b6d95b98 1073741824
Jul 10 12:41:26 devstack sudo[92143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:41:28 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-57469ac0-d4ca-406b-a5c2-0ea157774916 tempest-VolumesActionsTest-2039201444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:41:28 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-57469ac0-d4ca-406b-a5c2-0ea157774916 tempest-VolumesActionsTest-2039201444 None] Flow 'volume_create_manager' (0c5458c7-6bbf-423d-9ba1-8364dc8e2613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:41:28 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-57469ac0-d4ca-406b-a5c2-0ea157774916 tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f94decb-5ac1-421b-bc2c-206dcf60950b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:41:28 devstack sudo[92143]: pam_unix(sudo:session): session closed for user root
Jul 10 12:41:28 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-57469ac0-d4ca-406b-a5c2-0ea157774916 tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f94decb-5ac1-421b-bc2c-206dcf60950b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-232220239',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d3d849e-2673-4cc3-b361-0d410acb8e9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0567b9692ffd40679f714b3c80d22784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:41:28Z,use_quota=True,user_id='569a0fb83fad48ccad5a75e2ced0c543',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:41:28 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-57469ac0-d4ca-406b-a5c2-0ea157774916 tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9d402ad-f8c7-4de5-ada8-6bf477d78cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:41:28 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-57469ac0-d4ca-406b-a5c2-0ea157774916 tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9d402ad-f8c7-4de5-ada8-6bf477d78cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:41:28 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-57469ac0-d4ca-406b-a5c2-0ea157774916 tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0470ad14-2572-4f81-8497-d40a2bf54e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:41:28 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-57469ac0-d4ca-406b-a5c2-0ea157774916 tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0470ad14-2572-4f81-8497-d40a2bf54e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d3d849e-2673-4cc3-b361-0d410acb8e9a', 'volume_name': 'volume-8d3d849e-2673-4cc3-b361-0d410acb8e9a', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:41:28 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-57469ac0-d4ca-406b-a5c2-0ea157774916 tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6038e57f-0eeb-4ce2-879a-3868797c76cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:41:28 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-57469ac0-d4ca-406b-a5c2-0ea157774916 tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6038e57f-0eeb-4ce2-879a-3868797c76cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:41:28 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-57469ac0-d4ca-406b-a5c2-0ea157774916 tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2776a33-68f8-41fc-9f8f-07362725bea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:41:28 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-57469ac0-d4ca-406b-a5c2-0ea157774916 tempest-VolumesActionsTest-2039201444 None] Volume 8d3d849e-2673-4cc3-b361-0d410acb8e9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d3d849e-2673-4cc3-b361-0d410acb8e9a', 'volume_size': 1}
Jul 10 12:41:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-57469ac0-d4ca-406b-a5c2-0ea157774916 tempest-VolumesActionsTest-2039201444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:41:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2ae092e5-445d-4d71-bf28-0c28e9128c7d tempest-ServerRescueNegativeTestJSON-545856009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-86d901bf-93d5-4d68-ada2-1c80b6d95b98 1073741824" returned: 0 in 2.168s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:41:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2ae092e5-445d-4d71-bf28-0c28e9128c7d tempest-ServerRescueNegativeTestJSON-545856009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-86d901bf-93d5-4d68-ada2-1c80b6d95b98 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:41:28 devstack sudo[92152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-86d901bf-93d5-4d68-ada2-1c80b6d95b98
Jul 10 12:41:28 devstack sudo[92152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:41:29 devstack sudo[92152]: pam_unix(sudo:session): session closed for user root
Jul 10 12:41:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2ae092e5-445d-4d71-bf28-0c28e9128c7d tempest-ServerRescueNegativeTestJSON-545856009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-86d901bf-93d5-4d68-ada2-1c80b6d95b98" returned: 0 in 1.210s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:41:29 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-2ae092e5-445d-4d71-bf28-0c28e9128c7d tempest-ServerRescueNegativeTestJSON-545856009 None] <== create_volume: return (3453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:41:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2ae092e5-445d-4d71-bf28-0c28e9128c7d tempest-ServerRescueNegativeTestJSON-545856009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.456s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:41:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-57469ac0-d4ca-406b-a5c2-0ea157774916 tempest-VolumesActionsTest-2039201444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.267s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:41:29 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-57469ac0-d4ca-406b-a5c2-0ea157774916 tempest-VolumesActionsTest-2039201444 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-232220239',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d3d849e-2673-4cc3-b361-0d410acb8e9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0567b9692ffd40679f714b3c80d22784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:41:28Z,use_quota=True,user_id='569a0fb83fad48ccad5a75e2ced0c543',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:41:29 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-57469ac0-d4ca-406b-a5c2-0ea157774916 tempest-VolumesActionsTest-2039201444 None] Creating volume 8d3d849e-2673-4cc3-b361-0d410acb8e9a {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:41:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-57469ac0-d4ca-406b-a5c2-0ea157774916 tempest-VolumesActionsTest-2039201444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:41:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-57469ac0-d4ca-406b-a5c2-0ea157774916 tempest-VolumesActionsTest-2039201444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:41:29 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-57469ac0-d4ca-406b-a5c2-0ea157774916 tempest-VolumesActionsTest-2039201444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:41:29 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-57469ac0-d4ca-406b-a5c2-0ea157774916 tempest-VolumesActionsTest-2039201444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:41:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-57469ac0-d4ca-406b-a5c2-0ea157774916 tempest-VolumesActionsTest-2039201444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:41:29 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-57469ac0-d4ca-406b-a5c2-0ea157774916 tempest-VolumesActionsTest-2039201444 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:41:29 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-57469ac0-d4ca-406b-a5c2-0ea157774916 tempest-VolumesActionsTest-2039201444 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:41:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-57469ac0-d4ca-406b-a5c2-0ea157774916 tempest-VolumesActionsTest-2039201444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8d3d849e-2673-4cc3-b361-0d410acb8e9a 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:41:29 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2ae092e5-445d-4d71-bf28-0c28e9128c7d tempest-ServerRescueNegativeTestJSON-545856009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27380749-8a9b-4c0b-84ee-4908d960a904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86d901bf-93d5-4d68-ada2-1c80b6d95b98', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:41:29 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2ae092e5-445d-4d71-bf28-0c28e9128c7d tempest-ServerRescueNegativeTestJSON-545856009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f35a4c89-7dd0-4261-9e08-23c08dc752bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:41:29 devstack sudo[92156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8d3d849e-2673-4cc3-b361-0d410acb8e9a 1073741824
Jul 10 12:41:29 devstack sudo[92156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:41:29 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-2ae092e5-445d-4d71-bf28-0c28e9128c7d tempest-ServerRescueNegativeTestJSON-545856009 None] Volume volume-86d901bf-93d5-4d68-ada2-1c80b6d95b98 (86d901bf-93d5-4d68-ada2-1c80b6d95b98): created successfully
Jul 10 12:41:29 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2ae092e5-445d-4d71-bf28-0c28e9128c7d tempest-ServerRescueNegativeTestJSON-545856009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f35a4c89-7dd0-4261-9e08-23c08dc752bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:41:29 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2ae092e5-445d-4d71-bf28-0c28e9128c7d tempest-ServerRescueNegativeTestJSON-545856009 None] Flow 'volume_create_manager' (aa2a19b7-8b0b-43c7-b459-1b3c56202797) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:41:29 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-2ae092e5-445d-4d71-bf28-0c28e9128c7d tempest-ServerRescueNegativeTestJSON-545856009 None] Created volume successfully.
Jul 10 12:41:31 devstack sudo[92156]: pam_unix(sudo:session): session closed for user root
Jul 10 12:41:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-57469ac0-d4ca-406b-a5c2-0ea157774916 tempest-VolumesActionsTest-2039201444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8d3d849e-2673-4cc3-b361-0d410acb8e9a 1073741824" returned: 0 in 1.747s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:41:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-57469ac0-d4ca-406b-a5c2-0ea157774916 tempest-VolumesActionsTest-2039201444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8d3d849e-2673-4cc3-b361-0d410acb8e9a {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:41:31 devstack sudo[92164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8d3d849e-2673-4cc3-b361-0d410acb8e9a
Jul 10 12:41:31 devstack sudo[92164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:41:33 devstack sudo[92164]: pam_unix(sudo:session): session closed for user root
Jul 10 12:41:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-57469ac0-d4ca-406b-a5c2-0ea157774916 tempest-VolumesActionsTest-2039201444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8d3d849e-2673-4cc3-b361-0d410acb8e9a" returned: 0 in 1.606s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:41:33 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-57469ac0-d4ca-406b-a5c2-0ea157774916 tempest-VolumesActionsTest-2039201444 None] <== create_volume: return (3448ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:41:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-57469ac0-d4ca-406b-a5c2-0ea157774916 tempest-VolumesActionsTest-2039201444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.454s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:41:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-57469ac0-d4ca-406b-a5c2-0ea157774916 tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2776a33-68f8-41fc-9f8f-07362725bea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d3d849e-2673-4cc3-b361-0d410acb8e9a', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:41:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-57469ac0-d4ca-406b-a5c2-0ea157774916 tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a1207eb-6d07-4371-9737-cf4a3e48adf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:41:33 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-57469ac0-d4ca-406b-a5c2-0ea157774916 tempest-VolumesActionsTest-2039201444 None] Volume volume-8d3d849e-2673-4cc3-b361-0d410acb8e9a (8d3d849e-2673-4cc3-b361-0d410acb8e9a): created successfully
Jul 10 12:41:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-57469ac0-d4ca-406b-a5c2-0ea157774916 tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a1207eb-6d07-4371-9737-cf4a3e48adf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:41:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-57469ac0-d4ca-406b-a5c2-0ea157774916 tempest-VolumesActionsTest-2039201444 None] Flow 'volume_create_manager' (0c5458c7-6bbf-423d-9ba1-8364dc8e2613) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:41:33 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-57469ac0-d4ca-406b-a5c2-0ea157774916 tempest-VolumesActionsTest-2039201444 None] Created volume successfully.
Jul 10 12:41:33 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3ca483d9-f798-49cb-9472-3c22e9464e0b tempest-VolumesActionsTest-2039201444 None] Acquiring lock "cinder-8d3d849e-2673-4cc3-b361-0d410acb8e9a" by "attach_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:41:33 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3ca483d9-f798-49cb-9472-3c22e9464e0b tempest-VolumesActionsTest-2039201444 None] Lock "cinder-8d3d849e-2673-4cc3-b361-0d410acb8e9a" acquired by "attach_volume" :: waited 0.040s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:41:33 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-3ca483d9-f798-49cb-9472-3c22e9464e0b tempest-VolumesActionsTest-2039201444 None] Attaching volume 8d3d849e-2673-4cc3-b361-0d410acb8e9a to instance 32295753-0bdb-4854-b0e0-2781ec6db6ec at mountpoint /dev/vdb on host None.
Jul 10 12:41:33 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-3ca483d9-f798-49cb-9472-3c22e9464e0b tempest-VolumesActionsTest-2039201444 None] Attach volume completed successfully.
Jul 10 12:41:33 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3ca483d9-f798-49cb-9472-3c22e9464e0b tempest-VolumesActionsTest-2039201444 None] Lock "cinder-8d3d849e-2673-4cc3-b361-0d410acb8e9a" released by "attach_volume" :: held 0.248s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:41:35 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-b059e506-6545-4102-ae55-378ebe18d40c tempest-VolumesActionsTest-322858102 None] Terminate volume connection completed successfully.
Jul 10 12:41:35 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b059e506-6545-4102-ae55-378ebe18d40c tempest-VolumesActionsTest-322858102 None] Acquiring lock "cinder-8d3d849e-2673-4cc3-b361-0d410acb8e9a-detach_volume" by "detach_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:41:35 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b059e506-6545-4102-ae55-378ebe18d40c tempest-VolumesActionsTest-322858102 None] Lock "cinder-8d3d849e-2673-4cc3-b361-0d410acb8e9a-detach_volume" acquired by "detach_volume" :: waited 0.039s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:41:35 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-b059e506-6545-4102-ae55-378ebe18d40c tempest-VolumesActionsTest-322858102 None] Detaching volume 8d3d849e-2673-4cc3-b361-0d410acb8e9a from instance 32295753-0bdb-4854-b0e0-2781ec6db6ec.
Jul 10 12:41:36 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-b059e506-6545-4102-ae55-378ebe18d40c tempest-VolumesActionsTest-322858102 None] Detach volume completed successfully.
Jul 10 12:41:36 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b059e506-6545-4102-ae55-378ebe18d40c tempest-VolumesActionsTest-322858102 None] Lock "cinder-8d3d849e-2673-4cc3-b361-0d410acb8e9a-detach_volume" released by "detach_volume" :: held 0.216s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:41:36 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b8bc06dc-1a52-462b-9116-ab764cbe5dc2 tempest-VolumesActionsTest-2039201444 None] Acquiring lock "cinder-8d3d849e-2673-4cc3-b361-0d410acb8e9a-detach_volume" by "detach_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:41:36 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b8bc06dc-1a52-462b-9116-ab764cbe5dc2 tempest-VolumesActionsTest-2039201444 None] Lock "cinder-8d3d849e-2673-4cc3-b361-0d410acb8e9a-detach_volume" acquired by "detach_volume" :: waited 0.056s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:41:36 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-b8bc06dc-1a52-462b-9116-ab764cbe5dc2 tempest-VolumesActionsTest-2039201444 None] Volume detach called, but volume not attached.
Jul 10 12:41:36 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b8bc06dc-1a52-462b-9116-ab764cbe5dc2 tempest-VolumesActionsTest-2039201444 None] Lock "cinder-8d3d849e-2673-4cc3-b361-0d410acb8e9a-detach_volume" released by "detach_volume" :: held 0.038s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:41:37 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-c85a2886-6d31-49f8-913a-58ad85e9b096 tempest-VolumesActionsTest-2039201444 None] Acquiring lock "cinder-8d3d849e-2673-4cc3-b361-0d410acb8e9a-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:41:37 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-c85a2886-6d31-49f8-913a-58ad85e9b096 tempest-VolumesActionsTest-2039201444 None] Lock "cinder-8d3d849e-2673-4cc3-b361-0d410acb8e9a-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:41:37 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-c85a2886-6d31-49f8-913a-58ad85e9b096 tempest-VolumesActionsTest-2039201444 None] Acquiring lock "cinder-quobyte-8d3d849e-2673-4cc3-b361-0d410acb8e9a" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:41:37 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-c85a2886-6d31-49f8-913a-58ad85e9b096 tempest-VolumesActionsTest-2039201444 None] Lock "cinder-quobyte-8d3d849e-2673-4cc3-b361-0d410acb8e9a" acquired by "delete_volume" :: waited 0.023s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:41:37 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd0fa84-f9d5-4631-a5f2-35a81266bd8c]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:41:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c85a2886-6d31-49f8-913a-58ad85e9b096 tempest-VolumesActionsTest-2039201444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8d3d849e-2673-4cc3-b361-0d410acb8e9a {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:41:37 devstack sudo[92216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8d3d849e-2673-4cc3-b361-0d410acb8e9a
Jul 10 12:41:37 devstack sudo[92216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:41:38 devstack sudo[92216]: pam_unix(sudo:session): session closed for user root
Jul 10 12:41:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c85a2886-6d31-49f8-913a-58ad85e9b096 tempest-VolumesActionsTest-2039201444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8d3d849e-2673-4cc3-b361-0d410acb8e9a" returned: 0 in 1.069s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:41:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c85a2886-6d31-49f8-913a-58ad85e9b096 tempest-VolumesActionsTest-2039201444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8d3d849e-2673-4cc3-b361-0d410acb8e9a {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:41:38 devstack sudo[92244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8d3d849e-2673-4cc3-b361-0d410acb8e9a
Jul 10 12:41:38 devstack sudo[92244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:41:39 devstack sudo[92244]: pam_unix(sudo:session): session closed for user root
Jul 10 12:41:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c85a2886-6d31-49f8-913a-58ad85e9b096 tempest-VolumesActionsTest-2039201444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8d3d849e-2673-4cc3-b361-0d410acb8e9a" returned: 0 in 0.689s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:41:39 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-c85a2886-6d31-49f8-913a-58ad85e9b096 tempest-VolumesActionsTest-2039201444 None] Lock "cinder-quobyte-8d3d849e-2673-4cc3-b361-0d410acb8e9a" released by "delete_volume" :: held 1.821s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:41:39 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-c85a2886-6d31-49f8-913a-58ad85e9b096 tempest-VolumesActionsTest-2039201444 None] Created reservations ['4242083f-9f9a-422f-94b8-f7c452076a29', '382637da-3ac9-4bf0-8d10-2ce2b2070aae', '6a4d8971-5c1e-4e3b-a3a8-3f390a7b8dae', 'f34d2ae9-b9cd-438e-bf95-7c9594cf36dc'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:41:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c85a2886-6d31-49f8-913a-58ad85e9b096 tempest-VolumesActionsTest-2039201444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:41:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c85a2886-6d31-49f8-913a-58ad85e9b096 tempest-VolumesActionsTest-2039201444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:41:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-c85a2886-6d31-49f8-913a-58ad85e9b096 tempest-VolumesActionsTest-2039201444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:41:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-c85a2886-6d31-49f8-913a-58ad85e9b096 tempest-VolumesActionsTest-2039201444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:41:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c85a2886-6d31-49f8-913a-58ad85e9b096 tempest-VolumesActionsTest-2039201444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:41:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c85a2886-6d31-49f8-913a-58ad85e9b096 tempest-VolumesActionsTest-2039201444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:41:39 devstack sudo[92247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:41:39 devstack sudo[92247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:41:40 devstack sudo[92247]: pam_unix(sudo:session): session closed for user root
Jul 10 12:41:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c85a2886-6d31-49f8-913a-58ad85e9b096 tempest-VolumesActionsTest-2039201444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 1.232s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:41:40 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-c85a2886-6d31-49f8-913a-58ad85e9b096 tempest-VolumesActionsTest-2039201444 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:41:40 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-c85a2886-6d31-49f8-913a-58ad85e9b096 tempest-VolumesActionsTest-2039201444 None] Deleted volume successfully.
Jul 10 12:41:40 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-c85a2886-6d31-49f8-913a-58ad85e9b096 tempest-VolumesActionsTest-2039201444 None] Lock "cinder-8d3d849e-2673-4cc3-b361-0d410acb8e9a-delete_volume" released by "delete_volume" :: held 3.386s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:41:49 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-53323326-9eb7-4c22-b70e-ad9efc96a4b3 tempest-VolumesActionsTest-2039201444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:41:49 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-53323326-9eb7-4c22-b70e-ad9efc96a4b3 tempest-VolumesActionsTest-2039201444 None] Flow 'volume_create_manager' (e56737c6-d34a-4f61-b6c2-368bc98ace2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:41:49 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-53323326-9eb7-4c22-b70e-ad9efc96a4b3 tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e968c5cd-d618-4b08-ac14-8b0165725b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:41:49 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-53323326-9eb7-4c22-b70e-ad9efc96a4b3 tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e968c5cd-d618-4b08-ac14-8b0165725b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1573676142',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f3ccd4b-1cb1-415f-8fe9-b815b1f03a92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0567b9692ffd40679f714b3c80d22784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:41:49Z,use_quota=True,user_id='569a0fb83fad48ccad5a75e2ced0c543',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:41:49 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-53323326-9eb7-4c22-b70e-ad9efc96a4b3 tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd3a5b58-a6a8-4280-bbd8-41c5ec8ed089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:41:49 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-53323326-9eb7-4c22-b70e-ad9efc96a4b3 tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd3a5b58-a6a8-4280-bbd8-41c5ec8ed089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:41:49 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-53323326-9eb7-4c22-b70e-ad9efc96a4b3 tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac2bc5dc-445c-4717-9fe5-7581c51bae9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:41:49 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-53323326-9eb7-4c22-b70e-ad9efc96a4b3 tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac2bc5dc-445c-4717-9fe5-7581c51bae9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f3ccd4b-1cb1-415f-8fe9-b815b1f03a92', 'volume_name': 'volume-7f3ccd4b-1cb1-415f-8fe9-b815b1f03a92', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:41:49 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-53323326-9eb7-4c22-b70e-ad9efc96a4b3 tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cc9b0e5-5d86-4321-ad67-7b76f6262aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:41:49 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-53323326-9eb7-4c22-b70e-ad9efc96a4b3 tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cc9b0e5-5d86-4321-ad67-7b76f6262aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:41:49 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-53323326-9eb7-4c22-b70e-ad9efc96a4b3 tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a449b815-4ba5-4978-a7dd-dd3fd27be95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:41:49 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-53323326-9eb7-4c22-b70e-ad9efc96a4b3 tempest-VolumesActionsTest-2039201444 None] Volume 7f3ccd4b-1cb1-415f-8fe9-b815b1f03a92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f3ccd4b-1cb1-415f-8fe9-b815b1f03a92', 'volume_size': 1}
Jul 10 12:41:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-53323326-9eb7-4c22-b70e-ad9efc96a4b3 tempest-VolumesActionsTest-2039201444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:41:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-53323326-9eb7-4c22-b70e-ad9efc96a4b3 tempest-VolumesActionsTest-2039201444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:41:49 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-53323326-9eb7-4c22-b70e-ad9efc96a4b3 tempest-VolumesActionsTest-2039201444 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1573676142',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f3ccd4b-1cb1-415f-8fe9-b815b1f03a92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0567b9692ffd40679f714b3c80d22784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:41:49Z,use_quota=True,user_id='569a0fb83fad48ccad5a75e2ced0c543',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:41:49 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-53323326-9eb7-4c22-b70e-ad9efc96a4b3 tempest-VolumesActionsTest-2039201444 None] Creating volume 7f3ccd4b-1cb1-415f-8fe9-b815b1f03a92 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:41:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-53323326-9eb7-4c22-b70e-ad9efc96a4b3 tempest-VolumesActionsTest-2039201444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:41:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-53323326-9eb7-4c22-b70e-ad9efc96a4b3 tempest-VolumesActionsTest-2039201444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:41:49 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-53323326-9eb7-4c22-b70e-ad9efc96a4b3 tempest-VolumesActionsTest-2039201444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:41:49 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-53323326-9eb7-4c22-b70e-ad9efc96a4b3 tempest-VolumesActionsTest-2039201444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:41:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-53323326-9eb7-4c22-b70e-ad9efc96a4b3 tempest-VolumesActionsTest-2039201444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:41:49 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-53323326-9eb7-4c22-b70e-ad9efc96a4b3 tempest-VolumesActionsTest-2039201444 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:41:49 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-53323326-9eb7-4c22-b70e-ad9efc96a4b3 tempest-VolumesActionsTest-2039201444 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:41:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-53323326-9eb7-4c22-b70e-ad9efc96a4b3 tempest-VolumesActionsTest-2039201444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-7f3ccd4b-1cb1-415f-8fe9-b815b1f03a92 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:41:49 devstack sudo[92385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-7f3ccd4b-1cb1-415f-8fe9-b815b1f03a92 1073741824
Jul 10 12:41:49 devstack sudo[92385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:41:50 devstack sudo[92385]: pam_unix(sudo:session): session closed for user root
Jul 10 12:41:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-53323326-9eb7-4c22-b70e-ad9efc96a4b3 tempest-VolumesActionsTest-2039201444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-7f3ccd4b-1cb1-415f-8fe9-b815b1f03a92 1073741824" returned: 0 in 1.163s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:41:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-53323326-9eb7-4c22-b70e-ad9efc96a4b3 tempest-VolumesActionsTest-2039201444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-7f3ccd4b-1cb1-415f-8fe9-b815b1f03a92 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:41:50 devstack sudo[92440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-7f3ccd4b-1cb1-415f-8fe9-b815b1f03a92
Jul 10 12:41:50 devstack sudo[92440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:41:51 devstack sudo[92440]: pam_unix(sudo:session): session closed for user root
Jul 10 12:41:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-53323326-9eb7-4c22-b70e-ad9efc96a4b3 tempest-VolumesActionsTest-2039201444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-7f3ccd4b-1cb1-415f-8fe9-b815b1f03a92" returned: 0 in 0.829s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:41:51 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-53323326-9eb7-4c22-b70e-ad9efc96a4b3 tempest-VolumesActionsTest-2039201444 None] <== create_volume: return (2065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:41:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-53323326-9eb7-4c22-b70e-ad9efc96a4b3 tempest-VolumesActionsTest-2039201444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.068s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:41:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-53323326-9eb7-4c22-b70e-ad9efc96a4b3 tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a449b815-4ba5-4978-a7dd-dd3fd27be95a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f3ccd4b-1cb1-415f-8fe9-b815b1f03a92', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:41:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-53323326-9eb7-4c22-b70e-ad9efc96a4b3 tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dfe0eae-3e34-4317-9504-e4df84c5a04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:41:51 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-53323326-9eb7-4c22-b70e-ad9efc96a4b3 tempest-VolumesActionsTest-2039201444 None] Volume volume-7f3ccd4b-1cb1-415f-8fe9-b815b1f03a92 (7f3ccd4b-1cb1-415f-8fe9-b815b1f03a92): created successfully
Jul 10 12:41:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-53323326-9eb7-4c22-b70e-ad9efc96a4b3 tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dfe0eae-3e34-4317-9504-e4df84c5a04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:41:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-53323326-9eb7-4c22-b70e-ad9efc96a4b3 tempest-VolumesActionsTest-2039201444 None] Flow 'volume_create_manager' (e56737c6-d34a-4f61-b6c2-368bc98ace2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:41:51 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-53323326-9eb7-4c22-b70e-ad9efc96a4b3 tempest-VolumesActionsTest-2039201444 None] Created volume successfully.
Jul 10 12:41:52 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-85b36ce1-1aa9-46dd-be28-ea0ffd17b4ff tempest-ServerRescueNegativeTestJSON-545856009 None] Acquiring lock "cinder-86d901bf-93d5-4d68-ada2-1c80b6d95b98-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:41:52 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-85b36ce1-1aa9-46dd-be28-ea0ffd17b4ff tempest-ServerRescueNegativeTestJSON-545856009 None] Lock "cinder-86d901bf-93d5-4d68-ada2-1c80b6d95b98-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:41:52 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-85b36ce1-1aa9-46dd-be28-ea0ffd17b4ff tempest-ServerRescueNegativeTestJSON-545856009 None] Acquiring lock "cinder-quobyte-86d901bf-93d5-4d68-ada2-1c80b6d95b98" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:41:52 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-85b36ce1-1aa9-46dd-be28-ea0ffd17b4ff tempest-ServerRescueNegativeTestJSON-545856009 None] Lock "cinder-quobyte-86d901bf-93d5-4d68-ada2-1c80b6d95b98" acquired by "delete_volume" :: waited 0.021s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:41:52 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c36de54-5cf8-44e1-967a-08d986fe2439]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:41:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-85b36ce1-1aa9-46dd-be28-ea0ffd17b4ff tempest-ServerRescueNegativeTestJSON-545856009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-86d901bf-93d5-4d68-ada2-1c80b6d95b98 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:41:52 devstack sudo[92446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-86d901bf-93d5-4d68-ada2-1c80b6d95b98
Jul 10 12:41:52 devstack sudo[92446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:41:52 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-97491602-7a3e-475b-99e7-d0269c8e995a tempest-VolumesActionsTest-322858102 None] Acquiring lock "cinder-7f3ccd4b-1cb1-415f-8fe9-b815b1f03a92-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:41:52 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-97491602-7a3e-475b-99e7-d0269c8e995a tempest-VolumesActionsTest-322858102 None] Lock "cinder-7f3ccd4b-1cb1-415f-8fe9-b815b1f03a92-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:41:53 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-97491602-7a3e-475b-99e7-d0269c8e995a tempest-VolumesActionsTest-322858102 None] Acquiring lock "cinder-quobyte-7f3ccd4b-1cb1-415f-8fe9-b815b1f03a92" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:41:53 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-97491602-7a3e-475b-99e7-d0269c8e995a tempest-VolumesActionsTest-322858102 None] Lock "cinder-quobyte-7f3ccd4b-1cb1-415f-8fe9-b815b1f03a92" acquired by "delete_volume" :: waited 0.048s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:41:53 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[49656146-489b-458a-b839-7d93289b02cb]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:41:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-97491602-7a3e-475b-99e7-d0269c8e995a tempest-VolumesActionsTest-322858102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-7f3ccd4b-1cb1-415f-8fe9-b815b1f03a92 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:41:53 devstack sudo[92450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-7f3ccd4b-1cb1-415f-8fe9-b815b1f03a92
Jul 10 12:41:53 devstack sudo[92450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:41:54 devstack sudo[92446]: pam_unix(sudo:session): session closed for user root
Jul 10 12:41:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-85b36ce1-1aa9-46dd-be28-ea0ffd17b4ff tempest-ServerRescueNegativeTestJSON-545856009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-86d901bf-93d5-4d68-ada2-1c80b6d95b98" returned: 0 in 1.861s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:41:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-85b36ce1-1aa9-46dd-be28-ea0ffd17b4ff tempest-ServerRescueNegativeTestJSON-545856009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-86d901bf-93d5-4d68-ada2-1c80b6d95b98 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:41:54 devstack sudo[92455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-86d901bf-93d5-4d68-ada2-1c80b6d95b98
Jul 10 12:41:54 devstack sudo[92455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:41:55 devstack sudo[92450]: pam_unix(sudo:session): session closed for user root
Jul 10 12:41:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-97491602-7a3e-475b-99e7-d0269c8e995a tempest-VolumesActionsTest-322858102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-7f3ccd4b-1cb1-415f-8fe9-b815b1f03a92" returned: 0 in 1.945s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:41:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-97491602-7a3e-475b-99e7-d0269c8e995a tempest-VolumesActionsTest-322858102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-7f3ccd4b-1cb1-415f-8fe9-b815b1f03a92 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:41:55 devstack sudo[92464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-7f3ccd4b-1cb1-415f-8fe9-b815b1f03a92
Jul 10 12:41:55 devstack sudo[92464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:41:55 devstack sudo[92455]: pam_unix(sudo:session): session closed for user root
Jul 10 12:41:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-85b36ce1-1aa9-46dd-be28-ea0ffd17b4ff tempest-ServerRescueNegativeTestJSON-545856009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-86d901bf-93d5-4d68-ada2-1c80b6d95b98" returned: 0 in 1.805s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:41:55 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-85b36ce1-1aa9-46dd-be28-ea0ffd17b4ff tempest-ServerRescueNegativeTestJSON-545856009 None] Lock "cinder-quobyte-86d901bf-93d5-4d68-ada2-1c80b6d95b98" released by "delete_volume" :: held 3.748s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:41:56 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-85b36ce1-1aa9-46dd-be28-ea0ffd17b4ff tempest-ServerRescueNegativeTestJSON-545856009 None] Created reservations ['f7eb1021-a913-4bfb-8855-3cc77c2ba6cc', '0cc52032-ef60-474b-854c-4bb8c171bb40', '1854aed5-b960-4e6e-9324-e2cf3e36f637', '2ebf61b5-be46-4011-96fe-8e1a3d0e1e20'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:41:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-85b36ce1-1aa9-46dd-be28-ea0ffd17b4ff tempest-ServerRescueNegativeTestJSON-545856009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:41:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-85b36ce1-1aa9-46dd-be28-ea0ffd17b4ff tempest-ServerRescueNegativeTestJSON-545856009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:41:56 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-85b36ce1-1aa9-46dd-be28-ea0ffd17b4ff tempest-ServerRescueNegativeTestJSON-545856009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:41:56 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-85b36ce1-1aa9-46dd-be28-ea0ffd17b4ff tempest-ServerRescueNegativeTestJSON-545856009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:41:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-85b36ce1-1aa9-46dd-be28-ea0ffd17b4ff tempest-ServerRescueNegativeTestJSON-545856009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:41:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-85b36ce1-1aa9-46dd-be28-ea0ffd17b4ff tempest-ServerRescueNegativeTestJSON-545856009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:41:56 devstack sudo[92478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:41:56 devstack sudo[92478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:41:56 devstack sudo[92464]: pam_unix(sudo:session): session closed for user root
Jul 10 12:41:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-97491602-7a3e-475b-99e7-d0269c8e995a tempest-VolumesActionsTest-322858102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-7f3ccd4b-1cb1-415f-8fe9-b815b1f03a92" returned: 0 in 1.593s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:41:56 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-97491602-7a3e-475b-99e7-d0269c8e995a tempest-VolumesActionsTest-322858102 None] Lock "cinder-quobyte-7f3ccd4b-1cb1-415f-8fe9-b815b1f03a92" released by "delete_volume" :: held 3.685s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:41:56 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-97491602-7a3e-475b-99e7-d0269c8e995a tempest-VolumesActionsTest-322858102 None] Created reservations ['056fc005-2db6-4b81-a849-72d4f84a5955', '869f64b4-53b4-4c11-96c6-d1131f52715c', 'a4621370-91cb-4bb3-b754-255e589579ae', '47c371a5-cbfd-4922-a1fb-825018240846'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:41:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-97491602-7a3e-475b-99e7-d0269c8e995a tempest-VolumesActionsTest-322858102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:41:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-97491602-7a3e-475b-99e7-d0269c8e995a tempest-VolumesActionsTest-322858102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:41:57 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-97491602-7a3e-475b-99e7-d0269c8e995a tempest-VolumesActionsTest-322858102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:41:57 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-97491602-7a3e-475b-99e7-d0269c8e995a tempest-VolumesActionsTest-322858102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:41:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-97491602-7a3e-475b-99e7-d0269c8e995a tempest-VolumesActionsTest-322858102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:41:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-97491602-7a3e-475b-99e7-d0269c8e995a tempest-VolumesActionsTest-322858102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:41:57 devstack sudo[92483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:41:57 devstack sudo[92483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:41:57 devstack sudo[92478]: pam_unix(sudo:session): session closed for user root
Jul 10 12:41:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-85b36ce1-1aa9-46dd-be28-ea0ffd17b4ff tempest-ServerRescueNegativeTestJSON-545856009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 1.225s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:41:57 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-85b36ce1-1aa9-46dd-be28-ea0ffd17b4ff tempest-ServerRescueNegativeTestJSON-545856009 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:41:57 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-85b36ce1-1aa9-46dd-be28-ea0ffd17b4ff tempest-ServerRescueNegativeTestJSON-545856009 None] Deleted volume successfully.
Jul 10 12:41:57 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-85b36ce1-1aa9-46dd-be28-ea0ffd17b4ff tempest-ServerRescueNegativeTestJSON-545856009 None] Lock "cinder-86d901bf-93d5-4d68-ada2-1c80b6d95b98-delete_volume" released by "delete_volume" :: held 5.359s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:41:58 devstack sudo[92483]: pam_unix(sudo:session): session closed for user root
Jul 10 12:41:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-97491602-7a3e-475b-99e7-d0269c8e995a tempest-VolumesActionsTest-322858102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 1.046s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:41:58 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-97491602-7a3e-475b-99e7-d0269c8e995a tempest-VolumesActionsTest-322858102 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:41:58 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-97491602-7a3e-475b-99e7-d0269c8e995a tempest-VolumesActionsTest-322858102 None] Deleted volume successfully.
Jul 10 12:41:58 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-97491602-7a3e-475b-99e7-d0269c8e995a tempest-VolumesActionsTest-322858102 None] Lock "cinder-7f3ccd4b-1cb1-415f-8fe9-b815b1f03a92-delete_volume" released by "delete_volume" :: held 5.294s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:41:58 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-db124bb6-67a2-4883-813e-a0b07c8761e2 tempest-VolumesActionsTest-2039201444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:41:58 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-db124bb6-67a2-4883-813e-a0b07c8761e2 tempest-VolumesActionsTest-2039201444 None] Flow 'volume_create_manager' (00b63fa2-eeda-4af7-80f1-fef1db4f9a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:41:58 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-db124bb6-67a2-4883-813e-a0b07c8761e2 tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28753c26-dfb1-4fe6-9220-0a8dfd968e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:41:58 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-db124bb6-67a2-4883-813e-a0b07c8761e2 tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28753c26-dfb1-4fe6-9220-0a8dfd968e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-945245099',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6ae36bc-e7ab-4ae9-b73a-ce740917a653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0567b9692ffd40679f714b3c80d22784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:41:59Z,use_quota=True,user_id='569a0fb83fad48ccad5a75e2ced0c543',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:41:58 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-db124bb6-67a2-4883-813e-a0b07c8761e2 tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d4d29d2-c8ba-4218-8727-c69d2c88c008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:41:58 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-db124bb6-67a2-4883-813e-a0b07c8761e2 tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d4d29d2-c8ba-4218-8727-c69d2c88c008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:41:58 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-db124bb6-67a2-4883-813e-a0b07c8761e2 tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45f7da8c-6574-4520-ba91-d1379a8792f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:41:58 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-db124bb6-67a2-4883-813e-a0b07c8761e2 tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45f7da8c-6574-4520-ba91-d1379a8792f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6ae36bc-e7ab-4ae9-b73a-ce740917a653', 'volume_name': 'volume-c6ae36bc-e7ab-4ae9-b73a-ce740917a653', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:41:58 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-db124bb6-67a2-4883-813e-a0b07c8761e2 tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1de788b6-807c-469a-87dd-ca545349c4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:41:58 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-db124bb6-67a2-4883-813e-a0b07c8761e2 tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1de788b6-807c-469a-87dd-ca545349c4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:41:58 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-db124bb6-67a2-4883-813e-a0b07c8761e2 tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1282e789-7b35-4828-92f4-f66ba063617f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:41:58 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-db124bb6-67a2-4883-813e-a0b07c8761e2 tempest-VolumesActionsTest-2039201444 None] Volume c6ae36bc-e7ab-4ae9-b73a-ce740917a653: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6ae36bc-e7ab-4ae9-b73a-ce740917a653', 'volume_size': 1}
Jul 10 12:41:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-db124bb6-67a2-4883-813e-a0b07c8761e2 tempest-VolumesActionsTest-2039201444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:41:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-db124bb6-67a2-4883-813e-a0b07c8761e2 tempest-VolumesActionsTest-2039201444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:41:58 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-db124bb6-67a2-4883-813e-a0b07c8761e2 tempest-VolumesActionsTest-2039201444 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-945245099',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6ae36bc-e7ab-4ae9-b73a-ce740917a653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0567b9692ffd40679f714b3c80d22784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:41:59Z,use_quota=True,user_id='569a0fb83fad48ccad5a75e2ced0c543',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:41:58 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-db124bb6-67a2-4883-813e-a0b07c8761e2 tempest-VolumesActionsTest-2039201444 None] Creating volume c6ae36bc-e7ab-4ae9-b73a-ce740917a653 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:41:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-db124bb6-67a2-4883-813e-a0b07c8761e2 tempest-VolumesActionsTest-2039201444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:41:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-db124bb6-67a2-4883-813e-a0b07c8761e2 tempest-VolumesActionsTest-2039201444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:41:58 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-db124bb6-67a2-4883-813e-a0b07c8761e2 tempest-VolumesActionsTest-2039201444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:41:58 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-db124bb6-67a2-4883-813e-a0b07c8761e2 tempest-VolumesActionsTest-2039201444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:41:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-db124bb6-67a2-4883-813e-a0b07c8761e2 tempest-VolumesActionsTest-2039201444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:41:58 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-db124bb6-67a2-4883-813e-a0b07c8761e2 tempest-VolumesActionsTest-2039201444 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:41:58 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-db124bb6-67a2-4883-813e-a0b07c8761e2 tempest-VolumesActionsTest-2039201444 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:41:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-db124bb6-67a2-4883-813e-a0b07c8761e2 tempest-VolumesActionsTest-2039201444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-c6ae36bc-e7ab-4ae9-b73a-ce740917a653 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:41:58 devstack sudo[92496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-c6ae36bc-e7ab-4ae9-b73a-ce740917a653 1073741824
Jul 10 12:41:58 devstack sudo[92496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:42:00 devstack sudo[92496]: pam_unix(sudo:session): session closed for user root
Jul 10 12:42:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-db124bb6-67a2-4883-813e-a0b07c8761e2 tempest-VolumesActionsTest-2039201444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-c6ae36bc-e7ab-4ae9-b73a-ce740917a653 1073741824" returned: 0 in 1.713s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:42:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-db124bb6-67a2-4883-813e-a0b07c8761e2 tempest-VolumesActionsTest-2039201444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-c6ae36bc-e7ab-4ae9-b73a-ce740917a653 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:42:00 devstack sudo[92533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-c6ae36bc-e7ab-4ae9-b73a-ce740917a653
Jul 10 12:42:00 devstack sudo[92533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:42:02 devstack sudo[92533]: pam_unix(sudo:session): session closed for user root
Jul 10 12:42:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-db124bb6-67a2-4883-813e-a0b07c8761e2 tempest-VolumesActionsTest-2039201444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-c6ae36bc-e7ab-4ae9-b73a-ce740917a653" returned: 0 in 2.211s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:42:02 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-db124bb6-67a2-4883-813e-a0b07c8761e2 tempest-VolumesActionsTest-2039201444 None] <== create_volume: return (4141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:42:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-db124bb6-67a2-4883-813e-a0b07c8761e2 tempest-VolumesActionsTest-2039201444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.143s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:42:02 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-db124bb6-67a2-4883-813e-a0b07c8761e2 tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1282e789-7b35-4828-92f4-f66ba063617f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6ae36bc-e7ab-4ae9-b73a-ce740917a653', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:02 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-db124bb6-67a2-4883-813e-a0b07c8761e2 tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acc68475-a580-47b3-9153-1fc9ea5d176b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:02 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-db124bb6-67a2-4883-813e-a0b07c8761e2 tempest-VolumesActionsTest-2039201444 None] Volume volume-c6ae36bc-e7ab-4ae9-b73a-ce740917a653 (c6ae36bc-e7ab-4ae9-b73a-ce740917a653): created successfully
Jul 10 12:42:02 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-db124bb6-67a2-4883-813e-a0b07c8761e2 tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acc68475-a580-47b3-9153-1fc9ea5d176b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:02 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-db124bb6-67a2-4883-813e-a0b07c8761e2 tempest-VolumesActionsTest-2039201444 None] Flow 'volume_create_manager' (00b63fa2-eeda-4af7-80f1-fef1db4f9a7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:42:02 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-db124bb6-67a2-4883-813e-a0b07c8761e2 tempest-VolumesActionsTest-2039201444 None] Created volume successfully.
Jul 10 12:42:03 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-2ce4d501-4b43-44a3-a9ad-1d78107ae6cd tempest-VolumesActionsTest-322858102 None] Acquiring lock "cinder-c6ae36bc-e7ab-4ae9-b73a-ce740917a653-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:42:03 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-2ce4d501-4b43-44a3-a9ad-1d78107ae6cd tempest-VolumesActionsTest-322858102 None] Lock "cinder-c6ae36bc-e7ab-4ae9-b73a-ce740917a653-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:42:03 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-2ce4d501-4b43-44a3-a9ad-1d78107ae6cd tempest-VolumesActionsTest-322858102 None] Acquiring lock "cinder-quobyte-c6ae36bc-e7ab-4ae9-b73a-ce740917a653" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:42:03 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-2ce4d501-4b43-44a3-a9ad-1d78107ae6cd tempest-VolumesActionsTest-322858102 None] Lock "cinder-quobyte-c6ae36bc-e7ab-4ae9-b73a-ce740917a653" acquired by "delete_volume" :: waited 0.034s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:42:03 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[2518ecc2-466e-4501-ac5a-89feb16f3390]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:42:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2ce4d501-4b43-44a3-a9ad-1d78107ae6cd tempest-VolumesActionsTest-322858102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-c6ae36bc-e7ab-4ae9-b73a-ce740917a653 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:42:03 devstack sudo[92594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-c6ae36bc-e7ab-4ae9-b73a-ce740917a653
Jul 10 12:42:03 devstack sudo[92594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:42:05 devstack sudo[92594]: pam_unix(sudo:session): session closed for user root
Jul 10 12:42:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2ce4d501-4b43-44a3-a9ad-1d78107ae6cd tempest-VolumesActionsTest-322858102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-c6ae36bc-e7ab-4ae9-b73a-ce740917a653" returned: 0 in 1.455s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:42:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2ce4d501-4b43-44a3-a9ad-1d78107ae6cd tempest-VolumesActionsTest-322858102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-c6ae36bc-e7ab-4ae9-b73a-ce740917a653 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:42:05 devstack sudo[92601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-c6ae36bc-e7ab-4ae9-b73a-ce740917a653
Jul 10 12:42:05 devstack sudo[92601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:42:05 devstack sudo[92601]: pam_unix(sudo:session): session closed for user root
Jul 10 12:42:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2ce4d501-4b43-44a3-a9ad-1d78107ae6cd tempest-VolumesActionsTest-322858102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-c6ae36bc-e7ab-4ae9-b73a-ce740917a653" returned: 0 in 0.882s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:42:06 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-2ce4d501-4b43-44a3-a9ad-1d78107ae6cd tempest-VolumesActionsTest-322858102 None] Lock "cinder-quobyte-c6ae36bc-e7ab-4ae9-b73a-ce740917a653" released by "delete_volume" :: held 2.416s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:42:06 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-2ce4d501-4b43-44a3-a9ad-1d78107ae6cd tempest-VolumesActionsTest-322858102 None] Created reservations ['0af12bcf-991a-45e6-a5db-18ee45e91d55', '3d2e225c-a84b-4eac-b7a4-614376d2cb60', '7e362f70-dc83-458c-88bd-f4ee867f8b6f', 'edbc7f68-d890-454a-b1c0-393486473b09'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:42:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2ce4d501-4b43-44a3-a9ad-1d78107ae6cd tempest-VolumesActionsTest-322858102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:42:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2ce4d501-4b43-44a3-a9ad-1d78107ae6cd tempest-VolumesActionsTest-322858102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:42:06 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-2ce4d501-4b43-44a3-a9ad-1d78107ae6cd tempest-VolumesActionsTest-322858102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:42:06 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-2ce4d501-4b43-44a3-a9ad-1d78107ae6cd tempest-VolumesActionsTest-322858102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:42:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2ce4d501-4b43-44a3-a9ad-1d78107ae6cd tempest-VolumesActionsTest-322858102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:42:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2ce4d501-4b43-44a3-a9ad-1d78107ae6cd tempest-VolumesActionsTest-322858102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:42:06 devstack sudo[92605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:42:06 devstack sudo[92605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:42:07 devstack sudo[92605]: pam_unix(sudo:session): session closed for user root
Jul 10 12:42:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2ce4d501-4b43-44a3-a9ad-1d78107ae6cd tempest-VolumesActionsTest-322858102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 1.375s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:42:07 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-2ce4d501-4b43-44a3-a9ad-1d78107ae6cd tempest-VolumesActionsTest-322858102 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:42:07 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-2ce4d501-4b43-44a3-a9ad-1d78107ae6cd tempest-VolumesActionsTest-322858102 None] Deleted volume successfully.
Jul 10 12:42:07 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-2ce4d501-4b43-44a3-a9ad-1d78107ae6cd tempest-VolumesActionsTest-322858102 None] Lock "cinder-c6ae36bc-e7ab-4ae9-b73a-ce740917a653-delete_volume" released by "delete_volume" :: held 4.285s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:42:08 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-bed6c296-b808-4ec9-b951-79c3cff7b5ca tempest-VolumesActionsTest-2039201444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:42:08 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bed6c296-b808-4ec9-b951-79c3cff7b5ca tempest-VolumesActionsTest-2039201444 None] Flow 'volume_create_manager' (d09874ec-3731-4c3f-b085-a762bc652590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:42:08 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bed6c296-b808-4ec9-b951-79c3cff7b5ca tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4af3d849-0271-43ef-be02-1388d838401c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:08 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bed6c296-b808-4ec9-b951-79c3cff7b5ca tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4af3d849-0271-43ef-be02-1388d838401c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:42:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-317981020',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1f9338b-91ff-4ec8-8598-7bbc224c1457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0567b9692ffd40679f714b3c80d22784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:42:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:42:08Z,use_quota=True,user_id='569a0fb83fad48ccad5a75e2ced0c543',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:08 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bed6c296-b808-4ec9-b951-79c3cff7b5ca tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (825c0603-7d0f-4eec-bbc3-9764415b7630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:08 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bed6c296-b808-4ec9-b951-79c3cff7b5ca tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (825c0603-7d0f-4eec-bbc3-9764415b7630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:08 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bed6c296-b808-4ec9-b951-79c3cff7b5ca tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c651a99d-c518-40e3-aa79-6179ee82623b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:08 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bed6c296-b808-4ec9-b951-79c3cff7b5ca tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c651a99d-c518-40e3-aa79-6179ee82623b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1f9338b-91ff-4ec8-8598-7bbc224c1457', 'volume_name': 'volume-c1f9338b-91ff-4ec8-8598-7bbc224c1457', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:08 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bed6c296-b808-4ec9-b951-79c3cff7b5ca tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (046dc316-0d57-4863-a9de-3c7690fe12c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:08 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bed6c296-b808-4ec9-b951-79c3cff7b5ca tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (046dc316-0d57-4863-a9de-3c7690fe12c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:08 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bed6c296-b808-4ec9-b951-79c3cff7b5ca tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af29c26e-864c-4bab-b85d-e1974527139c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:08 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-bed6c296-b808-4ec9-b951-79c3cff7b5ca tempest-VolumesActionsTest-2039201444 None] Volume c1f9338b-91ff-4ec8-8598-7bbc224c1457: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1f9338b-91ff-4ec8-8598-7bbc224c1457', 'volume_size': 1}
Jul 10 12:42:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-bed6c296-b808-4ec9-b951-79c3cff7b5ca tempest-VolumesActionsTest-2039201444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:42:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-bed6c296-b808-4ec9-b951-79c3cff7b5ca tempest-VolumesActionsTest-2039201444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:42:08 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-bed6c296-b808-4ec9-b951-79c3cff7b5ca tempest-VolumesActionsTest-2039201444 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:42:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-317981020',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1f9338b-91ff-4ec8-8598-7bbc224c1457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0567b9692ffd40679f714b3c80d22784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:42:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:42:08Z,use_quota=True,user_id='569a0fb83fad48ccad5a75e2ced0c543',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:42:08 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-bed6c296-b808-4ec9-b951-79c3cff7b5ca tempest-VolumesActionsTest-2039201444 None] Creating volume c1f9338b-91ff-4ec8-8598-7bbc224c1457 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:42:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-bed6c296-b808-4ec9-b951-79c3cff7b5ca tempest-VolumesActionsTest-2039201444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:42:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-bed6c296-b808-4ec9-b951-79c3cff7b5ca tempest-VolumesActionsTest-2039201444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:42:08 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-bed6c296-b808-4ec9-b951-79c3cff7b5ca tempest-VolumesActionsTest-2039201444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:42:08 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-bed6c296-b808-4ec9-b951-79c3cff7b5ca tempest-VolumesActionsTest-2039201444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:42:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-bed6c296-b808-4ec9-b951-79c3cff7b5ca tempest-VolumesActionsTest-2039201444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:42:08 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-bed6c296-b808-4ec9-b951-79c3cff7b5ca tempest-VolumesActionsTest-2039201444 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:42:08 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-bed6c296-b808-4ec9-b951-79c3cff7b5ca tempest-VolumesActionsTest-2039201444 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:42:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-bed6c296-b808-4ec9-b951-79c3cff7b5ca tempest-VolumesActionsTest-2039201444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-c1f9338b-91ff-4ec8-8598-7bbc224c1457 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:42:08 devstack sudo[92627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-c1f9338b-91ff-4ec8-8598-7bbc224c1457 1073741824
Jul 10 12:42:08 devstack sudo[92627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:42:10 devstack sudo[92627]: pam_unix(sudo:session): session closed for user root
Jul 10 12:42:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-bed6c296-b808-4ec9-b951-79c3cff7b5ca tempest-VolumesActionsTest-2039201444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-c1f9338b-91ff-4ec8-8598-7bbc224c1457 1073741824" returned: 0 in 1.504s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:42:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-bed6c296-b808-4ec9-b951-79c3cff7b5ca tempest-VolumesActionsTest-2039201444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-c1f9338b-91ff-4ec8-8598-7bbc224c1457 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:42:10 devstack sudo[92643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-c1f9338b-91ff-4ec8-8598-7bbc224c1457
Jul 10 12:42:10 devstack sudo[92643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:42:10 devstack sudo[92643]: pam_unix(sudo:session): session closed for user root
Jul 10 12:42:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-bed6c296-b808-4ec9-b951-79c3cff7b5ca tempest-VolumesActionsTest-2039201444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-c1f9338b-91ff-4ec8-8598-7bbc224c1457" returned: 0 in 0.698s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:42:10 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-bed6c296-b808-4ec9-b951-79c3cff7b5ca tempest-VolumesActionsTest-2039201444 None] <== create_volume: return (2324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:42:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-bed6c296-b808-4ec9-b951-79c3cff7b5ca tempest-VolumesActionsTest-2039201444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.336s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:42:10 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bed6c296-b808-4ec9-b951-79c3cff7b5ca tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af29c26e-864c-4bab-b85d-e1974527139c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1f9338b-91ff-4ec8-8598-7bbc224c1457', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:10 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bed6c296-b808-4ec9-b951-79c3cff7b5ca tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1e1c550-96d0-490a-95f5-b092f11b44a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:10 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-bed6c296-b808-4ec9-b951-79c3cff7b5ca tempest-VolumesActionsTest-2039201444 None] Volume volume-c1f9338b-91ff-4ec8-8598-7bbc224c1457 (c1f9338b-91ff-4ec8-8598-7bbc224c1457): created successfully
Jul 10 12:42:10 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bed6c296-b808-4ec9-b951-79c3cff7b5ca tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1e1c550-96d0-490a-95f5-b092f11b44a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:10 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bed6c296-b808-4ec9-b951-79c3cff7b5ca tempest-VolumesActionsTest-2039201444 None] Flow 'volume_create_manager' (d09874ec-3731-4c3f-b085-a762bc652590) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:42:10 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-bed6c296-b808-4ec9-b951-79c3cff7b5ca tempest-VolumesActionsTest-2039201444 None] Created volume successfully.
Jul 10 12:42:11 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-989ab316-2017-4a52-b386-2d4330cefa14 tempest-VolumesActionsTest-322858102 None] Acquiring lock "cinder-c1f9338b-91ff-4ec8-8598-7bbc224c1457-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:42:11 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-989ab316-2017-4a52-b386-2d4330cefa14 tempest-VolumesActionsTest-322858102 None] Lock "cinder-c1f9338b-91ff-4ec8-8598-7bbc224c1457-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:42:11 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-989ab316-2017-4a52-b386-2d4330cefa14 tempest-VolumesActionsTest-322858102 None] Acquiring lock "cinder-quobyte-c1f9338b-91ff-4ec8-8598-7bbc224c1457" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:42:11 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-989ab316-2017-4a52-b386-2d4330cefa14 tempest-VolumesActionsTest-322858102 None] Lock "cinder-quobyte-c1f9338b-91ff-4ec8-8598-7bbc224c1457" acquired by "delete_volume" :: waited 0.017s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:42:11 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[03116e46-4515-449b-9b6f-557637878e5e]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:42:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-989ab316-2017-4a52-b386-2d4330cefa14 tempest-VolumesActionsTest-322858102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-c1f9338b-91ff-4ec8-8598-7bbc224c1457 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:42:11 devstack sudo[92647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-c1f9338b-91ff-4ec8-8598-7bbc224c1457
Jul 10 12:42:11 devstack sudo[92647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:42:12 devstack sudo[92647]: pam_unix(sudo:session): session closed for user root
Jul 10 12:42:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-989ab316-2017-4a52-b386-2d4330cefa14 tempest-VolumesActionsTest-322858102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-c1f9338b-91ff-4ec8-8598-7bbc224c1457" returned: 0 in 0.801s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:42:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-989ab316-2017-4a52-b386-2d4330cefa14 tempest-VolumesActionsTest-322858102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-c1f9338b-91ff-4ec8-8598-7bbc224c1457 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:42:12 devstack sudo[92652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-c1f9338b-91ff-4ec8-8598-7bbc224c1457
Jul 10 12:42:12 devstack sudo[92652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:42:12 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:42:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:42:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:42:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:42:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:42:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:42:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:42:12 devstack sudo[92654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:42:12 devstack sudo[92654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:42:13 devstack sudo[92652]: pam_unix(sudo:session): session closed for user root
Jul 10 12:42:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-989ab316-2017-4a52-b386-2d4330cefa14 tempest-VolumesActionsTest-322858102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-c1f9338b-91ff-4ec8-8598-7bbc224c1457" returned: 0 in 0.690s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:42:13 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-989ab316-2017-4a52-b386-2d4330cefa14 tempest-VolumesActionsTest-322858102 None] Lock "cinder-quobyte-c1f9338b-91ff-4ec8-8598-7bbc224c1457" released by "delete_volume" :: held 1.535s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:42:13 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-989ab316-2017-4a52-b386-2d4330cefa14 tempest-VolumesActionsTest-322858102 None] Created reservations ['80523158-4c30-49ce-9fb3-ee49b74574dc', 'f07c5ca4-a16e-459b-9616-856fccae80a0', 'd116bb56-13cf-43f0-8e1a-f460565d40b5', '880cb749-954b-461e-ad51-c898ff6f0e81'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:42:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-989ab316-2017-4a52-b386-2d4330cefa14 tempest-VolumesActionsTest-322858102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:42:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-989ab316-2017-4a52-b386-2d4330cefa14 tempest-VolumesActionsTest-322858102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:42:13 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-989ab316-2017-4a52-b386-2d4330cefa14 tempest-VolumesActionsTest-322858102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:42:13 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-989ab316-2017-4a52-b386-2d4330cefa14 tempest-VolumesActionsTest-322858102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:42:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-989ab316-2017-4a52-b386-2d4330cefa14 tempest-VolumesActionsTest-322858102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:42:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-989ab316-2017-4a52-b386-2d4330cefa14 tempest-VolumesActionsTest-322858102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:42:13 devstack sudo[92657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:42:13 devstack sudo[92657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:42:13 devstack sudo[92654]: pam_unix(sudo:session): session closed for user root
Jul 10 12:42:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.741s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:42:13 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:42:14 devstack sudo[92657]: pam_unix(sudo:session): session closed for user root
Jul 10 12:42:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-989ab316-2017-4a52-b386-2d4330cefa14 tempest-VolumesActionsTest-322858102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.761s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:42:14 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-989ab316-2017-4a52-b386-2d4330cefa14 tempest-VolumesActionsTest-322858102 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:42:14 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-989ab316-2017-4a52-b386-2d4330cefa14 tempest-VolumesActionsTest-322858102 None] Deleted volume successfully.
Jul 10 12:42:14 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-989ab316-2017-4a52-b386-2d4330cefa14 tempest-VolumesActionsTest-322858102 None] Lock "cinder-c1f9338b-91ff-4ec8-8598-7bbc224c1457-delete_volume" released by "delete_volume" :: held 2.537s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:42:14 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-12ec53f2-9978-4c69-a1b3-42d0b2da16be tempest-VolumesActionsTest-2039201444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:42:14 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-12ec53f2-9978-4c69-a1b3-42d0b2da16be tempest-VolumesActionsTest-2039201444 None] Flow 'volume_create_manager' (5c6bb8db-db09-4131-a22c-3cd9bfd14622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:42:14 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-12ec53f2-9978-4c69-a1b3-42d0b2da16be tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bae202a-dab2-48f0-8edc-964b8c352858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:14 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-12ec53f2-9978-4c69-a1b3-42d0b2da16be tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bae202a-dab2-48f0-8edc-964b8c352858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:42:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1753256431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24f378a1-e0cb-4310-87b8-1286ef7f4384,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0567b9692ffd40679f714b3c80d22784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:42:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:42:14Z,use_quota=True,user_id='569a0fb83fad48ccad5a75e2ced0c543',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:14 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-12ec53f2-9978-4c69-a1b3-42d0b2da16be tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a63c24d7-d0e9-4c34-bceb-301779257a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:14 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-12ec53f2-9978-4c69-a1b3-42d0b2da16be tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a63c24d7-d0e9-4c34-bceb-301779257a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:14 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-12ec53f2-9978-4c69-a1b3-42d0b2da16be tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aeea9b5-eda8-4b9f-89e8-1ca7f91155cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:14 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-12ec53f2-9978-4c69-a1b3-42d0b2da16be tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aeea9b5-eda8-4b9f-89e8-1ca7f91155cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24f378a1-e0cb-4310-87b8-1286ef7f4384', 'volume_name': 'volume-24f378a1-e0cb-4310-87b8-1286ef7f4384', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:14 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-12ec53f2-9978-4c69-a1b3-42d0b2da16be tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d23ac6af-826f-4882-ad78-07bf975d44ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:14 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-12ec53f2-9978-4c69-a1b3-42d0b2da16be tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d23ac6af-826f-4882-ad78-07bf975d44ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:14 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-12ec53f2-9978-4c69-a1b3-42d0b2da16be tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a24ca90-e89c-46e0-9d91-b1cdc17ef9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:14 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-12ec53f2-9978-4c69-a1b3-42d0b2da16be tempest-VolumesActionsTest-2039201444 None] Volume 24f378a1-e0cb-4310-87b8-1286ef7f4384: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24f378a1-e0cb-4310-87b8-1286ef7f4384', 'volume_size': 1}
Jul 10 12:42:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-12ec53f2-9978-4c69-a1b3-42d0b2da16be tempest-VolumesActionsTest-2039201444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:42:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-12ec53f2-9978-4c69-a1b3-42d0b2da16be tempest-VolumesActionsTest-2039201444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:42:14 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-12ec53f2-9978-4c69-a1b3-42d0b2da16be tempest-VolumesActionsTest-2039201444 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:42:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1753256431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24f378a1-e0cb-4310-87b8-1286ef7f4384,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0567b9692ffd40679f714b3c80d22784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:42:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:42:14Z,use_quota=True,user_id='569a0fb83fad48ccad5a75e2ced0c543',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:42:14 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-12ec53f2-9978-4c69-a1b3-42d0b2da16be tempest-VolumesActionsTest-2039201444 None] Creating volume 24f378a1-e0cb-4310-87b8-1286ef7f4384 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:42:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-12ec53f2-9978-4c69-a1b3-42d0b2da16be tempest-VolumesActionsTest-2039201444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:42:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-12ec53f2-9978-4c69-a1b3-42d0b2da16be tempest-VolumesActionsTest-2039201444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:42:14 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-12ec53f2-9978-4c69-a1b3-42d0b2da16be tempest-VolumesActionsTest-2039201444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:42:14 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-12ec53f2-9978-4c69-a1b3-42d0b2da16be tempest-VolumesActionsTest-2039201444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:42:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-12ec53f2-9978-4c69-a1b3-42d0b2da16be tempest-VolumesActionsTest-2039201444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:42:14 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-12ec53f2-9978-4c69-a1b3-42d0b2da16be tempest-VolumesActionsTest-2039201444 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:42:14 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-12ec53f2-9978-4c69-a1b3-42d0b2da16be tempest-VolumesActionsTest-2039201444 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:42:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-12ec53f2-9978-4c69-a1b3-42d0b2da16be tempest-VolumesActionsTest-2039201444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-24f378a1-e0cb-4310-87b8-1286ef7f4384 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:42:14 devstack sudo[92661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-24f378a1-e0cb-4310-87b8-1286ef7f4384 1073741824
Jul 10 12:42:14 devstack sudo[92661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:42:15 devstack sudo[92661]: pam_unix(sudo:session): session closed for user root
Jul 10 12:42:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-12ec53f2-9978-4c69-a1b3-42d0b2da16be tempest-VolumesActionsTest-2039201444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-24f378a1-e0cb-4310-87b8-1286ef7f4384 1073741824" returned: 0 in 1.003s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:42:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-12ec53f2-9978-4c69-a1b3-42d0b2da16be tempest-VolumesActionsTest-2039201444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-24f378a1-e0cb-4310-87b8-1286ef7f4384 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:42:15 devstack sudo[92701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-24f378a1-e0cb-4310-87b8-1286ef7f4384
Jul 10 12:42:15 devstack sudo[92701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:42:16 devstack sudo[92701]: pam_unix(sudo:session): session closed for user root
Jul 10 12:42:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-12ec53f2-9978-4c69-a1b3-42d0b2da16be tempest-VolumesActionsTest-2039201444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-24f378a1-e0cb-4310-87b8-1286ef7f4384" returned: 0 in 1.034s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:42:16 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-12ec53f2-9978-4c69-a1b3-42d0b2da16be tempest-VolumesActionsTest-2039201444 None] <== create_volume: return (2138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:42:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-12ec53f2-9978-4c69-a1b3-42d0b2da16be tempest-VolumesActionsTest-2039201444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.140s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:42:16 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-12ec53f2-9978-4c69-a1b3-42d0b2da16be tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a24ca90-e89c-46e0-9d91-b1cdc17ef9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24f378a1-e0cb-4310-87b8-1286ef7f4384', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:16 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-12ec53f2-9978-4c69-a1b3-42d0b2da16be tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf63766e-5fb5-4238-8a45-e1c880889a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:16 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-12ec53f2-9978-4c69-a1b3-42d0b2da16be tempest-VolumesActionsTest-2039201444 None] Volume volume-24f378a1-e0cb-4310-87b8-1286ef7f4384 (24f378a1-e0cb-4310-87b8-1286ef7f4384): created successfully
Jul 10 12:42:16 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-12ec53f2-9978-4c69-a1b3-42d0b2da16be tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf63766e-5fb5-4238-8a45-e1c880889a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:16 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-12ec53f2-9978-4c69-a1b3-42d0b2da16be tempest-VolumesActionsTest-2039201444 None] Flow 'volume_create_manager' (5c6bb8db-db09-4131-a22c-3cd9bfd14622) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:42:16 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-12ec53f2-9978-4c69-a1b3-42d0b2da16be tempest-VolumesActionsTest-2039201444 None] Created volume successfully.
Jul 10 12:42:17 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-a4f1b60f-041d-45f9-9695-e33853973ff1 tempest-VolumesActionsTest-322858102 None] Acquiring lock "cinder-24f378a1-e0cb-4310-87b8-1286ef7f4384-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:42:17 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-a4f1b60f-041d-45f9-9695-e33853973ff1 tempest-VolumesActionsTest-322858102 None] Lock "cinder-24f378a1-e0cb-4310-87b8-1286ef7f4384-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:42:17 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-a4f1b60f-041d-45f9-9695-e33853973ff1 tempest-VolumesActionsTest-322858102 None] Acquiring lock "cinder-quobyte-24f378a1-e0cb-4310-87b8-1286ef7f4384" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:42:17 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-a4f1b60f-041d-45f9-9695-e33853973ff1 tempest-VolumesActionsTest-322858102 None] Lock "cinder-quobyte-24f378a1-e0cb-4310-87b8-1286ef7f4384" acquired by "delete_volume" :: waited 0.019s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:42:17 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d909fcfc-a22d-4cf2-9a72-3e80e926110a]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:42:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a4f1b60f-041d-45f9-9695-e33853973ff1 tempest-VolumesActionsTest-322858102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-24f378a1-e0cb-4310-87b8-1286ef7f4384 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:42:18 devstack sudo[92707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-24f378a1-e0cb-4310-87b8-1286ef7f4384
Jul 10 12:42:18 devstack sudo[92707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:42:18 devstack sudo[92707]: pam_unix(sudo:session): session closed for user root
Jul 10 12:42:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a4f1b60f-041d-45f9-9695-e33853973ff1 tempest-VolumesActionsTest-322858102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-24f378a1-e0cb-4310-87b8-1286ef7f4384" returned: 0 in 0.943s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:42:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a4f1b60f-041d-45f9-9695-e33853973ff1 tempest-VolumesActionsTest-322858102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-24f378a1-e0cb-4310-87b8-1286ef7f4384 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:42:18 devstack sudo[92736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-24f378a1-e0cb-4310-87b8-1286ef7f4384
Jul 10 12:42:18 devstack sudo[92736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:42:19 devstack sudo[92736]: pam_unix(sudo:session): session closed for user root
Jul 10 12:42:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a4f1b60f-041d-45f9-9695-e33853973ff1 tempest-VolumesActionsTest-322858102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-24f378a1-e0cb-4310-87b8-1286ef7f4384" returned: 0 in 0.723s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:42:19 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-a4f1b60f-041d-45f9-9695-e33853973ff1 tempest-VolumesActionsTest-322858102 None] Lock "cinder-quobyte-24f378a1-e0cb-4310-87b8-1286ef7f4384" released by "delete_volume" :: held 1.717s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:42:19 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-a4f1b60f-041d-45f9-9695-e33853973ff1 tempest-VolumesActionsTest-322858102 None] Created reservations ['845b700a-1b33-4776-b594-059bf39f15e0', '792aef0f-3a7d-415a-9316-af7f0ee26cce', '3c624bf5-3a8b-41bd-b354-a6781e159e05', '087afc45-9929-4ea1-80be-a5c08b062328'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:42:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a4f1b60f-041d-45f9-9695-e33853973ff1 tempest-VolumesActionsTest-322858102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:42:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a4f1b60f-041d-45f9-9695-e33853973ff1 tempest-VolumesActionsTest-322858102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:42:19 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-a4f1b60f-041d-45f9-9695-e33853973ff1 tempest-VolumesActionsTest-322858102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:42:19 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-a4f1b60f-041d-45f9-9695-e33853973ff1 tempest-VolumesActionsTest-322858102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:42:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a4f1b60f-041d-45f9-9695-e33853973ff1 tempest-VolumesActionsTest-322858102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:42:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a4f1b60f-041d-45f9-9695-e33853973ff1 tempest-VolumesActionsTest-322858102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:42:19 devstack sudo[92740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:42:19 devstack sudo[92740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:42:20 devstack sudo[92740]: pam_unix(sudo:session): session closed for user root
Jul 10 12:42:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a4f1b60f-041d-45f9-9695-e33853973ff1 tempest-VolumesActionsTest-322858102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.691s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:42:20 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-a4f1b60f-041d-45f9-9695-e33853973ff1 tempest-VolumesActionsTest-322858102 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:42:20 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-a4f1b60f-041d-45f9-9695-e33853973ff1 tempest-VolumesActionsTest-322858102 None] Deleted volume successfully.
Jul 10 12:42:20 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-a4f1b60f-041d-45f9-9695-e33853973ff1 tempest-VolumesActionsTest-322858102 None] Lock "cinder-24f378a1-e0cb-4310-87b8-1286ef7f4384-delete_volume" released by "delete_volume" :: held 2.647s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:42:20 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-23ceb23b-f995-452d-af5d-a8a90dedb878 tempest-VolumesActionsTest-2039201444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:42:20 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-23ceb23b-f995-452d-af5d-a8a90dedb878 tempest-VolumesActionsTest-2039201444 None] Flow 'volume_create_manager' (19d9cf44-2371-446a-a674-a6c1b9209799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:42:20 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-23ceb23b-f995-452d-af5d-a8a90dedb878 tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (459b6518-3b58-4d88-a9a3-e294dc2ff0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:20 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-23ceb23b-f995-452d-af5d-a8a90dedb878 tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (459b6518-3b58-4d88-a9a3-e294dc2ff0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:42:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1645537897',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1bd5d76-952d-4c87-966d-a9197f1ee553,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0567b9692ffd40679f714b3c80d22784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:42:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:42:21Z,use_quota=True,user_id='569a0fb83fad48ccad5a75e2ced0c543',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:20 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-23ceb23b-f995-452d-af5d-a8a90dedb878 tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54d1b051-c86c-42eb-b1da-d64eba582e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:20 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-23ceb23b-f995-452d-af5d-a8a90dedb878 tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54d1b051-c86c-42eb-b1da-d64eba582e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:20 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-23ceb23b-f995-452d-af5d-a8a90dedb878 tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (380fc215-7aa0-44d5-8d0f-80633665fe06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:20 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-23ceb23b-f995-452d-af5d-a8a90dedb878 tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (380fc215-7aa0-44d5-8d0f-80633665fe06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1bd5d76-952d-4c87-966d-a9197f1ee553', 'volume_name': 'volume-e1bd5d76-952d-4c87-966d-a9197f1ee553', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:20 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-23ceb23b-f995-452d-af5d-a8a90dedb878 tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24cc776e-ed40-498b-a188-2279e1fbd258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:20 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-23ceb23b-f995-452d-af5d-a8a90dedb878 tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24cc776e-ed40-498b-a188-2279e1fbd258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:20 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-23ceb23b-f995-452d-af5d-a8a90dedb878 tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c069fdc0-5ce3-4c8c-b7dd-b9f4baea555c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:20 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-23ceb23b-f995-452d-af5d-a8a90dedb878 tempest-VolumesActionsTest-2039201444 None] Volume e1bd5d76-952d-4c87-966d-a9197f1ee553: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1bd5d76-952d-4c87-966d-a9197f1ee553', 'volume_size': 1}
Jul 10 12:42:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-23ceb23b-f995-452d-af5d-a8a90dedb878 tempest-VolumesActionsTest-2039201444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:42:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-23ceb23b-f995-452d-af5d-a8a90dedb878 tempest-VolumesActionsTest-2039201444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:42:20 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-23ceb23b-f995-452d-af5d-a8a90dedb878 tempest-VolumesActionsTest-2039201444 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:42:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1645537897',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1bd5d76-952d-4c87-966d-a9197f1ee553,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0567b9692ffd40679f714b3c80d22784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:42:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:42:21Z,use_quota=True,user_id='569a0fb83fad48ccad5a75e2ced0c543',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:42:20 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-23ceb23b-f995-452d-af5d-a8a90dedb878 tempest-VolumesActionsTest-2039201444 None] Creating volume e1bd5d76-952d-4c87-966d-a9197f1ee553 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:42:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-23ceb23b-f995-452d-af5d-a8a90dedb878 tempest-VolumesActionsTest-2039201444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:42:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-23ceb23b-f995-452d-af5d-a8a90dedb878 tempest-VolumesActionsTest-2039201444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:42:20 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-23ceb23b-f995-452d-af5d-a8a90dedb878 tempest-VolumesActionsTest-2039201444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:42:20 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-23ceb23b-f995-452d-af5d-a8a90dedb878 tempest-VolumesActionsTest-2039201444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:42:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-23ceb23b-f995-452d-af5d-a8a90dedb878 tempest-VolumesActionsTest-2039201444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:42:20 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-23ceb23b-f995-452d-af5d-a8a90dedb878 tempest-VolumesActionsTest-2039201444 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:42:20 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-23ceb23b-f995-452d-af5d-a8a90dedb878 tempest-VolumesActionsTest-2039201444 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:42:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-23ceb23b-f995-452d-af5d-a8a90dedb878 tempest-VolumesActionsTest-2039201444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1bd5d76-952d-4c87-966d-a9197f1ee553 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:42:20 devstack sudo[92743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1bd5d76-952d-4c87-966d-a9197f1ee553 1073741824
Jul 10 12:42:20 devstack sudo[92743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:42:21 devstack sudo[92743]: pam_unix(sudo:session): session closed for user root
Jul 10 12:42:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-23ceb23b-f995-452d-af5d-a8a90dedb878 tempest-VolumesActionsTest-2039201444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1bd5d76-952d-4c87-966d-a9197f1ee553 1073741824" returned: 0 in 0.861s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:42:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-23ceb23b-f995-452d-af5d-a8a90dedb878 tempest-VolumesActionsTest-2039201444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1bd5d76-952d-4c87-966d-a9197f1ee553 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:42:21 devstack sudo[92749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1bd5d76-952d-4c87-966d-a9197f1ee553
Jul 10 12:42:21 devstack sudo[92749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:42:22 devstack sudo[92749]: pam_unix(sudo:session): session closed for user root
Jul 10 12:42:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-23ceb23b-f995-452d-af5d-a8a90dedb878 tempest-VolumesActionsTest-2039201444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1bd5d76-952d-4c87-966d-a9197f1ee553" returned: 0 in 0.655s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:42:22 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-23ceb23b-f995-452d-af5d-a8a90dedb878 tempest-VolumesActionsTest-2039201444 None] <== create_volume: return (1560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:42:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-23ceb23b-f995-452d-af5d-a8a90dedb878 tempest-VolumesActionsTest-2039201444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.563s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:42:22 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-23ceb23b-f995-452d-af5d-a8a90dedb878 tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c069fdc0-5ce3-4c8c-b7dd-b9f4baea555c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1bd5d76-952d-4c87-966d-a9197f1ee553', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:22 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-23ceb23b-f995-452d-af5d-a8a90dedb878 tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62c0f33d-27ed-4cbd-85bd-4a7a339ccfa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:22 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-23ceb23b-f995-452d-af5d-a8a90dedb878 tempest-VolumesActionsTest-2039201444 None] Volume volume-e1bd5d76-952d-4c87-966d-a9197f1ee553 (e1bd5d76-952d-4c87-966d-a9197f1ee553): created successfully
Jul 10 12:42:22 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-23ceb23b-f995-452d-af5d-a8a90dedb878 tempest-VolumesActionsTest-2039201444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62c0f33d-27ed-4cbd-85bd-4a7a339ccfa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:22 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-23ceb23b-f995-452d-af5d-a8a90dedb878 tempest-VolumesActionsTest-2039201444 None] Flow 'volume_create_manager' (19d9cf44-2371-446a-a674-a6c1b9209799) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:42:22 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-23ceb23b-f995-452d-af5d-a8a90dedb878 tempest-VolumesActionsTest-2039201444 None] Created volume successfully.
Jul 10 12:42:22 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-7bb854cf-0a2d-4799-a6d0-bc7c996595f7 tempest-GroupsV320Test-836340176 None] Group tempest-GroupsV320Test-Group-1574444444: creating
Jul 10 12:42:22 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-7bb854cf-0a2d-4799-a6d0-bc7c996595f7 tempest-GroupsV320Test-836340176 None] Group tempest-GroupsV320Test-Group-1574444444: created successfully
Jul 10 12:42:22 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-7bb854cf-0a2d-4799-a6d0-bc7c996595f7 tempest-GroupsV320Test-836340176 None] Create group completed successfully.
Jul 10 12:42:23 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-36daf1ec-d623-4be1-a7e1-36e28067e607 tempest-VolumesActionsTest-2039201444 None] Acquiring lock "cinder-e1bd5d76-952d-4c87-966d-a9197f1ee553-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:42:23 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-36daf1ec-d623-4be1-a7e1-36e28067e607 tempest-VolumesActionsTest-2039201444 None] Lock "cinder-e1bd5d76-952d-4c87-966d-a9197f1ee553-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:42:23 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:SELECT=60,cinder:UPDATE=69,cinder:DELETE=8,cinder:INSERT=16 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:42:23 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-36daf1ec-d623-4be1-a7e1-36e28067e607 tempest-VolumesActionsTest-2039201444 None] Acquiring lock "cinder-quobyte-e1bd5d76-952d-4c87-966d-a9197f1ee553" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:42:23 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-36daf1ec-d623-4be1-a7e1-36e28067e607 tempest-VolumesActionsTest-2039201444 None] Lock "cinder-quobyte-e1bd5d76-952d-4c87-966d-a9197f1ee553" acquired by "delete_volume" :: waited 0.017s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:42:23 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[13797449-e150-4940-8b02-8823f27beb42]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:42:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-36daf1ec-d623-4be1-a7e1-36e28067e607 tempest-VolumesActionsTest-2039201444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1bd5d76-952d-4c87-966d-a9197f1ee553 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:42:23 devstack sudo[92766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1bd5d76-952d-4c87-966d-a9197f1ee553
Jul 10 12:42:23 devstack sudo[92766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:42:24 devstack sudo[92766]: pam_unix(sudo:session): session closed for user root
Jul 10 12:42:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-36daf1ec-d623-4be1-a7e1-36e28067e607 tempest-VolumesActionsTest-2039201444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1bd5d76-952d-4c87-966d-a9197f1ee553" returned: 0 in 0.866s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:42:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-36daf1ec-d623-4be1-a7e1-36e28067e607 tempest-VolumesActionsTest-2039201444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1bd5d76-952d-4c87-966d-a9197f1ee553 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:42:24 devstack sudo[92771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1bd5d76-952d-4c87-966d-a9197f1ee553
Jul 10 12:42:24 devstack sudo[92771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:42:24 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-ce279d3b-8c92-48e0-b870-80f8c473b8f7 tempest-GroupsV320Test-836340176 None] Created reservations ['f1646a42-2f9a-4c2c-a272-0e5f4c89cfda'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:42:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ce279d3b-8c92-48e0-b870-80f8c473b8f7 tempest-GroupsV320Test-836340176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:42:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ce279d3b-8c92-48e0-b870-80f8c473b8f7 tempest-GroupsV320Test-836340176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:42:24 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-ce279d3b-8c92-48e0-b870-80f8c473b8f7 tempest-GroupsV320Test-836340176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:42:24 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-ce279d3b-8c92-48e0-b870-80f8c473b8f7 tempest-GroupsV320Test-836340176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:42:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ce279d3b-8c92-48e0-b870-80f8c473b8f7 tempest-GroupsV320Test-836340176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:42:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ce279d3b-8c92-48e0-b870-80f8c473b8f7 tempest-GroupsV320Test-836340176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:42:24 devstack sudo[92773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:42:24 devstack sudo[92773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:42:25 devstack sudo[92771]: pam_unix(sudo:session): session closed for user root
Jul 10 12:42:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-36daf1ec-d623-4be1-a7e1-36e28067e607 tempest-VolumesActionsTest-2039201444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1bd5d76-952d-4c87-966d-a9197f1ee553" returned: 0 in 0.761s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:42:25 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-36daf1ec-d623-4be1-a7e1-36e28067e607 tempest-VolumesActionsTest-2039201444 None] Lock "cinder-quobyte-e1bd5d76-952d-4c87-966d-a9197f1ee553" released by "delete_volume" :: held 1.682s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:42:25 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:SELECT=57,cinder:UPDATE=84,cinder:INSERT=17,cinder:DELETE=5 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:42:25 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-36daf1ec-d623-4be1-a7e1-36e28067e607 tempest-VolumesActionsTest-2039201444 None] Created reservations ['3caba049-5121-4c84-b6b5-3729c3fac7aa', '2d88fab7-e595-4438-af72-57f8bb50827d', '59aef779-5eff-47cb-8169-c15e5e5954f4', 'eff1299c-a060-49e3-93ea-e0b8518433c7'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:42:25 devstack sudo[92773]: pam_unix(sudo:session): session closed for user root
Jul 10 12:42:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ce279d3b-8c92-48e0-b870-80f8c473b8f7 tempest-GroupsV320Test-836340176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.707s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:42:25 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-ce279d3b-8c92-48e0-b870-80f8c473b8f7 tempest-GroupsV320Test-836340176 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:42:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-36daf1ec-d623-4be1-a7e1-36e28067e607 tempest-VolumesActionsTest-2039201444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:42:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-36daf1ec-d623-4be1-a7e1-36e28067e607 tempest-VolumesActionsTest-2039201444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:42:25 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-36daf1ec-d623-4be1-a7e1-36e28067e607 tempest-VolumesActionsTest-2039201444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:42:25 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-36daf1ec-d623-4be1-a7e1-36e28067e607 tempest-VolumesActionsTest-2039201444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:42:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-36daf1ec-d623-4be1-a7e1-36e28067e607 tempest-VolumesActionsTest-2039201444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:42:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-36daf1ec-d623-4be1-a7e1-36e28067e607 tempest-VolumesActionsTest-2039201444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:42:25 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-ce279d3b-8c92-48e0-b870-80f8c473b8f7 tempest-GroupsV320Test-836340176 None] Delete group completed successfully.
Jul 10 12:42:25 devstack sudo[92777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:42:25 devstack sudo[92777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:42:26 devstack sudo[92777]: pam_unix(sudo:session): session closed for user root
Jul 10 12:42:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-36daf1ec-d623-4be1-a7e1-36e28067e607 tempest-VolumesActionsTest-2039201444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.739s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:42:26 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-36daf1ec-d623-4be1-a7e1-36e28067e607 tempest-VolumesActionsTest-2039201444 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:42:26 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-36daf1ec-d623-4be1-a7e1-36e28067e607 tempest-VolumesActionsTest-2039201444 None] Deleted volume successfully.
Jul 10 12:42:26 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-36daf1ec-d623-4be1-a7e1-36e28067e607 tempest-VolumesActionsTest-2039201444 None] Lock "cinder-e1bd5d76-952d-4c87-966d-a9197f1ee553-delete_volume" released by "delete_volume" :: held 2.834s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:42:28 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-436c1833-3cd1-48ca-b067-b64bf2073db9 tempest-AttachVolumeTestJSON-147786180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:42:28 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-436c1833-3cd1-48ca-b067-b64bf2073db9 tempest-AttachVolumeTestJSON-147786180 None] Flow 'volume_create_manager' (e84f5126-7402-4b18-80ae-30e3b15bbfd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:42:28 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-436c1833-3cd1-48ca-b067-b64bf2073db9 tempest-AttachVolumeTestJSON-147786180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2834d581-3cff-41d8-a94e-93eed353d27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:28 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-436c1833-3cd1-48ca-b067-b64bf2073db9 tempest-AttachVolumeTestJSON-147786180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2834d581-3cff-41d8-a94e-93eed353d27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:42:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1461663797',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05610419-79c8-4382-9398-7b2a419247fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a10ae46bd4e462db6a43d01ae1754c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:42:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:42:29Z,use_quota=True,user_id='a40bbe2f79f54b509b2c9fa1400ea628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:28 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-436c1833-3cd1-48ca-b067-b64bf2073db9 tempest-AttachVolumeTestJSON-147786180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c27468b6-fe02-4f8f-8dfc-412820d1a123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:28 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-436c1833-3cd1-48ca-b067-b64bf2073db9 tempest-AttachVolumeTestJSON-147786180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c27468b6-fe02-4f8f-8dfc-412820d1a123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:28 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-436c1833-3cd1-48ca-b067-b64bf2073db9 tempest-AttachVolumeTestJSON-147786180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19f44162-4a3c-410a-a18b-79b75edcf0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:28 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-436c1833-3cd1-48ca-b067-b64bf2073db9 tempest-AttachVolumeTestJSON-147786180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19f44162-4a3c-410a-a18b-79b75edcf0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05610419-79c8-4382-9398-7b2a419247fe', 'volume_name': 'volume-05610419-79c8-4382-9398-7b2a419247fe', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:28 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-436c1833-3cd1-48ca-b067-b64bf2073db9 tempest-AttachVolumeTestJSON-147786180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09cda654-ea96-4c11-ad3a-9c1c2b999682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:28 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-436c1833-3cd1-48ca-b067-b64bf2073db9 tempest-AttachVolumeTestJSON-147786180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09cda654-ea96-4c11-ad3a-9c1c2b999682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:28 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-436c1833-3cd1-48ca-b067-b64bf2073db9 tempest-AttachVolumeTestJSON-147786180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14df71a3-ca78-483d-b2cb-eeacdbd4a993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:28 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-436c1833-3cd1-48ca-b067-b64bf2073db9 tempest-AttachVolumeTestJSON-147786180 None] Volume 05610419-79c8-4382-9398-7b2a419247fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05610419-79c8-4382-9398-7b2a419247fe', 'volume_size': 1}
Jul 10 12:42:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-436c1833-3cd1-48ca-b067-b64bf2073db9 tempest-AttachVolumeTestJSON-147786180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:42:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-436c1833-3cd1-48ca-b067-b64bf2073db9 tempest-AttachVolumeTestJSON-147786180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:42:28 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-436c1833-3cd1-48ca-b067-b64bf2073db9 tempest-AttachVolumeTestJSON-147786180 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:42:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1461663797',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05610419-79c8-4382-9398-7b2a419247fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a10ae46bd4e462db6a43d01ae1754c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:42:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:42:29Z,use_quota=True,user_id='a40bbe2f79f54b509b2c9fa1400ea628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:42:28 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-436c1833-3cd1-48ca-b067-b64bf2073db9 tempest-AttachVolumeTestJSON-147786180 None] Creating volume 05610419-79c8-4382-9398-7b2a419247fe {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:42:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-436c1833-3cd1-48ca-b067-b64bf2073db9 tempest-AttachVolumeTestJSON-147786180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:42:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-436c1833-3cd1-48ca-b067-b64bf2073db9 tempest-AttachVolumeTestJSON-147786180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:42:28 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-436c1833-3cd1-48ca-b067-b64bf2073db9 tempest-AttachVolumeTestJSON-147786180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:42:28 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-436c1833-3cd1-48ca-b067-b64bf2073db9 tempest-AttachVolumeTestJSON-147786180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:42:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-436c1833-3cd1-48ca-b067-b64bf2073db9 tempest-AttachVolumeTestJSON-147786180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:42:28 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-436c1833-3cd1-48ca-b067-b64bf2073db9 tempest-AttachVolumeTestJSON-147786180 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:42:28 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-436c1833-3cd1-48ca-b067-b64bf2073db9 tempest-AttachVolumeTestJSON-147786180 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:42:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-436c1833-3cd1-48ca-b067-b64bf2073db9 tempest-AttachVolumeTestJSON-147786180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-05610419-79c8-4382-9398-7b2a419247fe 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:42:29 devstack sudo[92788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-05610419-79c8-4382-9398-7b2a419247fe 1073741824
Jul 10 12:42:29 devstack sudo[92788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:42:30 devstack sudo[92788]: pam_unix(sudo:session): session closed for user root
Jul 10 12:42:30 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-436c1833-3cd1-48ca-b067-b64bf2073db9 tempest-AttachVolumeTestJSON-147786180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-05610419-79c8-4382-9398-7b2a419247fe 1073741824" returned: 0 in 1.238s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:42:30 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-436c1833-3cd1-48ca-b067-b64bf2073db9 tempest-AttachVolumeTestJSON-147786180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-05610419-79c8-4382-9398-7b2a419247fe {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:42:30 devstack sudo[92798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-05610419-79c8-4382-9398-7b2a419247fe
Jul 10 12:42:30 devstack sudo[92798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:42:31 devstack sudo[92798]: pam_unix(sudo:session): session closed for user root
Jul 10 12:42:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-436c1833-3cd1-48ca-b067-b64bf2073db9 tempest-AttachVolumeTestJSON-147786180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-05610419-79c8-4382-9398-7b2a419247fe" returned: 0 in 0.757s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:42:31 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-436c1833-3cd1-48ca-b067-b64bf2073db9 tempest-AttachVolumeTestJSON-147786180 None] <== create_volume: return (2049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:42:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-436c1833-3cd1-48ca-b067-b64bf2073db9 tempest-AttachVolumeTestJSON-147786180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.053s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:42:31 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-436c1833-3cd1-48ca-b067-b64bf2073db9 tempest-AttachVolumeTestJSON-147786180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14df71a3-ca78-483d-b2cb-eeacdbd4a993) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05610419-79c8-4382-9398-7b2a419247fe', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:31 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-436c1833-3cd1-48ca-b067-b64bf2073db9 tempest-AttachVolumeTestJSON-147786180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb2d2bab-bd05-4ff8-8f71-48783526de65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:31 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-436c1833-3cd1-48ca-b067-b64bf2073db9 tempest-AttachVolumeTestJSON-147786180 None] Volume volume-05610419-79c8-4382-9398-7b2a419247fe (05610419-79c8-4382-9398-7b2a419247fe): created successfully
Jul 10 12:42:31 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-436c1833-3cd1-48ca-b067-b64bf2073db9 tempest-AttachVolumeTestJSON-147786180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb2d2bab-bd05-4ff8-8f71-48783526de65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:31 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-436c1833-3cd1-48ca-b067-b64bf2073db9 tempest-AttachVolumeTestJSON-147786180 None] Flow 'volume_create_manager' (e84f5126-7402-4b18-80ae-30e3b15bbfd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:42:31 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-436c1833-3cd1-48ca-b067-b64bf2073db9 tempest-AttachVolumeTestJSON-147786180 None] Created volume successfully.
Jul 10 12:42:32 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-c765a236-45d8-4d94-9015-646f09b784a4 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:42:32 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c765a236-45d8-4d94-9015-646f09b784a4 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] Flow 'volume_create_manager' (337f33c3-fa47-4c1a-baa7-b01cb73e6530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:42:32 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c765a236-45d8-4d94-9015-646f09b784a4 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad911c7f-2658-4da1-a69b-33826f6d09c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:32 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c765a236-45d8-4d94-9015-646f09b784a4 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad911c7f-2658-4da1-a69b-33826f6d09c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1326450763',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd0423c6-7025-44ca-b647-f0cd457b1b5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1216d6bf7cd4ef59433b0585fd65c25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:42:32Z,use_quota=True,user_id='1825d8f2d57548dd9f68dd623af46ed2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:32 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c765a236-45d8-4d94-9015-646f09b784a4 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bb3deef-d08f-4186-9e40-2e1955b2bf83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:32 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c765a236-45d8-4d94-9015-646f09b784a4 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bb3deef-d08f-4186-9e40-2e1955b2bf83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:32 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c765a236-45d8-4d94-9015-646f09b784a4 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6dcecd9-da41-4cd8-9e11-99941fd7f849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:32 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c765a236-45d8-4d94-9015-646f09b784a4 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6dcecd9-da41-4cd8-9e11-99941fd7f849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd0423c6-7025-44ca-b647-f0cd457b1b5d', 'volume_name': 'volume-fd0423c6-7025-44ca-b647-f0cd457b1b5d', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:32 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c765a236-45d8-4d94-9015-646f09b784a4 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cba1dd34-3905-49c7-930b-78e2c186388a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:32 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c765a236-45d8-4d94-9015-646f09b784a4 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cba1dd34-3905-49c7-930b-78e2c186388a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:32 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c765a236-45d8-4d94-9015-646f09b784a4 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2697a18f-cdb0-41f1-87aa-e2970bb5afbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:32 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-c765a236-45d8-4d94-9015-646f09b784a4 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] Volume fd0423c6-7025-44ca-b647-f0cd457b1b5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd0423c6-7025-44ca-b647-f0cd457b1b5d', 'volume_size': 1}
Jul 10 12:42:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c765a236-45d8-4d94-9015-646f09b784a4 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:42:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c765a236-45d8-4d94-9015-646f09b784a4 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:42:32 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-c765a236-45d8-4d94-9015-646f09b784a4 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1326450763',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd0423c6-7025-44ca-b647-f0cd457b1b5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1216d6bf7cd4ef59433b0585fd65c25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:42:32Z,use_quota=True,user_id='1825d8f2d57548dd9f68dd623af46ed2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:42:32 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-c765a236-45d8-4d94-9015-646f09b784a4 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] Creating volume fd0423c6-7025-44ca-b647-f0cd457b1b5d {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:42:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c765a236-45d8-4d94-9015-646f09b784a4 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:42:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c765a236-45d8-4d94-9015-646f09b784a4 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:42:32 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-c765a236-45d8-4d94-9015-646f09b784a4 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:42:32 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-c765a236-45d8-4d94-9015-646f09b784a4 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:42:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c765a236-45d8-4d94-9015-646f09b784a4 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:42:32 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-c765a236-45d8-4d94-9015-646f09b784a4 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:42:32 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-c765a236-45d8-4d94-9015-646f09b784a4 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:42:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c765a236-45d8-4d94-9015-646f09b784a4 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fd0423c6-7025-44ca-b647-f0cd457b1b5d 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:42:32 devstack sudo[92827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fd0423c6-7025-44ca-b647-f0cd457b1b5d 1073741824
Jul 10 12:42:32 devstack sudo[92827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:42:33 devstack sudo[92827]: pam_unix(sudo:session): session closed for user root
Jul 10 12:42:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c765a236-45d8-4d94-9015-646f09b784a4 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fd0423c6-7025-44ca-b647-f0cd457b1b5d 1073741824" returned: 0 in 1.161s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:42:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c765a236-45d8-4d94-9015-646f09b784a4 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fd0423c6-7025-44ca-b647-f0cd457b1b5d {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:42:33 devstack sudo[92842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fd0423c6-7025-44ca-b647-f0cd457b1b5d
Jul 10 12:42:33 devstack sudo[92842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:42:34 devstack sudo[92842]: pam_unix(sudo:session): session closed for user root
Jul 10 12:42:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c765a236-45d8-4d94-9015-646f09b784a4 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fd0423c6-7025-44ca-b647-f0cd457b1b5d" returned: 0 in 0.756s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:42:34 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-c765a236-45d8-4d94-9015-646f09b784a4 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] <== create_volume: return (1977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:42:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c765a236-45d8-4d94-9015-646f09b784a4 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.980s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:42:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c765a236-45d8-4d94-9015-646f09b784a4 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2697a18f-cdb0-41f1-87aa-e2970bb5afbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd0423c6-7025-44ca-b647-f0cd457b1b5d', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c765a236-45d8-4d94-9015-646f09b784a4 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (085eac76-29d7-4835-abac-57832b567c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:34 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-c765a236-45d8-4d94-9015-646f09b784a4 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] Volume volume-fd0423c6-7025-44ca-b647-f0cd457b1b5d (fd0423c6-7025-44ca-b647-f0cd457b1b5d): created successfully
Jul 10 12:42:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c765a236-45d8-4d94-9015-646f09b784a4 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (085eac76-29d7-4835-abac-57832b567c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c765a236-45d8-4d94-9015-646f09b784a4 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] Flow 'volume_create_manager' (337f33c3-fa47-4c1a-baa7-b01cb73e6530) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:42:34 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-c765a236-45d8-4d94-9015-646f09b784a4 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] Created volume successfully.
Jul 10 12:42:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-87fcfad1-4e6b-4f46-8d82-4198fd9155b3 req-35a19722-c113-436b-97a7-8d7f211ca45a tempest-AttachVolumeTestJSON-147786180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:42:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-87fcfad1-4e6b-4f46-8d82-4198fd9155b3 req-35a19722-c113-436b-97a7-8d7f211ca45a tempest-AttachVolumeTestJSON-147786180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:42:35 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc8b85b-6794-42c8-83be-8e159bb941b6]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:42:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-87fcfad1-4e6b-4f46-8d82-4198fd9155b3 req-35a19722-c113-436b-97a7-8d7f211ca45a tempest-AttachVolumeTestJSON-147786180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-05610419-79c8-4382-9398-7b2a419247fe {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:42:35 devstack sudo[92856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-05610419-79c8-4382-9398-7b2a419247fe
Jul 10 12:42:35 devstack sudo[92856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:42:36 devstack sudo[92856]: pam_unix(sudo:session): session closed for user root
Jul 10 12:42:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-87fcfad1-4e6b-4f46-8d82-4198fd9155b3 req-35a19722-c113-436b-97a7-8d7f211ca45a tempest-AttachVolumeTestJSON-147786180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-05610419-79c8-4382-9398-7b2a419247fe" returned: 0 in 0.910s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:42:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-87fcfad1-4e6b-4f46-8d82-4198fd9155b3 req-35a19722-c113-436b-97a7-8d7f211ca45a tempest-AttachVolumeTestJSON-147786180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.933s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:42:36 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-87fcfad1-4e6b-4f46-8d82-4198fd9155b3 req-35a19722-c113-436b-97a7-8d7f211ca45a tempest-AttachVolumeTestJSON-147786180 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be', 'name': 'volume-05610419-79c8-4382-9398-7b2a419247fe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '990fc5f3-c709-488e-b1f4-68088b95333f', 'enforce_multipath': True} {{(pid=87378) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 10 12:42:36 devstack cinder-volume[87378]: INFO cinder.volume.manager [req-87fcfad1-4e6b-4f46-8d82-4198fd9155b3 req-35a19722-c113-436b-97a7-8d7f211ca45a tempest-AttachVolumeTestJSON-147786180 None] attachment_update completed successfully.
Jul 10 12:42:36 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e5d64e9c-c46a-4b1e-af2e-92ffd98377e5 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] Acquiring lock "cinder-fd0423c6-7025-44ca-b647-f0cd457b1b5d-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:42:36 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e5d64e9c-c46a-4b1e-af2e-92ffd98377e5 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] Lock "cinder-fd0423c6-7025-44ca-b647-f0cd457b1b5d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:42:36 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e5d64e9c-c46a-4b1e-af2e-92ffd98377e5 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] Acquiring lock "cinder-quobyte-fd0423c6-7025-44ca-b647-f0cd457b1b5d" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:42:36 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e5d64e9c-c46a-4b1e-af2e-92ffd98377e5 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] Lock "cinder-quobyte-fd0423c6-7025-44ca-b647-f0cd457b1b5d" acquired by "delete_volume" :: waited 0.018s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:42:36 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[63cc0b48-3944-45b1-b2a3-4a249111b3f8]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:42:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e5d64e9c-c46a-4b1e-af2e-92ffd98377e5 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fd0423c6-7025-44ca-b647-f0cd457b1b5d {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:42:36 devstack sudo[92861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fd0423c6-7025-44ca-b647-f0cd457b1b5d
Jul 10 12:42:36 devstack sudo[92861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:42:37 devstack sudo[92861]: pam_unix(sudo:session): session closed for user root
Jul 10 12:42:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e5d64e9c-c46a-4b1e-af2e-92ffd98377e5 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fd0423c6-7025-44ca-b647-f0cd457b1b5d" returned: 0 in 0.878s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:42:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e5d64e9c-c46a-4b1e-af2e-92ffd98377e5 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fd0423c6-7025-44ca-b647-f0cd457b1b5d {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:42:37 devstack sudo[93233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fd0423c6-7025-44ca-b647-f0cd457b1b5d
Jul 10 12:42:37 devstack sudo[93233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:42:38 devstack sudo[93233]: pam_unix(sudo:session): session closed for user root
Jul 10 12:42:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e5d64e9c-c46a-4b1e-af2e-92ffd98377e5 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fd0423c6-7025-44ca-b647-f0cd457b1b5d" returned: 0 in 0.761s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:42:38 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e5d64e9c-c46a-4b1e-af2e-92ffd98377e5 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] Lock "cinder-quobyte-fd0423c6-7025-44ca-b647-f0cd457b1b5d" released by "delete_volume" :: held 1.689s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:42:38 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-e5d64e9c-c46a-4b1e-af2e-92ffd98377e5 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] Created reservations ['5f787a85-e282-4e05-8d37-f32d0d64c3dd', 'eae64732-608f-4bec-9048-aa021db3a5d8', 'd110e3f6-6cec-4beb-be02-2713c49a9139', 'be43d5eb-8fde-40c2-806a-b76189782565'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:42:38 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f99dc59b-e785-452f-a107-2d8dc8f2d08f tempest-AttachVolumeShelveTestJSON-943029956 None] Acquiring lock "cinder-4f010746-ac44-42c1-9e5d-a4065cb0b2df-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:42:38 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f99dc59b-e785-452f-a107-2d8dc8f2d08f tempest-AttachVolumeShelveTestJSON-943029956 None] Lock "cinder-4f010746-ac44-42c1-9e5d-a4065cb0b2df-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:42:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e5d64e9c-c46a-4b1e-af2e-92ffd98377e5 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:42:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e5d64e9c-c46a-4b1e-af2e-92ffd98377e5 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:42:38 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-e5d64e9c-c46a-4b1e-af2e-92ffd98377e5 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:42:38 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-e5d64e9c-c46a-4b1e-af2e-92ffd98377e5 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:42:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e5d64e9c-c46a-4b1e-af2e-92ffd98377e5 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:42:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e5d64e9c-c46a-4b1e-af2e-92ffd98377e5 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:42:38 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f99dc59b-e785-452f-a107-2d8dc8f2d08f tempest-AttachVolumeShelveTestJSON-943029956 None] Acquiring lock "cinder-quobyte-4f010746-ac44-42c1-9e5d-a4065cb0b2df" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:42:38 devstack sudo[93251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:42:38 devstack sudo[93251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:42:38 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f99dc59b-e785-452f-a107-2d8dc8f2d08f tempest-AttachVolumeShelveTestJSON-943029956 None] Lock "cinder-quobyte-4f010746-ac44-42c1-9e5d-a4065cb0b2df" acquired by "delete_volume" :: waited 0.023s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:42:38 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33882a4-398b-4565-850a-e8eebe5f9dde]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:42:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f99dc59b-e785-452f-a107-2d8dc8f2d08f tempest-AttachVolumeShelveTestJSON-943029956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4f010746-ac44-42c1-9e5d-a4065cb0b2df {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:42:38 devstack sudo[93253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4f010746-ac44-42c1-9e5d-a4065cb0b2df
Jul 10 12:42:38 devstack sudo[93253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:42:39 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-4953f2df-4552-42c5-b519-ce41fbff0cf3 tempest-VolumesListAdminTestJSON-1306545019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:42:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4953f2df-4552-42c5-b519-ce41fbff0cf3 tempest-VolumesListAdminTestJSON-1306545019 None] Flow 'volume_create_manager' (849a0441-a9ff-4134-beed-3baa0ad11df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:42:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4953f2df-4552-42c5-b519-ce41fbff0cf3 tempest-VolumesListAdminTestJSON-1306545019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6159559c-86f1-4e4b-babe-fa772e8b662a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:39 devstack sudo[93251]: pam_unix(sudo:session): session closed for user root
Jul 10 12:42:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4953f2df-4552-42c5-b519-ce41fbff0cf3 tempest-VolumesListAdminTestJSON-1306545019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6159559c-86f1-4e4b-babe-fa772e8b662a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2056215733',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbb0b8cb-0c87-4456-984a-e812c6f8511b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='890ac43a3fcc4c459a9f8c192d7fab37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:42:39Z,use_quota=True,user_id='0cd1a1b97e26475881e25b513fe6bae1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4953f2df-4552-42c5-b519-ce41fbff0cf3 tempest-VolumesListAdminTestJSON-1306545019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (868abef3-020c-4eb8-a2cd-a4233074a952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4953f2df-4552-42c5-b519-ce41fbff0cf3 tempest-VolumesListAdminTestJSON-1306545019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (868abef3-020c-4eb8-a2cd-a4233074a952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4953f2df-4552-42c5-b519-ce41fbff0cf3 tempest-VolumesListAdminTestJSON-1306545019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5765c1a3-f3df-4225-b1cf-a98ea535c24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4953f2df-4552-42c5-b519-ce41fbff0cf3 tempest-VolumesListAdminTestJSON-1306545019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5765c1a3-f3df-4225-b1cf-a98ea535c24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbb0b8cb-0c87-4456-984a-e812c6f8511b', 'volume_name': 'volume-cbb0b8cb-0c87-4456-984a-e812c6f8511b', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4953f2df-4552-42c5-b519-ce41fbff0cf3 tempest-VolumesListAdminTestJSON-1306545019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c966f96-4744-4a51-8d46-f8f61fd422b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4953f2df-4552-42c5-b519-ce41fbff0cf3 tempest-VolumesListAdminTestJSON-1306545019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c966f96-4744-4a51-8d46-f8f61fd422b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4953f2df-4552-42c5-b519-ce41fbff0cf3 tempest-VolumesListAdminTestJSON-1306545019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (396d33ef-fcaa-454a-8963-367faadac263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:39 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-4953f2df-4552-42c5-b519-ce41fbff0cf3 tempest-VolumesListAdminTestJSON-1306545019 None] Volume cbb0b8cb-0c87-4456-984a-e812c6f8511b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbb0b8cb-0c87-4456-984a-e812c6f8511b', 'volume_size': 1}
Jul 10 12:42:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-4953f2df-4552-42c5-b519-ce41fbff0cf3 tempest-VolumesListAdminTestJSON-1306545019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:42:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-4953f2df-4552-42c5-b519-ce41fbff0cf3 tempest-VolumesListAdminTestJSON-1306545019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:42:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-4953f2df-4552-42c5-b519-ce41fbff0cf3 tempest-VolumesListAdminTestJSON-1306545019 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2056215733',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbb0b8cb-0c87-4456-984a-e812c6f8511b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='890ac43a3fcc4c459a9f8c192d7fab37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:42:39Z,use_quota=True,user_id='0cd1a1b97e26475881e25b513fe6bae1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:42:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-4953f2df-4552-42c5-b519-ce41fbff0cf3 tempest-VolumesListAdminTestJSON-1306545019 None] Creating volume cbb0b8cb-0c87-4456-984a-e812c6f8511b {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:42:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-4953f2df-4552-42c5-b519-ce41fbff0cf3 tempest-VolumesListAdminTestJSON-1306545019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:42:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-4953f2df-4552-42c5-b519-ce41fbff0cf3 tempest-VolumesListAdminTestJSON-1306545019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:42:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-4953f2df-4552-42c5-b519-ce41fbff0cf3 tempest-VolumesListAdminTestJSON-1306545019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:42:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-4953f2df-4552-42c5-b519-ce41fbff0cf3 tempest-VolumesListAdminTestJSON-1306545019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:42:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-4953f2df-4552-42c5-b519-ce41fbff0cf3 tempest-VolumesListAdminTestJSON-1306545019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:42:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-4953f2df-4552-42c5-b519-ce41fbff0cf3 tempest-VolumesListAdminTestJSON-1306545019 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:42:39 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-4953f2df-4552-42c5-b519-ce41fbff0cf3 tempest-VolumesListAdminTestJSON-1306545019 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:42:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4953f2df-4552-42c5-b519-ce41fbff0cf3 tempest-VolumesListAdminTestJSON-1306545019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cbb0b8cb-0c87-4456-984a-e812c6f8511b 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:42:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e5d64e9c-c46a-4b1e-af2e-92ffd98377e5 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.807s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:42:39 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-e5d64e9c-c46a-4b1e-af2e-92ffd98377e5 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:42:39 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-e5d64e9c-c46a-4b1e-af2e-92ffd98377e5 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] Deleted volume successfully.
Jul 10 12:42:39 devstack sudo[93258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cbb0b8cb-0c87-4456-984a-e812c6f8511b 1073741824
Jul 10 12:42:39 devstack sudo[93258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:42:39 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e5d64e9c-c46a-4b1e-af2e-92ffd98377e5 tempest-VolumeQuotasNegativeTestJSON-1176903075 None] Lock "cinder-fd0423c6-7025-44ca-b647-f0cd457b1b5d-delete_volume" released by "delete_volume" :: held 2.807s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:42:39 devstack sudo[93253]: pam_unix(sudo:session): session closed for user root
Jul 10 12:42:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f99dc59b-e785-452f-a107-2d8dc8f2d08f tempest-AttachVolumeShelveTestJSON-943029956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4f010746-ac44-42c1-9e5d-a4065cb0b2df" returned: 0 in 0.900s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:42:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f99dc59b-e785-452f-a107-2d8dc8f2d08f tempest-AttachVolumeShelveTestJSON-943029956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4f010746-ac44-42c1-9e5d-a4065cb0b2df {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:42:39 devstack sudo[93262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4f010746-ac44-42c1-9e5d-a4065cb0b2df
Jul 10 12:42:39 devstack sudo[93262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:42:40 devstack sudo[93262]: pam_unix(sudo:session): session closed for user root
Jul 10 12:42:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f99dc59b-e785-452f-a107-2d8dc8f2d08f tempest-AttachVolumeShelveTestJSON-943029956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4f010746-ac44-42c1-9e5d-a4065cb0b2df" returned: 0 in 0.755s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:42:40 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f99dc59b-e785-452f-a107-2d8dc8f2d08f tempest-AttachVolumeShelveTestJSON-943029956 None] Lock "cinder-quobyte-4f010746-ac44-42c1-9e5d-a4065cb0b2df" released by "delete_volume" :: held 1.721s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:42:40 devstack sudo[93258]: pam_unix(sudo:session): session closed for user root
Jul 10 12:42:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4953f2df-4552-42c5-b519-ce41fbff0cf3 tempest-VolumesListAdminTestJSON-1306545019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cbb0b8cb-0c87-4456-984a-e812c6f8511b 1073741824" returned: 0 in 1.008s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:42:40 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-f99dc59b-e785-452f-a107-2d8dc8f2d08f tempest-AttachVolumeShelveTestJSON-943029956 None] Created reservations ['01fe6ffc-56e0-4a7d-bac0-7668c89c5be5', '53950d1f-6b08-4f55-825c-5112bad4d819', '67f8031a-e922-4816-a5a7-3384ded2d370', '969d3182-90ef-47f5-ae26-af4bcb4852df'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:42:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4953f2df-4552-42c5-b519-ce41fbff0cf3 tempest-VolumesListAdminTestJSON-1306545019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cbb0b8cb-0c87-4456-984a-e812c6f8511b {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:42:40 devstack sudo[93269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cbb0b8cb-0c87-4456-984a-e812c6f8511b
Jul 10 12:42:40 devstack sudo[93269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:42:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f99dc59b-e785-452f-a107-2d8dc8f2d08f tempest-AttachVolumeShelveTestJSON-943029956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:42:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f99dc59b-e785-452f-a107-2d8dc8f2d08f tempest-AttachVolumeShelveTestJSON-943029956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:42:40 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-f99dc59b-e785-452f-a107-2d8dc8f2d08f tempest-AttachVolumeShelveTestJSON-943029956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:42:40 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-f99dc59b-e785-452f-a107-2d8dc8f2d08f tempest-AttachVolumeShelveTestJSON-943029956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:42:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f99dc59b-e785-452f-a107-2d8dc8f2d08f tempest-AttachVolumeShelveTestJSON-943029956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:42:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f99dc59b-e785-452f-a107-2d8dc8f2d08f tempest-AttachVolumeShelveTestJSON-943029956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:42:40 devstack sudo[93271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:42:40 devstack sudo[93271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:42:41 devstack sudo[93269]: pam_unix(sudo:session): session closed for user root
Jul 10 12:42:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4953f2df-4552-42c5-b519-ce41fbff0cf3 tempest-VolumesListAdminTestJSON-1306545019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cbb0b8cb-0c87-4456-984a-e812c6f8511b" returned: 0 in 0.860s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:42:41 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-4953f2df-4552-42c5-b519-ce41fbff0cf3 tempest-VolumesListAdminTestJSON-1306545019 None] <== create_volume: return (1925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:42:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-4953f2df-4552-42c5-b519-ce41fbff0cf3 tempest-VolumesListAdminTestJSON-1306545019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.927s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:42:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4953f2df-4552-42c5-b519-ce41fbff0cf3 tempest-VolumesListAdminTestJSON-1306545019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (396d33ef-fcaa-454a-8963-367faadac263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbb0b8cb-0c87-4456-984a-e812c6f8511b', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4953f2df-4552-42c5-b519-ce41fbff0cf3 tempest-VolumesListAdminTestJSON-1306545019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6cfdb9a-c71a-4e17-9403-0b59ce77068c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:41 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-4953f2df-4552-42c5-b519-ce41fbff0cf3 tempest-VolumesListAdminTestJSON-1306545019 None] Volume volume-cbb0b8cb-0c87-4456-984a-e812c6f8511b (cbb0b8cb-0c87-4456-984a-e812c6f8511b): created successfully
Jul 10 12:42:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4953f2df-4552-42c5-b519-ce41fbff0cf3 tempest-VolumesListAdminTestJSON-1306545019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6cfdb9a-c71a-4e17-9403-0b59ce77068c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4953f2df-4552-42c5-b519-ce41fbff0cf3 tempest-VolumesListAdminTestJSON-1306545019 None] Flow 'volume_create_manager' (849a0441-a9ff-4134-beed-3baa0ad11df0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:42:41 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-4953f2df-4552-42c5-b519-ce41fbff0cf3 tempest-VolumesListAdminTestJSON-1306545019 None] Created volume successfully.
Jul 10 12:42:41 devstack sudo[93271]: pam_unix(sudo:session): session closed for user root
Jul 10 12:42:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f99dc59b-e785-452f-a107-2d8dc8f2d08f tempest-AttachVolumeShelveTestJSON-943029956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.849s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:42:41 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-f99dc59b-e785-452f-a107-2d8dc8f2d08f tempest-AttachVolumeShelveTestJSON-943029956 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:42:41 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-f99dc59b-e785-452f-a107-2d8dc8f2d08f tempest-AttachVolumeShelveTestJSON-943029956 None] Deleted volume successfully.
Jul 10 12:42:41 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f99dc59b-e785-452f-a107-2d8dc8f2d08f tempest-AttachVolumeShelveTestJSON-943029956 None] Lock "cinder-4f010746-ac44-42c1-9e5d-a4065cb0b2df-delete_volume" released by "delete_volume" :: held 2.894s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:42:42 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-08b8b4d7-591e-43f0-a611-cb16f1146880 tempest-VolumesListAdminTestJSON-1306545019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:42:42 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-08b8b4d7-591e-43f0-a611-cb16f1146880 tempest-VolumesListAdminTestJSON-1306545019 None] Flow 'volume_create_manager' (c5d9e4be-b7f2-479f-b15d-19b329ef6ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:42:42 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-08b8b4d7-591e-43f0-a611-cb16f1146880 tempest-VolumesListAdminTestJSON-1306545019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfcff495-0101-4d54-8270-368ac86da1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:43 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-08b8b4d7-591e-43f0-a611-cb16f1146880 tempest-VolumesListAdminTestJSON-1306545019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfcff495-0101-4d54-8270-368ac86da1df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-732005132',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc47f89e-a960-4a25-8369-9b772b2cb98e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='890ac43a3fcc4c459a9f8c192d7fab37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:42:43Z,use_quota=True,user_id='0cd1a1b97e26475881e25b513fe6bae1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:43 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-08b8b4d7-591e-43f0-a611-cb16f1146880 tempest-VolumesListAdminTestJSON-1306545019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb7df6af-298c-4e81-841f-08e27762b842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:43 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-08b8b4d7-591e-43f0-a611-cb16f1146880 tempest-VolumesListAdminTestJSON-1306545019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb7df6af-298c-4e81-841f-08e27762b842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:43 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-08b8b4d7-591e-43f0-a611-cb16f1146880 tempest-VolumesListAdminTestJSON-1306545019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e3c4028-0785-4834-8058-8522cff4f79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:43 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-08b8b4d7-591e-43f0-a611-cb16f1146880 tempest-VolumesListAdminTestJSON-1306545019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e3c4028-0785-4834-8058-8522cff4f79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc47f89e-a960-4a25-8369-9b772b2cb98e', 'volume_name': 'volume-bc47f89e-a960-4a25-8369-9b772b2cb98e', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:43 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-08b8b4d7-591e-43f0-a611-cb16f1146880 tempest-VolumesListAdminTestJSON-1306545019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d38bf1-bec5-490e-8fab-c187388b69a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:43 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-08b8b4d7-591e-43f0-a611-cb16f1146880 tempest-VolumesListAdminTestJSON-1306545019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d38bf1-bec5-490e-8fab-c187388b69a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:43 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-08b8b4d7-591e-43f0-a611-cb16f1146880 tempest-VolumesListAdminTestJSON-1306545019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1fe3373-bdc7-49a4-82d8-bb962139a8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:43 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-08b8b4d7-591e-43f0-a611-cb16f1146880 tempest-VolumesListAdminTestJSON-1306545019 None] Volume bc47f89e-a960-4a25-8369-9b772b2cb98e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc47f89e-a960-4a25-8369-9b772b2cb98e', 'volume_size': 1}
Jul 10 12:42:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-08b8b4d7-591e-43f0-a611-cb16f1146880 tempest-VolumesListAdminTestJSON-1306545019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:42:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-08b8b4d7-591e-43f0-a611-cb16f1146880 tempest-VolumesListAdminTestJSON-1306545019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:42:43 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-08b8b4d7-591e-43f0-a611-cb16f1146880 tempest-VolumesListAdminTestJSON-1306545019 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-732005132',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc47f89e-a960-4a25-8369-9b772b2cb98e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='890ac43a3fcc4c459a9f8c192d7fab37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:42:43Z,use_quota=True,user_id='0cd1a1b97e26475881e25b513fe6bae1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:42:43 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-08b8b4d7-591e-43f0-a611-cb16f1146880 tempest-VolumesListAdminTestJSON-1306545019 None] Creating volume bc47f89e-a960-4a25-8369-9b772b2cb98e {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:42:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-08b8b4d7-591e-43f0-a611-cb16f1146880 tempest-VolumesListAdminTestJSON-1306545019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:42:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-08b8b4d7-591e-43f0-a611-cb16f1146880 tempest-VolumesListAdminTestJSON-1306545019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:42:43 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-08b8b4d7-591e-43f0-a611-cb16f1146880 tempest-VolumesListAdminTestJSON-1306545019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:42:43 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-08b8b4d7-591e-43f0-a611-cb16f1146880 tempest-VolumesListAdminTestJSON-1306545019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:42:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-08b8b4d7-591e-43f0-a611-cb16f1146880 tempest-VolumesListAdminTestJSON-1306545019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:42:43 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-08b8b4d7-591e-43f0-a611-cb16f1146880 tempest-VolumesListAdminTestJSON-1306545019 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:42:43 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-08b8b4d7-591e-43f0-a611-cb16f1146880 tempest-VolumesListAdminTestJSON-1306545019 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:42:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-08b8b4d7-591e-43f0-a611-cb16f1146880 tempest-VolumesListAdminTestJSON-1306545019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-bc47f89e-a960-4a25-8369-9b772b2cb98e 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:42:43 devstack sudo[93278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-bc47f89e-a960-4a25-8369-9b772b2cb98e 1073741824
Jul 10 12:42:43 devstack sudo[93278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:42:44 devstack sudo[93278]: pam_unix(sudo:session): session closed for user root
Jul 10 12:42:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-08b8b4d7-591e-43f0-a611-cb16f1146880 tempest-VolumesListAdminTestJSON-1306545019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-bc47f89e-a960-4a25-8369-9b772b2cb98e 1073741824" returned: 0 in 1.224s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:42:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-08b8b4d7-591e-43f0-a611-cb16f1146880 tempest-VolumesListAdminTestJSON-1306545019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-bc47f89e-a960-4a25-8369-9b772b2cb98e {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:42:44 devstack sudo[93292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-bc47f89e-a960-4a25-8369-9b772b2cb98e
Jul 10 12:42:44 devstack sudo[93292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:42:45 devstack sudo[93292]: pam_unix(sudo:session): session closed for user root
Jul 10 12:42:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-08b8b4d7-591e-43f0-a611-cb16f1146880 tempest-VolumesListAdminTestJSON-1306545019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-bc47f89e-a960-4a25-8369-9b772b2cb98e" returned: 0 in 0.866s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:42:45 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-08b8b4d7-591e-43f0-a611-cb16f1146880 tempest-VolumesListAdminTestJSON-1306545019 None] <== create_volume: return (2136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:42:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-08b8b4d7-591e-43f0-a611-cb16f1146880 tempest-VolumesListAdminTestJSON-1306545019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.139s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:42:45 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-08b8b4d7-591e-43f0-a611-cb16f1146880 tempest-VolumesListAdminTestJSON-1306545019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1fe3373-bdc7-49a4-82d8-bb962139a8c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc47f89e-a960-4a25-8369-9b772b2cb98e', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:45 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-08b8b4d7-591e-43f0-a611-cb16f1146880 tempest-VolumesListAdminTestJSON-1306545019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (181b18fd-247c-4653-94b5-d2cce45309af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:45 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-08b8b4d7-591e-43f0-a611-cb16f1146880 tempest-VolumesListAdminTestJSON-1306545019 None] Volume volume-bc47f89e-a960-4a25-8369-9b772b2cb98e (bc47f89e-a960-4a25-8369-9b772b2cb98e): created successfully
Jul 10 12:42:45 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-08b8b4d7-591e-43f0-a611-cb16f1146880 tempest-VolumesListAdminTestJSON-1306545019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (181b18fd-247c-4653-94b5-d2cce45309af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:45 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-08b8b4d7-591e-43f0-a611-cb16f1146880 tempest-VolumesListAdminTestJSON-1306545019 None] Flow 'volume_create_manager' (c5d9e4be-b7f2-479f-b15d-19b329ef6ae1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:42:45 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-08b8b4d7-591e-43f0-a611-cb16f1146880 tempest-VolumesListAdminTestJSON-1306545019 None] Created volume successfully.
Jul 10 12:42:47 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-1663544c-39dc-4f3d-b01d-dda34b35f3b0 tempest-VolumesListAdminTestJSON-1306545019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:42:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1663544c-39dc-4f3d-b01d-dda34b35f3b0 tempest-VolumesListAdminTestJSON-1306545019 None] Flow 'volume_create_manager' (84b487aa-0a24-48b1-85f9-b179076ba0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:42:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1663544c-39dc-4f3d-b01d-dda34b35f3b0 tempest-VolumesListAdminTestJSON-1306545019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (127c3e5e-131f-4872-8541-c245e06eab83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1663544c-39dc-4f3d-b01d-dda34b35f3b0 tempest-VolumesListAdminTestJSON-1306545019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (127c3e5e-131f-4872-8541-c245e06eab83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2108382898',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44e9e696-e68d-4156-8475-5538ac72ba10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='890ac43a3fcc4c459a9f8c192d7fab37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:42:47Z,use_quota=True,user_id='0cd1a1b97e26475881e25b513fe6bae1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1663544c-39dc-4f3d-b01d-dda34b35f3b0 tempest-VolumesListAdminTestJSON-1306545019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d07b574-b723-416f-be5a-ac4cc3dc83eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1663544c-39dc-4f3d-b01d-dda34b35f3b0 tempest-VolumesListAdminTestJSON-1306545019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d07b574-b723-416f-be5a-ac4cc3dc83eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1663544c-39dc-4f3d-b01d-dda34b35f3b0 tempest-VolumesListAdminTestJSON-1306545019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adbc157c-0a62-44e4-9fd3-707d28bf8bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1663544c-39dc-4f3d-b01d-dda34b35f3b0 tempest-VolumesListAdminTestJSON-1306545019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adbc157c-0a62-44e4-9fd3-707d28bf8bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44e9e696-e68d-4156-8475-5538ac72ba10', 'volume_name': 'volume-44e9e696-e68d-4156-8475-5538ac72ba10', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1663544c-39dc-4f3d-b01d-dda34b35f3b0 tempest-VolumesListAdminTestJSON-1306545019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (426f2927-2855-45ef-b27f-4afe3b8acbae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1663544c-39dc-4f3d-b01d-dda34b35f3b0 tempest-VolumesListAdminTestJSON-1306545019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (426f2927-2855-45ef-b27f-4afe3b8acbae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1663544c-39dc-4f3d-b01d-dda34b35f3b0 tempest-VolumesListAdminTestJSON-1306545019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94208640-86e1-4668-9cef-f7d278c1f3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:47 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-1663544c-39dc-4f3d-b01d-dda34b35f3b0 tempest-VolumesListAdminTestJSON-1306545019 None] Volume 44e9e696-e68d-4156-8475-5538ac72ba10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44e9e696-e68d-4156-8475-5538ac72ba10', 'volume_size': 1}
Jul 10 12:42:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1663544c-39dc-4f3d-b01d-dda34b35f3b0 tempest-VolumesListAdminTestJSON-1306545019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:42:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1663544c-39dc-4f3d-b01d-dda34b35f3b0 tempest-VolumesListAdminTestJSON-1306545019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:42:47 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-1663544c-39dc-4f3d-b01d-dda34b35f3b0 tempest-VolumesListAdminTestJSON-1306545019 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2108382898',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44e9e696-e68d-4156-8475-5538ac72ba10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='890ac43a3fcc4c459a9f8c192d7fab37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:42:47Z,use_quota=True,user_id='0cd1a1b97e26475881e25b513fe6bae1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:42:47 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-1663544c-39dc-4f3d-b01d-dda34b35f3b0 tempest-VolumesListAdminTestJSON-1306545019 None] Creating volume 44e9e696-e68d-4156-8475-5538ac72ba10 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:42:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1663544c-39dc-4f3d-b01d-dda34b35f3b0 tempest-VolumesListAdminTestJSON-1306545019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:42:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1663544c-39dc-4f3d-b01d-dda34b35f3b0 tempest-VolumesListAdminTestJSON-1306545019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:42:47 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-1663544c-39dc-4f3d-b01d-dda34b35f3b0 tempest-VolumesListAdminTestJSON-1306545019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:42:47 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-1663544c-39dc-4f3d-b01d-dda34b35f3b0 tempest-VolumesListAdminTestJSON-1306545019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:42:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1663544c-39dc-4f3d-b01d-dda34b35f3b0 tempest-VolumesListAdminTestJSON-1306545019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:42:47 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-1663544c-39dc-4f3d-b01d-dda34b35f3b0 tempest-VolumesListAdminTestJSON-1306545019 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:42:47 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-1663544c-39dc-4f3d-b01d-dda34b35f3b0 tempest-VolumesListAdminTestJSON-1306545019 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:42:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1663544c-39dc-4f3d-b01d-dda34b35f3b0 tempest-VolumesListAdminTestJSON-1306545019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-44e9e696-e68d-4156-8475-5538ac72ba10 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:42:47 devstack sudo[93298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-44e9e696-e68d-4156-8475-5538ac72ba10 1073741824
Jul 10 12:42:47 devstack sudo[93298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:42:48 devstack sudo[93298]: pam_unix(sudo:session): session closed for user root
Jul 10 12:42:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1663544c-39dc-4f3d-b01d-dda34b35f3b0 tempest-VolumesListAdminTestJSON-1306545019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-44e9e696-e68d-4156-8475-5538ac72ba10 1073741824" returned: 0 in 0.991s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:42:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1663544c-39dc-4f3d-b01d-dda34b35f3b0 tempest-VolumesListAdminTestJSON-1306545019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-44e9e696-e68d-4156-8475-5538ac72ba10 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:42:48 devstack sudo[93304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-44e9e696-e68d-4156-8475-5538ac72ba10
Jul 10 12:42:48 devstack sudo[93304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:42:49 devstack sudo[93304]: pam_unix(sudo:session): session closed for user root
Jul 10 12:42:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1663544c-39dc-4f3d-b01d-dda34b35f3b0 tempest-VolumesListAdminTestJSON-1306545019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-44e9e696-e68d-4156-8475-5538ac72ba10" returned: 0 in 0.809s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:42:49 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-1663544c-39dc-4f3d-b01d-dda34b35f3b0 tempest-VolumesListAdminTestJSON-1306545019 None] <== create_volume: return (1862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:42:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1663544c-39dc-4f3d-b01d-dda34b35f3b0 tempest-VolumesListAdminTestJSON-1306545019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.865s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:42:49 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1663544c-39dc-4f3d-b01d-dda34b35f3b0 tempest-VolumesListAdminTestJSON-1306545019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94208640-86e1-4668-9cef-f7d278c1f3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44e9e696-e68d-4156-8475-5538ac72ba10', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:49 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1663544c-39dc-4f3d-b01d-dda34b35f3b0 tempest-VolumesListAdminTestJSON-1306545019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (180d27be-7eb7-40f3-ba1c-3915b9d19647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:49 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-1663544c-39dc-4f3d-b01d-dda34b35f3b0 tempest-VolumesListAdminTestJSON-1306545019 None] Volume volume-44e9e696-e68d-4156-8475-5538ac72ba10 (44e9e696-e68d-4156-8475-5538ac72ba10): created successfully
Jul 10 12:42:49 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1663544c-39dc-4f3d-b01d-dda34b35f3b0 tempest-VolumesListAdminTestJSON-1306545019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (180d27be-7eb7-40f3-ba1c-3915b9d19647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:49 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1663544c-39dc-4f3d-b01d-dda34b35f3b0 tempest-VolumesListAdminTestJSON-1306545019 None] Flow 'volume_create_manager' (84b487aa-0a24-48b1-85f9-b179076ba0bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:42:49 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-1663544c-39dc-4f3d-b01d-dda34b35f3b0 tempest-VolumesListAdminTestJSON-1306545019 None] Created volume successfully.
Jul 10 12:42:51 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0231add-1b0d-48cf-bff7-f2b05c635f7b tempest-VolumesListAdminTestJSON-1270386626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:42:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c0231add-1b0d-48cf-bff7-f2b05c635f7b tempest-VolumesListAdminTestJSON-1270386626 None] Flow 'volume_create_manager' (b5d35a68-268d-4773-b195-5f34948061ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:42:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c0231add-1b0d-48cf-bff7-f2b05c635f7b tempest-VolumesListAdminTestJSON-1270386626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1fe771d-8598-4127-9400-701ddc4556d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c0231add-1b0d-48cf-bff7-f2b05c635f7b tempest-VolumesListAdminTestJSON-1270386626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1fe771d-8598-4127-9400-701ddc4556d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ef46c3a-a41e-4fcd-bb09-fd95748015d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32165e635bbc412284700b1676c51641',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:42:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:42:51Z,use_quota=True,user_id='faf652af9dac42a4827c071325419e4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c0231add-1b0d-48cf-bff7-f2b05c635f7b tempest-VolumesListAdminTestJSON-1270386626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef1f81aa-35ab-479b-b24b-c2764564c49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c0231add-1b0d-48cf-bff7-f2b05c635f7b tempest-VolumesListAdminTestJSON-1270386626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef1f81aa-35ab-479b-b24b-c2764564c49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c0231add-1b0d-48cf-bff7-f2b05c635f7b tempest-VolumesListAdminTestJSON-1270386626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aae371ce-7c2a-42ea-8444-05bbb0ac9188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c0231add-1b0d-48cf-bff7-f2b05c635f7b tempest-VolumesListAdminTestJSON-1270386626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aae371ce-7c2a-42ea-8444-05bbb0ac9188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ef46c3a-a41e-4fcd-bb09-fd95748015d0', 'volume_name': 'volume-4ef46c3a-a41e-4fcd-bb09-fd95748015d0', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c0231add-1b0d-48cf-bff7-f2b05c635f7b tempest-VolumesListAdminTestJSON-1270386626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db282b94-b3cd-41c4-84ee-6d628f243256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c0231add-1b0d-48cf-bff7-f2b05c635f7b tempest-VolumesListAdminTestJSON-1270386626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db282b94-b3cd-41c4-84ee-6d628f243256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c0231add-1b0d-48cf-bff7-f2b05c635f7b tempest-VolumesListAdminTestJSON-1270386626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e6fb787-c2aa-45b2-892e-3e9c9a384a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:51 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-c0231add-1b0d-48cf-bff7-f2b05c635f7b tempest-VolumesListAdminTestJSON-1270386626 None] Volume 4ef46c3a-a41e-4fcd-bb09-fd95748015d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ef46c3a-a41e-4fcd-bb09-fd95748015d0', 'volume_size': 1}
Jul 10 12:42:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c0231add-1b0d-48cf-bff7-f2b05c635f7b tempest-VolumesListAdminTestJSON-1270386626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:42:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c0231add-1b0d-48cf-bff7-f2b05c635f7b tempest-VolumesListAdminTestJSON-1270386626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:42:51 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-c0231add-1b0d-48cf-bff7-f2b05c635f7b tempest-VolumesListAdminTestJSON-1270386626 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ef46c3a-a41e-4fcd-bb09-fd95748015d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32165e635bbc412284700b1676c51641',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:42:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:42:51Z,use_quota=True,user_id='faf652af9dac42a4827c071325419e4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:42:51 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-c0231add-1b0d-48cf-bff7-f2b05c635f7b tempest-VolumesListAdminTestJSON-1270386626 None] Creating volume 4ef46c3a-a41e-4fcd-bb09-fd95748015d0 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:42:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c0231add-1b0d-48cf-bff7-f2b05c635f7b tempest-VolumesListAdminTestJSON-1270386626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:42:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c0231add-1b0d-48cf-bff7-f2b05c635f7b tempest-VolumesListAdminTestJSON-1270386626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:42:51 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-c0231add-1b0d-48cf-bff7-f2b05c635f7b tempest-VolumesListAdminTestJSON-1270386626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:42:51 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-c0231add-1b0d-48cf-bff7-f2b05c635f7b tempest-VolumesListAdminTestJSON-1270386626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:42:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c0231add-1b0d-48cf-bff7-f2b05c635f7b tempest-VolumesListAdminTestJSON-1270386626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:42:51 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-c0231add-1b0d-48cf-bff7-f2b05c635f7b tempest-VolumesListAdminTestJSON-1270386626 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:42:51 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-c0231add-1b0d-48cf-bff7-f2b05c635f7b tempest-VolumesListAdminTestJSON-1270386626 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:42:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c0231add-1b0d-48cf-bff7-f2b05c635f7b tempest-VolumesListAdminTestJSON-1270386626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4ef46c3a-a41e-4fcd-bb09-fd95748015d0 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:42:51 devstack sudo[93349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4ef46c3a-a41e-4fcd-bb09-fd95748015d0 1073741824
Jul 10 12:42:51 devstack sudo[93349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:42:52 devstack sudo[93349]: pam_unix(sudo:session): session closed for user root
Jul 10 12:42:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c0231add-1b0d-48cf-bff7-f2b05c635f7b tempest-VolumesListAdminTestJSON-1270386626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4ef46c3a-a41e-4fcd-bb09-fd95748015d0 1073741824" returned: 0 in 1.259s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:42:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c0231add-1b0d-48cf-bff7-f2b05c635f7b tempest-VolumesListAdminTestJSON-1270386626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4ef46c3a-a41e-4fcd-bb09-fd95748015d0 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:42:52 devstack sudo[93423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4ef46c3a-a41e-4fcd-bb09-fd95748015d0
Jul 10 12:42:52 devstack sudo[93423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:42:53 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:42:53 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] Flow 'volume_create_manager' (428ebdeb-2b77-425e-a54f-95502348c740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:42:53 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18f2ffff-be9f-4d32-80e7-13bbec17d71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:53 devstack sudo[93423]: pam_unix(sudo:session): session closed for user root
Jul 10 12:42:53 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18f2ffff-be9f-4d32-80e7-13bbec17d71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-682309719',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdcc9087-1c98-4ad4-b6de-88e8ebc0e502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbcf7c71567242a3b988a8ff01a1896e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:42:53Z,use_quota=True,user_id='142f9eab4dbb4e12a2f878e6f35a930c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:53 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f466c7c1-159e-43b7-b7b7-51002d365a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:53 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f466c7c1-159e-43b7-b7b7-51002d365a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:53 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2fe3a66-bfa1-4805-9b42-dcf492d73a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:53 devstack cinder-volume[87378]: DEBUG cinder.image.glance [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] Creating Keystone auth plugin from conf {{(pid=87378) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 10 12:42:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c0231add-1b0d-48cf-bff7-f2b05c635f7b tempest-VolumesListAdminTestJSON-1270386626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4ef46c3a-a41e-4fcd-bb09-fd95748015d0" returned: 0 in 0.919s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:42:53 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-c0231add-1b0d-48cf-bff7-f2b05c635f7b tempest-VolumesListAdminTestJSON-1270386626 None] <== create_volume: return (2236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:42:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c0231add-1b0d-48cf-bff7-f2b05c635f7b tempest-VolumesListAdminTestJSON-1270386626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.241s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:42:53 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c0231add-1b0d-48cf-bff7-f2b05c635f7b tempest-VolumesListAdminTestJSON-1270386626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e6fb787-c2aa-45b2-892e-3e9c9a384a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ef46c3a-a41e-4fcd-bb09-fd95748015d0', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:53 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c0231add-1b0d-48cf-bff7-f2b05c635f7b tempest-VolumesListAdminTestJSON-1270386626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9e7bdc8-99b5-4df4-a021-8a9c7329a931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:53 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-c0231add-1b0d-48cf-bff7-f2b05c635f7b tempest-VolumesListAdminTestJSON-1270386626 None] Volume volume-4ef46c3a-a41e-4fcd-bb09-fd95748015d0 (4ef46c3a-a41e-4fcd-bb09-fd95748015d0): created successfully
Jul 10 12:42:53 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c0231add-1b0d-48cf-bff7-f2b05c635f7b tempest-VolumesListAdminTestJSON-1270386626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9e7bdc8-99b5-4df4-a021-8a9c7329a931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:53 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c0231add-1b0d-48cf-bff7-f2b05c635f7b tempest-VolumesListAdminTestJSON-1270386626 None] Flow 'volume_create_manager' (b5d35a68-268d-4773-b195-5f34948061ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:42:53 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-c0231add-1b0d-48cf-bff7-f2b05c635f7b tempest-VolumesListAdminTestJSON-1270386626 None] Created volume successfully.
Jul 10 12:42:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2fe3a66-bfa1-4805-9b42-dcf492d73a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cdcc9087-1c98-4ad4-b6de-88e8ebc0e502', 'volume_name': 'volume-cdcc9087-1c98-4ad4-b6de-88e8ebc0e502', 'volume_size': 1, 'image_id': 'c73e431b-92e2-4ca0-8142-903361296a8f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c73e431b-92e2-4ca0-8142-903361296a8f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ea129ca6c904ec8b3827a458726b692', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c73e431b-92e2-4ca0-8142-903361296a8f', 'created_at': datetime.datetime(2026, 7, 10, 10, 26, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 10, 26, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c73e431b-92e2-4ca0-8142-903361296a8f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74a0ab9a4c50>}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a201fd4d-6e7a-4626-8536-209a93021de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a201fd4d-6e7a-4626-8536-209a93021de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:42:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d04a9fe-8a0b-4825-8f4b-224e001a0b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:42:54 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] Volume cdcc9087-1c98-4ad4-b6de-88e8ebc0e502: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cdcc9087-1c98-4ad4-b6de-88e8ebc0e502', 'volume_size': 1, 'image_id': 'c73e431b-92e2-4ca0-8142-903361296a8f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c73e431b-92e2-4ca0-8142-903361296a8f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ea129ca6c904ec8b3827a458726b692', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c73e431b-92e2-4ca0-8142-903361296a8f', 'created_at': datetime.datetime(2026, 7, 10, 10, 26, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 10, 26, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c73e431b-92e2-4ca0-8142-903361296a8f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74a0ab9a4c50>}
Jul 10 12:42:54 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] Trying to clone cdcc9087-1c98-4ad4-b6de-88e8ebc0e502 from image c73e431b-92e2-4ca0-8142-903361296a8f at location (None, [{'url': 'file:///opt/stack/data/glance/images/c73e431b-92e2-4ca0-8142-903361296a8f', 'metadata': {}}]). {{(pid=87378) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 10 12:42:54 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b4c6a1d5-4a5c-4139-973e-69eff8d567b4 tempest-VolumesListAdminTestJSON-1270386626 None] Acquiring lock "cinder-4ef46c3a-a41e-4fcd-bb09-fd95748015d0-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:42:54 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b4c6a1d5-4a5c-4139-973e-69eff8d567b4 tempest-VolumesListAdminTestJSON-1270386626 None] Lock "cinder-4ef46c3a-a41e-4fcd-bb09-fd95748015d0-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:42:54 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_nz6qp7hydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87378) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 10 12:42:54 devstack cinder-volume[87378]: INFO cinder.image.image_utils [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] Image download 20.69 MB at 20.69 MB/s
Jul 10 12:42:54 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b4c6a1d5-4a5c-4139-973e-69eff8d567b4 tempest-VolumesListAdminTestJSON-1270386626 None] Acquiring lock "cinder-quobyte-4ef46c3a-a41e-4fcd-bb09-fd95748015d0" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:42:54 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b4c6a1d5-4a5c-4139-973e-69eff8d567b4 tempest-VolumesListAdminTestJSON-1270386626 None] Lock "cinder-quobyte-4ef46c3a-a41e-4fcd-bb09-fd95748015d0" acquired by "delete_volume" :: waited 0.032s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:42:54 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-6b1801f9-16de-4581-a006-e984d74f7c68 tempest-VolumesListAdminTestJSON-1306545019 None] Acquiring lock "cinder-44e9e696-e68d-4156-8475-5538ac72ba10-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:42:54 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7625a6-f857-42b0-979d-b3fb02c2bcec]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:42:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_nz6qp7hydevstack@QuobyteHD {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:42:54 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5bb5723-0a60-4c93-b5fd-b7ae8b39c423]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:42:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b4c6a1d5-4a5c-4139-973e-69eff8d567b4 tempest-VolumesListAdminTestJSON-1270386626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4ef46c3a-a41e-4fcd-bb09-fd95748015d0 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:42:54 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-6b1801f9-16de-4581-a006-e984d74f7c68 tempest-VolumesListAdminTestJSON-1306545019 None] Lock "cinder-44e9e696-e68d-4156-8475-5538ac72ba10-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:42:54 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-6b1801f9-16de-4581-a006-e984d74f7c68 tempest-VolumesListAdminTestJSON-1306545019 None] Acquiring lock "cinder-quobyte-44e9e696-e68d-4156-8475-5538ac72ba10" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:42:54 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-6b1801f9-16de-4581-a006-e984d74f7c68 tempest-VolumesListAdminTestJSON-1306545019 None] Lock "cinder-quobyte-44e9e696-e68d-4156-8475-5538ac72ba10" acquired by "delete_volume" :: waited 0.027s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:42:54 devstack sudo[93459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_nz6qp7hydevstack@QuobyteHD
Jul 10 12:42:54 devstack sudo[93459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:42:55 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e56d3de-a674-47b2-9dc0-162abe50537d]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:42:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6b1801f9-16de-4581-a006-e984d74f7c68 tempest-VolumesListAdminTestJSON-1306545019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-44e9e696-e68d-4156-8475-5538ac72ba10 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:42:55 devstack sudo[93460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4ef46c3a-a41e-4fcd-bb09-fd95748015d0
Jul 10 12:42:55 devstack sudo[93460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:42:55 devstack sudo[93462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-44e9e696-e68d-4156-8475-5538ac72ba10
Jul 10 12:42:55 devstack sudo[93462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:42:56 devstack sudo[93459]: pam_unix(sudo:session): session closed for user root
Jul 10 12:42:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_nz6qp7hydevstack@QuobyteHD" returned: 0 in 1.245s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:42:56 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] Temporary image c73e431b-92e2-4ca0-8142-903361296a8f is fetched for user 142f9eab4dbb4e12a2f878e6f35a930c. {{(pid=87378) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 10 12:42:56 devstack sudo[93462]: pam_unix(sudo:session): session closed for user root
Jul 10 12:42:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6b1801f9-16de-4581-a006-e984d74f7c68 tempest-VolumesListAdminTestJSON-1306545019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-44e9e696-e68d-4156-8475-5538ac72ba10" returned: 0 in 1.188s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:42:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6b1801f9-16de-4581-a006-e984d74f7c68 tempest-VolumesListAdminTestJSON-1306545019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-44e9e696-e68d-4156-8475-5538ac72ba10 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:42:56 devstack sudo[93846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-44e9e696-e68d-4156-8475-5538ac72ba10
Jul 10 12:42:56 devstack sudo[93846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:42:56 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b24e4b3-a73e-472b-919e-a0a3b06ccdab]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:42:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_nz6qp7hydevstack@QuobyteHD {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:42:56 devstack sudo[93460]: pam_unix(sudo:session): session closed for user root
Jul 10 12:42:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b4c6a1d5-4a5c-4139-973e-69eff8d567b4 tempest-VolumesListAdminTestJSON-1270386626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4ef46c3a-a41e-4fcd-bb09-fd95748015d0" returned: 0 in 1.473s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:42:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b4c6a1d5-4a5c-4139-973e-69eff8d567b4 tempest-VolumesListAdminTestJSON-1270386626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4ef46c3a-a41e-4fcd-bb09-fd95748015d0 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:42:56 devstack sudo[93853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4ef46c3a-a41e-4fcd-bb09-fd95748015d0
Jul 10 12:42:56 devstack sudo[93853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:42:56 devstack sudo[93850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_nz6qp7hydevstack@QuobyteHD
Jul 10 12:42:56 devstack sudo[93850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:42:57 devstack sudo[93853]: pam_unix(sudo:session): session closed for user root
Jul 10 12:42:57 devstack sudo[93850]: pam_unix(sudo:session): session closed for user root
Jul 10 12:42:57 devstack sudo[93846]: pam_unix(sudo:session): session closed for user root
Jul 10 12:42:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b4c6a1d5-4a5c-4139-973e-69eff8d567b4 tempest-VolumesListAdminTestJSON-1270386626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4ef46c3a-a41e-4fcd-bb09-fd95748015d0" returned: 0 in 1.250s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:42:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6b1801f9-16de-4581-a006-e984d74f7c68 tempest-VolumesListAdminTestJSON-1306545019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-44e9e696-e68d-4156-8475-5538ac72ba10" returned: 0 in 1.405s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:42:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_nz6qp7hydevstack@QuobyteHD" returned: 0 in 1.309s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:42:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:42:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:42:57 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-682309719',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdcc9087-1c98-4ad4-b6de-88e8ebc0e502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbcf7c71567242a3b988a8ff01a1896e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:42:53Z,use_quota=True,user_id='142f9eab4dbb4e12a2f878e6f35a930c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:42:57 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] Creating volume cdcc9087-1c98-4ad4-b6de-88e8ebc0e502 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:42:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:42:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:42:57 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:42:57 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:42:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:42:57 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:42:57 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:42:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cdcc9087-1c98-4ad4-b6de-88e8ebc0e502 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:42:57 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b4c6a1d5-4a5c-4139-973e-69eff8d567b4 tempest-VolumesListAdminTestJSON-1270386626 None] Lock "cinder-quobyte-4ef46c3a-a41e-4fcd-bb09-fd95748015d0" released by "delete_volume" :: held 2.844s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:42:57 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-6b1801f9-16de-4581-a006-e984d74f7c68 tempest-VolumesListAdminTestJSON-1306545019 None] Lock "cinder-quobyte-44e9e696-e68d-4156-8475-5538ac72ba10" released by "delete_volume" :: held 2.690s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:42:57 devstack sudo[93869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cdcc9087-1c98-4ad4-b6de-88e8ebc0e502 1073741824
Jul 10 12:42:57 devstack sudo[93869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:42:57 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-6b1801f9-16de-4581-a006-e984d74f7c68 tempest-VolumesListAdminTestJSON-1306545019 None] Created reservations ['0624f69f-1698-488d-a8b9-7eaee3cad18b', '9ff8c47f-5042-4916-bcf7-29b4da268bd0', 'b4d55d75-cc60-4178-bf38-93a65aa687be', 'ec35f7c0-8768-4844-b546-c5e395292e82'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:42:57 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-b4c6a1d5-4a5c-4139-973e-69eff8d567b4 tempest-VolumesListAdminTestJSON-1270386626 None] Created reservations ['cfa30064-53c0-4684-9f96-d043d682f575', 'a2cefe1b-e208-4ec0-8676-54d4a6374703', '81b92c29-0cb5-43f0-8d3d-bc232d310e13', '62547e8b-0771-4584-831e-60a756bd0262'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:42:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-6b1801f9-16de-4581-a006-e984d74f7c68 tempest-VolumesListAdminTestJSON-1306545019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:42:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-6b1801f9-16de-4581-a006-e984d74f7c68 tempest-VolumesListAdminTestJSON-1306545019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:42:57 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-6b1801f9-16de-4581-a006-e984d74f7c68 tempest-VolumesListAdminTestJSON-1306545019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:42:57 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-6b1801f9-16de-4581-a006-e984d74f7c68 tempest-VolumesListAdminTestJSON-1306545019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:42:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-6b1801f9-16de-4581-a006-e984d74f7c68 tempest-VolumesListAdminTestJSON-1306545019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:42:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6b1801f9-16de-4581-a006-e984d74f7c68 tempest-VolumesListAdminTestJSON-1306545019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:42:58 devstack sudo[93871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:42:58 devstack sudo[93871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:42:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-b4c6a1d5-4a5c-4139-973e-69eff8d567b4 tempest-VolumesListAdminTestJSON-1270386626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:42:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-b4c6a1d5-4a5c-4139-973e-69eff8d567b4 tempest-VolumesListAdminTestJSON-1270386626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:42:58 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-b4c6a1d5-4a5c-4139-973e-69eff8d567b4 tempest-VolumesListAdminTestJSON-1270386626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:42:58 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-b4c6a1d5-4a5c-4139-973e-69eff8d567b4 tempest-VolumesListAdminTestJSON-1270386626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:42:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-b4c6a1d5-4a5c-4139-973e-69eff8d567b4 tempest-VolumesListAdminTestJSON-1270386626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:42:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b4c6a1d5-4a5c-4139-973e-69eff8d567b4 tempest-VolumesListAdminTestJSON-1270386626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:42:58 devstack sudo[93873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:42:58 devstack sudo[93873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:42:59 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-040650c9-7056-4867-be7b-644b5817c99c tempest-VolumesListAdminTestJSON-1306545019 None] Acquiring lock "cinder-bc47f89e-a960-4a25-8369-9b772b2cb98e-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:42:59 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-040650c9-7056-4867-be7b-644b5817c99c tempest-VolumesListAdminTestJSON-1306545019 None] Lock "cinder-bc47f89e-a960-4a25-8369-9b772b2cb98e-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:42:59 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-040650c9-7056-4867-be7b-644b5817c99c tempest-VolumesListAdminTestJSON-1306545019 None] Acquiring lock "cinder-quobyte-bc47f89e-a960-4a25-8369-9b772b2cb98e" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:42:59 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-040650c9-7056-4867-be7b-644b5817c99c tempest-VolumesListAdminTestJSON-1306545019 None] Lock "cinder-quobyte-bc47f89e-a960-4a25-8369-9b772b2cb98e" acquired by "delete_volume" :: waited 0.051s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:42:59 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c8f93e-a513-4e26-87ca-095c5a77ea16]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:42:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-040650c9-7056-4867-be7b-644b5817c99c tempest-VolumesListAdminTestJSON-1306545019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-bc47f89e-a960-4a25-8369-9b772b2cb98e {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:42:59 devstack sudo[93871]: pam_unix(sudo:session): session closed for user root
Jul 10 12:42:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6b1801f9-16de-4581-a006-e984d74f7c68 tempest-VolumesListAdminTestJSON-1306545019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 1.651s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:42:59 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-6b1801f9-16de-4581-a006-e984d74f7c68 tempest-VolumesListAdminTestJSON-1306545019 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:42:59 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-6b1801f9-16de-4581-a006-e984d74f7c68 tempest-VolumesListAdminTestJSON-1306545019 None] Deleted volume successfully.
Jul 10 12:42:59 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-6b1801f9-16de-4581-a006-e984d74f7c68 tempest-VolumesListAdminTestJSON-1306545019 None] Lock "cinder-44e9e696-e68d-4156-8475-5538ac72ba10-delete_volume" released by "delete_volume" :: held 4.777s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:42:59 devstack sudo[93869]: pam_unix(sudo:session): session closed for user root
Jul 10 12:42:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cdcc9087-1c98-4ad4-b6de-88e8ebc0e502 1073741824" returned: 0 in 2.056s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:42:59 devstack sudo[93873]: pam_unix(sudo:session): session closed for user root
Jul 10 12:42:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b4c6a1d5-4a5c-4139-973e-69eff8d567b4 tempest-VolumesListAdminTestJSON-1270386626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 1.595s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:42:59 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-b4c6a1d5-4a5c-4139-973e-69eff8d567b4 tempest-VolumesListAdminTestJSON-1270386626 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:42:59 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-b4c6a1d5-4a5c-4139-973e-69eff8d567b4 tempest-VolumesListAdminTestJSON-1270386626 None] Deleted volume successfully.
Jul 10 12:42:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cdcc9087-1c98-4ad4-b6de-88e8ebc0e502 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:42:59 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b4c6a1d5-4a5c-4139-973e-69eff8d567b4 tempest-VolumesListAdminTestJSON-1270386626 None] Lock "cinder-4ef46c3a-a41e-4fcd-bb09-fd95748015d0-delete_volume" released by "delete_volume" :: held 5.153s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:42:59 devstack sudo[93886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cdcc9087-1c98-4ad4-b6de-88e8ebc0e502
Jul 10 12:42:59 devstack sudo[93886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:42:59 devstack sudo[93885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-bc47f89e-a960-4a25-8369-9b772b2cb98e
Jul 10 12:42:59 devstack sudo[93885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:00 devstack sudo[93886]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cdcc9087-1c98-4ad4-b6de-88e8ebc0e502" returned: 0 in 0.907s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:00 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] <== create_volume: return (3067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:43:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.070s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:43:00 devstack cinder-volume[87378]: DEBUG cinder.volume.volume_utils [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] Attempting download of c73e431b-92e2-4ca0-8142-903361296a8f ((None, [{'url': 'file:///opt/stack/data/glance/images/c73e431b-92e2-4ca0-8142-903361296a8f', 'metadata': {}}])) to volume cdcc9087-1c98-4ad4-b6de-88e8ebc0e502. {{(pid=87378) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 10 12:43:00 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[7faed344-eabe-4aa7-8985-bae934b63a4d]: (4, 'raw') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:43:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c73e431b-92e2-4ca0-8142-903361296a8f_wt8vzzmn {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:00 devstack sudo[93893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c73e431b-92e2-4ca0-8142-903361296a8f_wt8vzzmn
Jul 10 12:43:00 devstack sudo[93893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:01 devstack sudo[93885]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-040650c9-7056-4867-be7b-644b5817c99c tempest-VolumesListAdminTestJSON-1306545019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-bc47f89e-a960-4a25-8369-9b772b2cb98e" returned: 0 in 1.441s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-040650c9-7056-4867-be7b-644b5817c99c tempest-VolumesListAdminTestJSON-1306545019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-bc47f89e-a960-4a25-8369-9b772b2cb98e {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:01 devstack sudo[93896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-bc47f89e-a960-4a25-8369-9b772b2cb98e
Jul 10 12:43:01 devstack sudo[93896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:01 devstack sudo[93893]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c73e431b-92e2-4ca0-8142-903361296a8f_wt8vzzmn" returned: 0 in 0.987s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c73e431b-92e2-4ca0-8142-903361296a8f_wt8vzzmn {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:01 devstack sudo[93896]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-040650c9-7056-4867-be7b-644b5817c99c tempest-VolumesListAdminTestJSON-1306545019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-bc47f89e-a960-4a25-8369-9b772b2cb98e" returned: 0 in 0.861s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:01 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-040650c9-7056-4867-be7b-644b5817c99c tempest-VolumesListAdminTestJSON-1306545019 None] Lock "cinder-quobyte-bc47f89e-a960-4a25-8369-9b772b2cb98e" released by "delete_volume" :: held 2.420s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:43:01 devstack sudo[93901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c73e431b-92e2-4ca0-8142-903361296a8f_wt8vzzmn
Jul 10 12:43:01 devstack sudo[93901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:01 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-040650c9-7056-4867-be7b-644b5817c99c tempest-VolumesListAdminTestJSON-1306545019 None] Created reservations ['d4fe4bfd-0df8-48f3-95c3-eaa4020f1453', '139b5e7e-90fa-4c1f-b126-6faa81e2ee0a', '56f5451c-b08e-4b7e-a535-19df38004e4c', '318a2d5c-d17e-4152-9e36-fa60dac58d60'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:43:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-040650c9-7056-4867-be7b-644b5817c99c tempest-VolumesListAdminTestJSON-1306545019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:43:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-040650c9-7056-4867-be7b-644b5817c99c tempest-VolumesListAdminTestJSON-1306545019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:43:02 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-040650c9-7056-4867-be7b-644b5817c99c tempest-VolumesListAdminTestJSON-1306545019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:43:02 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-040650c9-7056-4867-be7b-644b5817c99c tempest-VolumesListAdminTestJSON-1306545019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:43:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-040650c9-7056-4867-be7b-644b5817c99c tempest-VolumesListAdminTestJSON-1306545019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:43:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-040650c9-7056-4867-be7b-644b5817c99c tempest-VolumesListAdminTestJSON-1306545019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:02 devstack sudo[93903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:43:02 devstack sudo[93903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:02 devstack sudo[93901]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c73e431b-92e2-4ca0-8142-903361296a8f_wt8vzzmn" returned: 1 in 1.018s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c73e431b-92e2-4ca0-8142-903361296a8f_wt8vzzmn' failed. Not Retrying. {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 10 12:43:02 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b813f7b-559e-4eb1-8a9a-f2cf7c7fbbf2]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:43:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_nz6qp7hydevstack@QuobyteHD {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:03 devstack sudo[93907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_nz6qp7hydevstack@QuobyteHD
Jul 10 12:43:03 devstack sudo[93907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:03 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-76935b75-d531-4389-874d-3b9cd1fe3236 tempest-VolumesListAdminTestJSON-1306545019 None] Acquiring lock "cinder-cbb0b8cb-0c87-4456-984a-e812c6f8511b-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:43:03 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-76935b75-d531-4389-874d-3b9cd1fe3236 tempest-VolumesListAdminTestJSON-1306545019 None] Lock "cinder-cbb0b8cb-0c87-4456-984a-e812c6f8511b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:43:03 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-76935b75-d531-4389-874d-3b9cd1fe3236 tempest-VolumesListAdminTestJSON-1306545019 None] Acquiring lock "cinder-quobyte-cbb0b8cb-0c87-4456-984a-e812c6f8511b" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:43:03 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-76935b75-d531-4389-874d-3b9cd1fe3236 tempest-VolumesListAdminTestJSON-1306545019 None] Lock "cinder-quobyte-cbb0b8cb-0c87-4456-984a-e812c6f8511b" acquired by "delete_volume" :: waited 0.039s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:43:03 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec87fa2b-5eee-401c-867b-d33dc310b2cf]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:43:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-76935b75-d531-4389-874d-3b9cd1fe3236 tempest-VolumesListAdminTestJSON-1306545019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cbb0b8cb-0c87-4456-984a-e812c6f8511b {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:03 devstack sudo[93903]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-040650c9-7056-4867-be7b-644b5817c99c tempest-VolumesListAdminTestJSON-1306545019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 1.335s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:03 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-040650c9-7056-4867-be7b-644b5817c99c tempest-VolumesListAdminTestJSON-1306545019 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:43:03 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-040650c9-7056-4867-be7b-644b5817c99c tempest-VolumesListAdminTestJSON-1306545019 None] Deleted volume successfully.
Jul 10 12:43:03 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-040650c9-7056-4867-be7b-644b5817c99c tempest-VolumesListAdminTestJSON-1306545019 None] Lock "cinder-bc47f89e-a960-4a25-8369-9b772b2cb98e-delete_volume" released by "delete_volume" :: held 4.178s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:43:03 devstack sudo[93910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cbb0b8cb-0c87-4456-984a-e812c6f8511b
Jul 10 12:43:03 devstack sudo[93910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:04 devstack sudo[93907]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_nz6qp7hydevstack@QuobyteHD" returned: 0 in 1.651s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:04 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] c73e431b-92e2-4ca0-8142-903361296a8f was qcow2, converting to raw {{(pid=87378) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 10 12:43:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_nz6qp7hydevstack@QuobyteHD /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cdcc9087-1c98-4ad4-b6de-88e8ebc0e502 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:04 devstack sudo[93919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_nz6qp7hydevstack@QuobyteHD /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cdcc9087-1c98-4ad4-b6de-88e8ebc0e502
Jul 10 12:43:04 devstack sudo[93919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:04 devstack sudo[93910]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-76935b75-d531-4389-874d-3b9cd1fe3236 tempest-VolumesListAdminTestJSON-1306545019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cbb0b8cb-0c87-4456-984a-e812c6f8511b" returned: 0 in 1.289s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-76935b75-d531-4389-874d-3b9cd1fe3236 tempest-VolumesListAdminTestJSON-1306545019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cbb0b8cb-0c87-4456-984a-e812c6f8511b {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:04 devstack sudo[93921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cbb0b8cb-0c87-4456-984a-e812c6f8511b
Jul 10 12:43:04 devstack sudo[93921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:05 devstack sudo[93921]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-76935b75-d531-4389-874d-3b9cd1fe3236 tempest-VolumesListAdminTestJSON-1306545019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cbb0b8cb-0c87-4456-984a-e812c6f8511b" returned: 0 in 0.901s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:05 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-76935b75-d531-4389-874d-3b9cd1fe3236 tempest-VolumesListAdminTestJSON-1306545019 None] Lock "cinder-quobyte-cbb0b8cb-0c87-4456-984a-e812c6f8511b" released by "delete_volume" :: held 2.300s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:43:05 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-76935b75-d531-4389-874d-3b9cd1fe3236 tempest-VolumesListAdminTestJSON-1306545019 None] Created reservations ['86b386a2-d1bc-4bb5-83b2-18c2c8c9e4fc', '5e6ce545-9e09-4441-bed5-46559ab21a07', 'ae6bda84-054a-434f-9bf6-62ba88271efd', '5c99a08f-7d46-4a22-8aed-a8203d34493f'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:43:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-76935b75-d531-4389-874d-3b9cd1fe3236 tempest-VolumesListAdminTestJSON-1306545019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:43:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-76935b75-d531-4389-874d-3b9cd1fe3236 tempest-VolumesListAdminTestJSON-1306545019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:43:05 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-76935b75-d531-4389-874d-3b9cd1fe3236 tempest-VolumesListAdminTestJSON-1306545019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:43:05 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-76935b75-d531-4389-874d-3b9cd1fe3236 tempest-VolumesListAdminTestJSON-1306545019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:43:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-76935b75-d531-4389-874d-3b9cd1fe3236 tempest-VolumesListAdminTestJSON-1306545019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:43:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-76935b75-d531-4389-874d-3b9cd1fe3236 tempest-VolumesListAdminTestJSON-1306545019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:05 devstack sudo[93931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:43:05 devstack sudo[93931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:06 devstack sudo[93931]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-76935b75-d531-4389-874d-3b9cd1fe3236 tempest-VolumesListAdminTestJSON-1306545019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.876s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:06 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-76935b75-d531-4389-874d-3b9cd1fe3236 tempest-VolumesListAdminTestJSON-1306545019 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:43:06 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-76935b75-d531-4389-874d-3b9cd1fe3236 tempest-VolumesListAdminTestJSON-1306545019 None] Deleted volume successfully.
Jul 10 12:43:06 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-76935b75-d531-4389-874d-3b9cd1fe3236 tempest-VolumesListAdminTestJSON-1306545019 None] Lock "cinder-cbb0b8cb-0c87-4456-984a-e812c6f8511b-delete_volume" released by "delete_volume" :: held 3.533s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:43:06 devstack sudo[93919]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_nz6qp7hydevstack@QuobyteHD /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cdcc9087-1c98-4ad4-b6de-88e8ebc0e502" returned: 0 in 2.477s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:06 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_nz6qp7hydevstack@QuobyteHD, size 112.00 MB, duration 2.48 sec, destination /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cdcc9087-1c98-4ad4-b6de-88e8ebc0e502 {{(pid=87378) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 10 12:43:06 devstack cinder-volume[87378]: INFO cinder.image.image_utils [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] Converted 112.00 MB image at 45.14 MB/s
Jul 10 12:43:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cdcc9087-1c98-4ad4-b6de-88e8ebc0e502 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:07 devstack sudo[93934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cdcc9087-1c98-4ad4-b6de-88e8ebc0e502 1G
Jul 10 12:43:07 devstack sudo[93934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:07 devstack sudo[93934]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cdcc9087-1c98-4ad4-b6de-88e8ebc0e502 1G" returned: 0 in 0.892s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:07 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[36676257-0977-4d7c-b91d-d2e6c8f4c3f7]: (4, 'raw') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:43:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cdcc9087-1c98-4ad4-b6de-88e8ebc0e502 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:08 devstack sudo[93939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cdcc9087-1c98-4ad4-b6de-88e8ebc0e502
Jul 10 12:43:08 devstack sudo[93939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:09 devstack sudo[93939]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cdcc9087-1c98-4ad4-b6de-88e8ebc0e502" returned: 0 in 1.222s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cdcc9087-1c98-4ad4-b6de-88e8ebc0e502 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:09 devstack sudo[93947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cdcc9087-1c98-4ad4-b6de-88e8ebc0e502
Jul 10 12:43:09 devstack sudo[93947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:10 devstack sudo[93947]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cdcc9087-1c98-4ad4-b6de-88e8ebc0e502" returned: 1 in 1.066s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cdcc9087-1c98-4ad4-b6de-88e8ebc0e502' failed. Not Retrying. {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 10 12:43:10 devstack cinder-volume[87378]: DEBUG cinder.volume.volume_utils [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] Downloaded image c73e431b-92e2-4ca0-8142-903361296a8f ((None, [{'url': 'file:///opt/stack/data/glance/images/c73e431b-92e2-4ca0-8142-903361296a8f', 'metadata': {}}])) to volume cdcc9087-1c98-4ad4-b6de-88e8ebc0e502 successfully. {{(pid=87378) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 10 12:43:10 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] Temporary image c73e431b-92e2-4ca0-8142-903361296a8f for user 142f9eab4dbb4e12a2f878e6f35a930c is deleted. {{(pid=87378) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 10 12:43:10 devstack cinder-volume[87378]: DEBUG cinder.volume.volume_utils [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] Marking volume cdcc9087-1c98-4ad4-b6de-88e8ebc0e502 as bootable. {{(pid=87378) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 10 12:43:10 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] Copying metadata from image c73e431b-92e2-4ca0-8142-903361296a8f to cdcc9087-1c98-4ad4-b6de-88e8ebc0e502. {{(pid=87378) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 10 12:43:10 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] Creating volume glance metadata for volume cdcc9087-1c98-4ad4-b6de-88e8ebc0e502 backed by image c73e431b-92e2-4ca0-8142-903361296a8f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c73e431b-92e2-4ca0-8142-903361296a8f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87378) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 10 12:43:10 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d04a9fe-8a0b-4825-8f4b-224e001a0b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdcc9087-1c98-4ad4-b6de-88e8ebc0e502', 'volume_size': 1, 'image_id': 'c73e431b-92e2-4ca0-8142-903361296a8f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c73e431b-92e2-4ca0-8142-903361296a8f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ea129ca6c904ec8b3827a458726b692', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c73e431b-92e2-4ca0-8142-903361296a8f', 'created_at': datetime.datetime(2026, 7, 10, 10, 26, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 10, 26, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c73e431b-92e2-4ca0-8142-903361296a8f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74a0ab9a4c50>}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:43:10 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30dfa2ec-228c-47bb-98cb-716060d14f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:43:10 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] Volume volume-cdcc9087-1c98-4ad4-b6de-88e8ebc0e502 (cdcc9087-1c98-4ad4-b6de-88e8ebc0e502): created successfully
Jul 10 12:43:10 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30dfa2ec-228c-47bb-98cb-716060d14f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:43:10 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] Flow 'volume_create_manager' (428ebdeb-2b77-425e-a54f-95502348c740) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:43:10 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-ddac07a5-b5e1-4888-8b3c-160d81e8d93d tempest-VolumesImageMetadata-885578317 None] Created volume successfully.
Jul 10 12:43:11 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-960c355a-2324-4277-8e23-2e644c564ce1 tempest-VolumesImageMetadata-885578317 None] Acquiring lock "cinder-cdcc9087-1c98-4ad4-b6de-88e8ebc0e502-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:43:11 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-960c355a-2324-4277-8e23-2e644c564ce1 tempest-VolumesImageMetadata-885578317 None] Lock "cinder-cdcc9087-1c98-4ad4-b6de-88e8ebc0e502-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:43:11 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-960c355a-2324-4277-8e23-2e644c564ce1 tempest-VolumesImageMetadata-885578317 None] Acquiring lock "cinder-quobyte-cdcc9087-1c98-4ad4-b6de-88e8ebc0e502" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:43:11 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-960c355a-2324-4277-8e23-2e644c564ce1 tempest-VolumesImageMetadata-885578317 None] Lock "cinder-quobyte-cdcc9087-1c98-4ad4-b6de-88e8ebc0e502" acquired by "delete_volume" :: waited 0.026s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:43:12 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0809ea-e0d5-4d27-8314-d2b344ffcb29]: (4, 'raw') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:43:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-960c355a-2324-4277-8e23-2e644c564ce1 tempest-VolumesImageMetadata-885578317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cdcc9087-1c98-4ad4-b6de-88e8ebc0e502 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:12 devstack sudo[93959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cdcc9087-1c98-4ad4-b6de-88e8ebc0e502
Jul 10 12:43:12 devstack sudo[93959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:12 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-67c20c4a-b30d-4b90-954e-f17ad07c3001 tempest-VolumesMetadataTest-1461929025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:43:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-67c20c4a-b30d-4b90-954e-f17ad07c3001 tempest-VolumesMetadataTest-1461929025 None] Flow 'volume_create_manager' (ce45efc4-f318-4939-bec2-be7cf95eefef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:43:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-67c20c4a-b30d-4b90-954e-f17ad07c3001 tempest-VolumesMetadataTest-1461929025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dded11a-2dd2-48be-aeff-42d41c7038f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:43:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-67c20c4a-b30d-4b90-954e-f17ad07c3001 tempest-VolumesMetadataTest-1461929025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dded11a-2dd2-48be-aeff-42d41c7038f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:43:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1976453921',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc2b2e6d-9478-4736-9c0b-2c4351625cb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb17485569444bf392f4d540a17ae63c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:43:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:43:12Z,use_quota=True,user_id='1c0ae2ffa4154a95a54ce32a826df6ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:43:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-67c20c4a-b30d-4b90-954e-f17ad07c3001 tempest-VolumesMetadataTest-1461929025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3324770c-e1c1-4c4c-9129-52d76de39ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:43:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-67c20c4a-b30d-4b90-954e-f17ad07c3001 tempest-VolumesMetadataTest-1461929025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3324770c-e1c1-4c4c-9129-52d76de39ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:43:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-67c20c4a-b30d-4b90-954e-f17ad07c3001 tempest-VolumesMetadataTest-1461929025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0db4443b-a0ea-44e3-ab4f-0de5af9383e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:43:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-67c20c4a-b30d-4b90-954e-f17ad07c3001 tempest-VolumesMetadataTest-1461929025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0db4443b-a0ea-44e3-ab4f-0de5af9383e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc2b2e6d-9478-4736-9c0b-2c4351625cb0', 'volume_name': 'volume-dc2b2e6d-9478-4736-9c0b-2c4351625cb0', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:43:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-67c20c4a-b30d-4b90-954e-f17ad07c3001 tempest-VolumesMetadataTest-1461929025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f06c396e-9b91-407d-9ad8-eb4daa399f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:43:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-67c20c4a-b30d-4b90-954e-f17ad07c3001 tempest-VolumesMetadataTest-1461929025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f06c396e-9b91-407d-9ad8-eb4daa399f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:43:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-67c20c4a-b30d-4b90-954e-f17ad07c3001 tempest-VolumesMetadataTest-1461929025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b820bc98-172f-47f4-a711-af6f06b9724a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:43:12 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-67c20c4a-b30d-4b90-954e-f17ad07c3001 tempest-VolumesMetadataTest-1461929025 None] Volume dc2b2e6d-9478-4736-9c0b-2c4351625cb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc2b2e6d-9478-4736-9c0b-2c4351625cb0', 'volume_size': 1}
Jul 10 12:43:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-67c20c4a-b30d-4b90-954e-f17ad07c3001 tempest-VolumesMetadataTest-1461929025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:43:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-67c20c4a-b30d-4b90-954e-f17ad07c3001 tempest-VolumesMetadataTest-1461929025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:43:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-67c20c4a-b30d-4b90-954e-f17ad07c3001 tempest-VolumesMetadataTest-1461929025 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:43:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1976453921',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc2b2e6d-9478-4736-9c0b-2c4351625cb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb17485569444bf392f4d540a17ae63c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:43:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:43:12Z,use_quota=True,user_id='1c0ae2ffa4154a95a54ce32a826df6ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:43:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-67c20c4a-b30d-4b90-954e-f17ad07c3001 tempest-VolumesMetadataTest-1461929025 None] Creating volume dc2b2e6d-9478-4736-9c0b-2c4351625cb0 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:43:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-67c20c4a-b30d-4b90-954e-f17ad07c3001 tempest-VolumesMetadataTest-1461929025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:43:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-67c20c4a-b30d-4b90-954e-f17ad07c3001 tempest-VolumesMetadataTest-1461929025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:43:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-67c20c4a-b30d-4b90-954e-f17ad07c3001 tempest-VolumesMetadataTest-1461929025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:43:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-67c20c4a-b30d-4b90-954e-f17ad07c3001 tempest-VolumesMetadataTest-1461929025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:43:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-67c20c4a-b30d-4b90-954e-f17ad07c3001 tempest-VolumesMetadataTest-1461929025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:43:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-67c20c4a-b30d-4b90-954e-f17ad07c3001 tempest-VolumesMetadataTest-1461929025 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:43:12 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-67c20c4a-b30d-4b90-954e-f17ad07c3001 tempest-VolumesMetadataTest-1461929025 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:43:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-67c20c4a-b30d-4b90-954e-f17ad07c3001 tempest-VolumesMetadataTest-1461929025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-dc2b2e6d-9478-4736-9c0b-2c4351625cb0 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:12 devstack sudo[93985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-dc2b2e6d-9478-4736-9c0b-2c4351625cb0 1073741824
Jul 10 12:43:12 devstack sudo[93985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:12 devstack sudo[93959]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-960c355a-2324-4277-8e23-2e644c564ce1 tempest-VolumesImageMetadata-885578317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cdcc9087-1c98-4ad4-b6de-88e8ebc0e502" returned: 0 in 0.779s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-960c355a-2324-4277-8e23-2e644c564ce1 tempest-VolumesImageMetadata-885578317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cdcc9087-1c98-4ad4-b6de-88e8ebc0e502 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:12 devstack sudo[93989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cdcc9087-1c98-4ad4-b6de-88e8ebc0e502
Jul 10 12:43:12 devstack sudo[93989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:12 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:43:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:43:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:43:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:43:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:43:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:43:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:12 devstack sudo[93995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:43:12 devstack sudo[93995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:13 devstack sudo[93985]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-67c20c4a-b30d-4b90-954e-f17ad07c3001 tempest-VolumesMetadataTest-1461929025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-dc2b2e6d-9478-4736-9c0b-2c4351625cb0 1073741824" returned: 0 in 0.911s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-67c20c4a-b30d-4b90-954e-f17ad07c3001 tempest-VolumesMetadataTest-1461929025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-dc2b2e6d-9478-4736-9c0b-2c4351625cb0 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:13 devstack sudo[93997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-dc2b2e6d-9478-4736-9c0b-2c4351625cb0
Jul 10 12:43:13 devstack sudo[93997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:13 devstack sudo[93989]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-960c355a-2324-4277-8e23-2e644c564ce1 tempest-VolumesImageMetadata-885578317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cdcc9087-1c98-4ad4-b6de-88e8ebc0e502" returned: 1 in 0.791s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-960c355a-2324-4277-8e23-2e644c564ce1 tempest-VolumesImageMetadata-885578317 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cdcc9087-1c98-4ad4-b6de-88e8ebc0e502' failed. Not Retrying. {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 10 12:43:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-960c355a-2324-4277-8e23-2e644c564ce1 tempest-VolumesImageMetadata-885578317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cdcc9087-1c98-4ad4-b6de-88e8ebc0e502 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:13 devstack sudo[94003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cdcc9087-1c98-4ad4-b6de-88e8ebc0e502
Jul 10 12:43:13 devstack sudo[94003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:13 devstack sudo[93995]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.719s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:13 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:43:13 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager._thread_info {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:43:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread count: 28 {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 10 12:43:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread info: [<_MainThread(MainThread, started 128233544536192)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128233445424704)>, <Thread(Thread-3 (stat_writer), started daemon 128233435118528)>, <Thread(Rabbit-heartbeat, started daemon 128233435718016)>, <Thread(Thread-5 (_runner), started daemon 128233432624448)>, <Thread(Thread-7 (_runner), started daemon 128233432674688)>, <Thread(fd_logger, started daemon 128233428569472)>, <Thread(privsep_reader, started daemon 128233429417088)>, <Thread(tpool_thread_0, started daemon 128233421182656)>, <Thread(tpool_thread_1, started daemon 128233412789952)>, <Thread(tpool_thread_2, started daemon 128233404397248)>, <Thread(tpool_thread_3, started daemon 128233396004544)>, <Thread(tpool_thread_4, started daemon 128233387611840)>, <Thread(tpool_thread_5, started daemon 128233379219136)>, <Thread(tpool_thread_6, started daemon 128233370826432)>, <Thread(tpool_thread_7, started daemon 128233362433728)>, <Thread(tpool_thread_8, started daemon 128233354041024)>, <Thread(tpool_thread_9, started daemon 128233345631936)>, <Thread(tpool_thread_10, started daemon 128233337222848)>, <Thread(tpool_thread_11, started daemon 128233328813760)>, <Thread(tpool_thread_12, started daemon 128233320404672)>, <Thread(tpool_thread_13, started daemon 128233311995584)>, <Thread(tpool_thread_14, started daemon 128233303586496)>, <Thread(tpool_thread_15, started daemon 128233295177408)>, <Thread(tpool_thread_16, started daemon 128233286768320)>, <Thread(tpool_thread_17, started daemon 128233278359232)>, <Thread(tpool_thread_18, started daemon 128233269950144)>, <Thread(tpool_thread_19, started daemon 128233261541056)>] {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 10 12:43:13 devstack sudo[93997]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-67c20c4a-b30d-4b90-954e-f17ad07c3001 tempest-VolumesMetadataTest-1461929025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-dc2b2e6d-9478-4736-9c0b-2c4351625cb0" returned: 0 in 0.712s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:13 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-67c20c4a-b30d-4b90-954e-f17ad07c3001 tempest-VolumesMetadataTest-1461929025 None] <== create_volume: return (1682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:43:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-67c20c4a-b30d-4b90-954e-f17ad07c3001 tempest-VolumesMetadataTest-1461929025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.684s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:43:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-67c20c4a-b30d-4b90-954e-f17ad07c3001 tempest-VolumesMetadataTest-1461929025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b820bc98-172f-47f4-a711-af6f06b9724a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc2b2e6d-9478-4736-9c0b-2c4351625cb0', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:43:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-67c20c4a-b30d-4b90-954e-f17ad07c3001 tempest-VolumesMetadataTest-1461929025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80cf4281-cc18-4619-88b1-48a7eb89320b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:43:13 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-67c20c4a-b30d-4b90-954e-f17ad07c3001 tempest-VolumesMetadataTest-1461929025 None] Volume volume-dc2b2e6d-9478-4736-9c0b-2c4351625cb0 (dc2b2e6d-9478-4736-9c0b-2c4351625cb0): created successfully
Jul 10 12:43:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-67c20c4a-b30d-4b90-954e-f17ad07c3001 tempest-VolumesMetadataTest-1461929025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80cf4281-cc18-4619-88b1-48a7eb89320b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:43:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-67c20c4a-b30d-4b90-954e-f17ad07c3001 tempest-VolumesMetadataTest-1461929025 None] Flow 'volume_create_manager' (ce45efc4-f318-4939-bec2-be7cf95eefef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:43:13 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-67c20c4a-b30d-4b90-954e-f17ad07c3001 tempest-VolumesMetadataTest-1461929025 None] Created volume successfully.
Jul 10 12:43:14 devstack sudo[94003]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-960c355a-2324-4277-8e23-2e644c564ce1 tempest-VolumesImageMetadata-885578317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cdcc9087-1c98-4ad4-b6de-88e8ebc0e502" returned: 0 in 0.722s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:14 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-960c355a-2324-4277-8e23-2e644c564ce1 tempest-VolumesImageMetadata-885578317 None] Lock "cinder-quobyte-cdcc9087-1c98-4ad4-b6de-88e8ebc0e502" released by "delete_volume" :: held 2.369s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:43:14 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-960c355a-2324-4277-8e23-2e644c564ce1 tempest-VolumesImageMetadata-885578317 None] Created reservations ['8387cba0-6eb8-457f-80c0-595a373a978f', 'e780b158-4ccc-411c-843f-03682e9d337f', '703fbb94-f98e-47c3-acbd-5fe3c8dd887a', 'd8fd69a1-ab6b-4839-9869-770597d1a838'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:43:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-960c355a-2324-4277-8e23-2e644c564ce1 tempest-VolumesImageMetadata-885578317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:43:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-960c355a-2324-4277-8e23-2e644c564ce1 tempest-VolumesImageMetadata-885578317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:43:14 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-960c355a-2324-4277-8e23-2e644c564ce1 tempest-VolumesImageMetadata-885578317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:43:14 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-960c355a-2324-4277-8e23-2e644c564ce1 tempest-VolumesImageMetadata-885578317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:43:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-960c355a-2324-4277-8e23-2e644c564ce1 tempest-VolumesImageMetadata-885578317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:43:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-960c355a-2324-4277-8e23-2e644c564ce1 tempest-VolumesImageMetadata-885578317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:14 devstack sudo[94007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:43:14 devstack sudo[94007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:15 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3e0fb73c-e0d5-4e55-bc6c-f06cec94593d tempest-VolumesMetadataTest-1461929025 None] Acquiring lock "cinder-dc2b2e6d-9478-4736-9c0b-2c4351625cb0-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:43:15 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3e0fb73c-e0d5-4e55-bc6c-f06cec94593d tempest-VolumesMetadataTest-1461929025 None] Lock "cinder-dc2b2e6d-9478-4736-9c0b-2c4351625cb0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:43:15 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3e0fb73c-e0d5-4e55-bc6c-f06cec94593d tempest-VolumesMetadataTest-1461929025 None] Acquiring lock "cinder-quobyte-dc2b2e6d-9478-4736-9c0b-2c4351625cb0" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:43:15 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3e0fb73c-e0d5-4e55-bc6c-f06cec94593d tempest-VolumesMetadataTest-1461929025 None] Lock "cinder-quobyte-dc2b2e6d-9478-4736-9c0b-2c4351625cb0" acquired by "delete_volume" :: waited 0.024s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:43:15 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d4149d-1a1a-47ba-b18e-8a1f4fc64405]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:43:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3e0fb73c-e0d5-4e55-bc6c-f06cec94593d tempest-VolumesMetadataTest-1461929025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-dc2b2e6d-9478-4736-9c0b-2c4351625cb0 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:15 devstack sudo[94009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-dc2b2e6d-9478-4736-9c0b-2c4351625cb0
Jul 10 12:43:15 devstack sudo[94009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:15 devstack sudo[94007]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-960c355a-2324-4277-8e23-2e644c564ce1 tempest-VolumesImageMetadata-885578317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.978s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:15 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-960c355a-2324-4277-8e23-2e644c564ce1 tempest-VolumesImageMetadata-885578317 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:43:15 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-960c355a-2324-4277-8e23-2e644c564ce1 tempest-VolumesImageMetadata-885578317 None] Deleted volume successfully.
Jul 10 12:43:15 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-960c355a-2324-4277-8e23-2e644c564ce1 tempest-VolumesImageMetadata-885578317 None] Lock "cinder-cdcc9087-1c98-4ad4-b6de-88e8ebc0e502-delete_volume" released by "delete_volume" :: held 3.632s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:43:16 devstack sudo[94009]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3e0fb73c-e0d5-4e55-bc6c-f06cec94593d tempest-VolumesMetadataTest-1461929025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-dc2b2e6d-9478-4736-9c0b-2c4351625cb0" returned: 0 in 1.047s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3e0fb73c-e0d5-4e55-bc6c-f06cec94593d tempest-VolumesMetadataTest-1461929025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-dc2b2e6d-9478-4736-9c0b-2c4351625cb0 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:16 devstack sudo[94015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-dc2b2e6d-9478-4736-9c0b-2c4351625cb0
Jul 10 12:43:16 devstack sudo[94015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:17 devstack sudo[94015]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3e0fb73c-e0d5-4e55-bc6c-f06cec94593d tempest-VolumesMetadataTest-1461929025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-dc2b2e6d-9478-4736-9c0b-2c4351625cb0" returned: 0 in 1.015s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:17 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3e0fb73c-e0d5-4e55-bc6c-f06cec94593d tempest-VolumesMetadataTest-1461929025 None] Lock "cinder-quobyte-dc2b2e6d-9478-4736-9c0b-2c4351625cb0" released by "delete_volume" :: held 2.150s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:43:17 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-3e0fb73c-e0d5-4e55-bc6c-f06cec94593d tempest-VolumesMetadataTest-1461929025 None] Created reservations ['b238e845-fa48-43b7-9d04-9ec1b1079422', 'fe6faabf-5bcf-4b0f-8b06-eee9a452771c', 'f17785db-ddc3-4a5a-803e-1f1b4bd451b7', 'e06ee14f-73e4-4649-a344-bce94f8c9815'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:43:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3e0fb73c-e0d5-4e55-bc6c-f06cec94593d tempest-VolumesMetadataTest-1461929025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:43:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3e0fb73c-e0d5-4e55-bc6c-f06cec94593d tempest-VolumesMetadataTest-1461929025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:43:17 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3e0fb73c-e0d5-4e55-bc6c-f06cec94593d tempest-VolumesMetadataTest-1461929025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:43:17 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3e0fb73c-e0d5-4e55-bc6c-f06cec94593d tempest-VolumesMetadataTest-1461929025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:43:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3e0fb73c-e0d5-4e55-bc6c-f06cec94593d tempest-VolumesMetadataTest-1461929025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:43:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3e0fb73c-e0d5-4e55-bc6c-f06cec94593d tempest-VolumesMetadataTest-1461929025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:17 devstack sudo[94071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:43:17 devstack sudo[94071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:18 devstack sudo[94071]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3e0fb73c-e0d5-4e55-bc6c-f06cec94593d tempest-VolumesMetadataTest-1461929025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.783s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:18 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-3e0fb73c-e0d5-4e55-bc6c-f06cec94593d tempest-VolumesMetadataTest-1461929025 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:43:18 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-3e0fb73c-e0d5-4e55-bc6c-f06cec94593d tempest-VolumesMetadataTest-1461929025 None] Deleted volume successfully.
Jul 10 12:43:18 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3e0fb73c-e0d5-4e55-bc6c-f06cec94593d tempest-VolumesMetadataTest-1461929025 None] Lock "cinder-dc2b2e6d-9478-4736-9c0b-2c4351625cb0-delete_volume" released by "delete_volume" :: held 3.236s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:43:19 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b893dd2-ab93-40db-92d0-73d92e1f4e6f tempest-SnapshotMetadataTestJSON-733843792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:43:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1b893dd2-ab93-40db-92d0-73d92e1f4e6f tempest-SnapshotMetadataTestJSON-733843792 None] Flow 'volume_create_manager' (1727f950-1ce0-46d8-9111-04b2c4dacda8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:43:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1b893dd2-ab93-40db-92d0-73d92e1f4e6f tempest-SnapshotMetadataTestJSON-733843792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4918442-7f95-4115-9343-601dda06c36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:43:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1b893dd2-ab93-40db-92d0-73d92e1f4e6f tempest-SnapshotMetadataTestJSON-733843792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4918442-7f95-4115-9343-601dda06c36c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2048725630',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fa6dc84-5a50-4c77-bc35-51538bcf20fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='541138eb821b404d9ad5f6e4b6805a54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:43:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:43:19Z,use_quota=True,user_id='83c0d16ff9b1414ab5aa24052d54d994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:43:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1b893dd2-ab93-40db-92d0-73d92e1f4e6f tempest-SnapshotMetadataTestJSON-733843792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (757bc622-f43f-416e-b8cc-848ba2e6e7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:43:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1b893dd2-ab93-40db-92d0-73d92e1f4e6f tempest-SnapshotMetadataTestJSON-733843792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (757bc622-f43f-416e-b8cc-848ba2e6e7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:43:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1b893dd2-ab93-40db-92d0-73d92e1f4e6f tempest-SnapshotMetadataTestJSON-733843792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deb6fb31-9a9f-4440-85d3-7d50313f96a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:43:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1b893dd2-ab93-40db-92d0-73d92e1f4e6f tempest-SnapshotMetadataTestJSON-733843792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deb6fb31-9a9f-4440-85d3-7d50313f96a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fa6dc84-5a50-4c77-bc35-51538bcf20fa', 'volume_name': 'volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:43:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1b893dd2-ab93-40db-92d0-73d92e1f4e6f tempest-SnapshotMetadataTestJSON-733843792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4d4af7e-c977-4aad-929d-cd39b515e2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:43:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1b893dd2-ab93-40db-92d0-73d92e1f4e6f tempest-SnapshotMetadataTestJSON-733843792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4d4af7e-c977-4aad-929d-cd39b515e2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:43:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1b893dd2-ab93-40db-92d0-73d92e1f4e6f tempest-SnapshotMetadataTestJSON-733843792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c47906fd-008e-45cc-afa4-7e09a07a4fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:43:19 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-1b893dd2-ab93-40db-92d0-73d92e1f4e6f tempest-SnapshotMetadataTestJSON-733843792 None] Volume 2fa6dc84-5a50-4c77-bc35-51538bcf20fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa', 'volume_size': 1}
Jul 10 12:43:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1b893dd2-ab93-40db-92d0-73d92e1f4e6f tempest-SnapshotMetadataTestJSON-733843792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:43:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1b893dd2-ab93-40db-92d0-73d92e1f4e6f tempest-SnapshotMetadataTestJSON-733843792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:43:19 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-1b893dd2-ab93-40db-92d0-73d92e1f4e6f tempest-SnapshotMetadataTestJSON-733843792 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2048725630',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fa6dc84-5a50-4c77-bc35-51538bcf20fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='541138eb821b404d9ad5f6e4b6805a54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:43:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:43:19Z,use_quota=True,user_id='83c0d16ff9b1414ab5aa24052d54d994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:43:19 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-1b893dd2-ab93-40db-92d0-73d92e1f4e6f tempest-SnapshotMetadataTestJSON-733843792 None] Creating volume 2fa6dc84-5a50-4c77-bc35-51538bcf20fa {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:43:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1b893dd2-ab93-40db-92d0-73d92e1f4e6f tempest-SnapshotMetadataTestJSON-733843792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:43:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1b893dd2-ab93-40db-92d0-73d92e1f4e6f tempest-SnapshotMetadataTestJSON-733843792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:43:19 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-1b893dd2-ab93-40db-92d0-73d92e1f4e6f tempest-SnapshotMetadataTestJSON-733843792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:43:19 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-1b893dd2-ab93-40db-92d0-73d92e1f4e6f tempest-SnapshotMetadataTestJSON-733843792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:43:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1b893dd2-ab93-40db-92d0-73d92e1f4e6f tempest-SnapshotMetadataTestJSON-733843792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:43:19 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-1b893dd2-ab93-40db-92d0-73d92e1f4e6f tempest-SnapshotMetadataTestJSON-733843792 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:43:19 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-1b893dd2-ab93-40db-92d0-73d92e1f4e6f tempest-SnapshotMetadataTestJSON-733843792 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:43:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1b893dd2-ab93-40db-92d0-73d92e1f4e6f tempest-SnapshotMetadataTestJSON-733843792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:19 devstack sudo[94077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa 1073741824
Jul 10 12:43:19 devstack sudo[94077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:20 devstack sudo[94077]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1b893dd2-ab93-40db-92d0-73d92e1f4e6f tempest-SnapshotMetadataTestJSON-733843792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa 1073741824" returned: 0 in 1.159s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1b893dd2-ab93-40db-92d0-73d92e1f4e6f tempest-SnapshotMetadataTestJSON-733843792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:20 devstack sudo[94112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa
Jul 10 12:43:20 devstack sudo[94112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:21 devstack cinder-volume[87378]: INFO cinder.volume.manager [req-623f5517-2c5d-4e89-91f9-c354e447d9d2 req-e8273650-10cf-4fc9-b21c-fcd9b401261e tempest-AttachVolumeTestJSON-147786180 None] Terminate volume connection completed successfully.
Jul 10 12:43:21 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-623f5517-2c5d-4e89-91f9-c354e447d9d2 req-e8273650-10cf-4fc9-b21c-fcd9b401261e tempest-AttachVolumeTestJSON-147786180 None] Deleting attachment 990fc5f3-c709-488e-b1f4-68088b95333f. {{(pid=87378) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 10 12:43:21 devstack sudo[94112]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1b893dd2-ab93-40db-92d0-73d92e1f4e6f tempest-SnapshotMetadataTestJSON-733843792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa" returned: 0 in 1.092s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:21 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-1b893dd2-ab93-40db-92d0-73d92e1f4e6f tempest-SnapshotMetadataTestJSON-733843792 None] <== create_volume: return (2351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:43:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1b893dd2-ab93-40db-92d0-73d92e1f4e6f tempest-SnapshotMetadataTestJSON-733843792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.355s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:43:21 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1b893dd2-ab93-40db-92d0-73d92e1f4e6f tempest-SnapshotMetadataTestJSON-733843792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c47906fd-008e-45cc-afa4-7e09a07a4fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:43:21 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1b893dd2-ab93-40db-92d0-73d92e1f4e6f tempest-SnapshotMetadataTestJSON-733843792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a04948d-49ac-4eb0-abb4-5d5cd9c11202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:43:21 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-1b893dd2-ab93-40db-92d0-73d92e1f4e6f tempest-SnapshotMetadataTestJSON-733843792 None] Volume volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa (2fa6dc84-5a50-4c77-bc35-51538bcf20fa): created successfully
Jul 10 12:43:21 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1b893dd2-ab93-40db-92d0-73d92e1f4e6f tempest-SnapshotMetadataTestJSON-733843792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a04948d-49ac-4eb0-abb4-5d5cd9c11202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:43:22 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1b893dd2-ab93-40db-92d0-73d92e1f4e6f tempest-SnapshotMetadataTestJSON-733843792 None] Flow 'volume_create_manager' (1727f950-1ce0-46d8-9111-04b2c4dacda8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:43:22 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-1b893dd2-ab93-40db-92d0-73d92e1f4e6f tempest-SnapshotMetadataTestJSON-733843792 None] Created volume successfully.
Jul 10 12:43:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-24a9f3ae-4aa0-4da7-9c77-98992fb78cbe tempest-SnapshotMetadataTestJSON-733843792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:43:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-24a9f3ae-4aa0-4da7-9c77-98992fb78cbe tempest-SnapshotMetadataTestJSON-733843792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:43:23 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-24a9f3ae-4aa0-4da7-9c77-98992fb78cbe tempest-SnapshotMetadataTestJSON-733843792 None] Creating offline snapshot a7492edf-0309-4028-954e-1f402d820d1c of volume 2fa6dc84-5a50-4c77-bc35-51538bcf20fa {{(pid=87378) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 10 12:43:23 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8df464-fba3-44f5-9924-feaa9c21f69c]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:43:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-24a9f3ae-4aa0-4da7-9c77-98992fb78cbe tempest-SnapshotMetadataTestJSON-733843792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:23 devstack sudo[94157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa
Jul 10 12:43:23 devstack sudo[94157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:23 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:SELECT=89,cinder:UPDATE=93,cinder:INSERT=31,cinder:DELETE=7 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:43:24 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-19cfc17a-75a8-49c9-9c8c-20906cce6d53 tempest-VolumesTransfersV355Test-185287744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:43:24 devstack sudo[94157]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:24 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-19cfc17a-75a8-49c9-9c8c-20906cce6d53 tempest-VolumesTransfersV355Test-185287744 None] Flow 'volume_create_manager' (5c64e0d5-5f8d-4c5d-bb11-9a07de7efa2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:43:24 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-19cfc17a-75a8-49c9-9c8c-20906cce6d53 tempest-VolumesTransfersV355Test-185287744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a93e9f4-bed8-4d57-bb44-49f1596643ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:43:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-24a9f3ae-4aa0-4da7-9c77-98992fb78cbe tempest-SnapshotMetadataTestJSON-733843792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa" returned: 0 in 1.027s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-24a9f3ae-4aa0-4da7-9c77-98992fb78cbe tempest-SnapshotMetadataTestJSON-733843792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa.a7492edf-0309-4028-954e-1f402d820d1c 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:24 devstack sudo[94164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa.a7492edf-0309-4028-954e-1f402d820d1c 1G
Jul 10 12:43:24 devstack sudo[94164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:24 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-19cfc17a-75a8-49c9-9c8c-20906cce6d53 tempest-VolumesTransfersV355Test-185287744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a93e9f4-bed8-4d57-bb44-49f1596643ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:43:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-388900183',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14380572-e4cd-4b7c-ac82-217041efd0cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc4fdeb45da640c8a5c123b2e4a3f73b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:43:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:43:24Z,use_quota=True,user_id='d5fffce42d2f4b7cae0972f060cc99ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:43:24 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-19cfc17a-75a8-49c9-9c8c-20906cce6d53 tempest-VolumesTransfersV355Test-185287744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34cbb9be-be52-45d9-8964-67b2247d1934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:43:24 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-19cfc17a-75a8-49c9-9c8c-20906cce6d53 tempest-VolumesTransfersV355Test-185287744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34cbb9be-be52-45d9-8964-67b2247d1934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:43:24 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-19cfc17a-75a8-49c9-9c8c-20906cce6d53 tempest-VolumesTransfersV355Test-185287744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (821a895a-c2a4-4451-9f0f-67d929b7bdb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:43:24 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-19cfc17a-75a8-49c9-9c8c-20906cce6d53 tempest-VolumesTransfersV355Test-185287744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (821a895a-c2a4-4451-9f0f-67d929b7bdb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14380572-e4cd-4b7c-ac82-217041efd0cb', 'volume_name': 'volume-14380572-e4cd-4b7c-ac82-217041efd0cb', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:43:24 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-19cfc17a-75a8-49c9-9c8c-20906cce6d53 tempest-VolumesTransfersV355Test-185287744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25735eb3-afd2-45e0-a42a-01b60728f16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:43:24 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-19cfc17a-75a8-49c9-9c8c-20906cce6d53 tempest-VolumesTransfersV355Test-185287744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25735eb3-afd2-45e0-a42a-01b60728f16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:43:24 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-19cfc17a-75a8-49c9-9c8c-20906cce6d53 tempest-VolumesTransfersV355Test-185287744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a078a84-986e-46bd-aa4d-e812b467b015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:43:24 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-19cfc17a-75a8-49c9-9c8c-20906cce6d53 tempest-VolumesTransfersV355Test-185287744 None] Volume 14380572-e4cd-4b7c-ac82-217041efd0cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14380572-e4cd-4b7c-ac82-217041efd0cb', 'volume_size': 1}
Jul 10 12:43:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-19cfc17a-75a8-49c9-9c8c-20906cce6d53 tempest-VolumesTransfersV355Test-185287744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:43:25 devstack sudo[94164]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-24a9f3ae-4aa0-4da7-9c77-98992fb78cbe tempest-SnapshotMetadataTestJSON-733843792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa.a7492edf-0309-4028-954e-1f402d820d1c 1G" returned: 0 in 0.971s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-24a9f3ae-4aa0-4da7-9c77-98992fb78cbe tempest-SnapshotMetadataTestJSON-733843792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa.a7492edf-0309-4028-954e-1f402d820d1c {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:25 devstack sudo[94174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa.a7492edf-0309-4028-954e-1f402d820d1c
Jul 10 12:43:25 devstack sudo[94174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:26 devstack sudo[94174]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-24a9f3ae-4aa0-4da7-9c77-98992fb78cbe tempest-SnapshotMetadataTestJSON-733843792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa.a7492edf-0309-4028-954e-1f402d820d1c" returned: 0 in 1.004s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:26 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-24a9f3ae-4aa0-4da7-9c77-98992fb78cbe tempest-SnapshotMetadataTestJSON-733843792 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa.a7492edf-0309-4028-954e-1f402d820d1c is being set with open permissions: ugo+rw
Jul 10 12:43:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-24a9f3ae-4aa0-4da7-9c77-98992fb78cbe tempest-SnapshotMetadataTestJSON-733843792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa.a7492edf-0309-4028-954e-1f402d820d1c {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:26 devstack sudo[94180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa.a7492edf-0309-4028-954e-1f402d820d1c
Jul 10 12:43:26 devstack sudo[94180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:26 devstack sudo[94180]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-24a9f3ae-4aa0-4da7-9c77-98992fb78cbe tempest-SnapshotMetadataTestJSON-733843792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa.a7492edf-0309-4028-954e-1f402d820d1c" returned: 0 in 0.748s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:26 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:UPDATE=113,cinder:DELETE=11,cinder:SELECT=72,cinder:INSERT=28 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:43:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-24a9f3ae-4aa0-4da7-9c77-98992fb78cbe tempest-SnapshotMetadataTestJSON-733843792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:26 devstack sudo[94185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa.info
Jul 10 12:43:26 devstack sudo[94185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:27 devstack sudo[94185]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-24a9f3ae-4aa0-4da7-9c77-98992fb78cbe tempest-SnapshotMetadataTestJSON-733843792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa.info" returned: 0 in 0.776s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:27 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-24a9f3ae-4aa0-4da7-9c77-98992fb78cbe tempest-SnapshotMetadataTestJSON-733843792 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa.info is being set with open permissions: ugo+rw
Jul 10 12:43:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-24a9f3ae-4aa0-4da7-9c77-98992fb78cbe tempest-SnapshotMetadataTestJSON-733843792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:27 devstack sudo[94196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa.info
Jul 10 12:43:27 devstack sudo[94196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:28 devstack sudo[94196]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-24a9f3ae-4aa0-4da7-9c77-98992fb78cbe tempest-SnapshotMetadataTestJSON-733843792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa.info" returned: 0 in 0.815s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-24a9f3ae-4aa0-4da7-9c77-98992fb78cbe tempest-SnapshotMetadataTestJSON-733843792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.484s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:43:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-19cfc17a-75a8-49c9-9c8c-20906cce6d53 tempest-VolumesTransfersV355Test-185287744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.271s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:43:28 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-19cfc17a-75a8-49c9-9c8c-20906cce6d53 tempest-VolumesTransfersV355Test-185287744 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:43:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-388900183',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14380572-e4cd-4b7c-ac82-217041efd0cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc4fdeb45da640c8a5c123b2e4a3f73b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:43:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:43:24Z,use_quota=True,user_id='d5fffce42d2f4b7cae0972f060cc99ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:43:28 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-19cfc17a-75a8-49c9-9c8c-20906cce6d53 tempest-VolumesTransfersV355Test-185287744 None] Creating volume 14380572-e4cd-4b7c-ac82-217041efd0cb {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:43:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-19cfc17a-75a8-49c9-9c8c-20906cce6d53 tempest-VolumesTransfersV355Test-185287744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:43:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-19cfc17a-75a8-49c9-9c8c-20906cce6d53 tempest-VolumesTransfersV355Test-185287744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:43:28 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-19cfc17a-75a8-49c9-9c8c-20906cce6d53 tempest-VolumesTransfersV355Test-185287744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:43:28 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-19cfc17a-75a8-49c9-9c8c-20906cce6d53 tempest-VolumesTransfersV355Test-185287744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:43:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-19cfc17a-75a8-49c9-9c8c-20906cce6d53 tempest-VolumesTransfersV355Test-185287744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:43:28 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-19cfc17a-75a8-49c9-9c8c-20906cce6d53 tempest-VolumesTransfersV355Test-185287744 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:43:28 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-19cfc17a-75a8-49c9-9c8c-20906cce6d53 tempest-VolumesTransfersV355Test-185287744 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:43:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-19cfc17a-75a8-49c9-9c8c-20906cce6d53 tempest-VolumesTransfersV355Test-185287744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-14380572-e4cd-4b7c-ac82-217041efd0cb 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:28 devstack sudo[94206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-14380572-e4cd-4b7c-ac82-217041efd0cb 1073741824
Jul 10 12:43:28 devstack sudo[94206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:28 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-24a9f3ae-4aa0-4da7-9c77-98992fb78cbe tempest-SnapshotMetadataTestJSON-733843792 None] Create snapshot completed successfully
Jul 10 12:43:29 devstack sudo[94206]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-19cfc17a-75a8-49c9-9c8c-20906cce6d53 tempest-VolumesTransfersV355Test-185287744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-14380572-e4cd-4b7c-ac82-217041efd0cb 1073741824" returned: 0 in 0.902s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-19cfc17a-75a8-49c9-9c8c-20906cce6d53 tempest-VolumesTransfersV355Test-185287744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-14380572-e4cd-4b7c-ac82-217041efd0cb {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:29 devstack sudo[94212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-14380572-e4cd-4b7c-ac82-217041efd0cb
Jul 10 12:43:29 devstack sudo[94212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:30 devstack sudo[94212]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:30 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-19cfc17a-75a8-49c9-9c8c-20906cce6d53 tempest-VolumesTransfersV355Test-185287744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-14380572-e4cd-4b7c-ac82-217041efd0cb" returned: 0 in 0.809s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:30 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-19cfc17a-75a8-49c9-9c8c-20906cce6d53 tempest-VolumesTransfersV355Test-185287744 None] <== create_volume: return (1783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:43:30 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-19cfc17a-75a8-49c9-9c8c-20906cce6d53 tempest-VolumesTransfersV355Test-185287744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.789s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:43:30 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-4b9d5325-1460-437c-b17e-b14ac7956ddb tempest-SnapshotMetadataTestJSON-733843792 None] Acquiring lock "cinder-a7492edf-0309-4028-954e-1f402d820d1c-delete_snapshot" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:43:30 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-19cfc17a-75a8-49c9-9c8c-20906cce6d53 tempest-VolumesTransfersV355Test-185287744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a078a84-986e-46bd-aa4d-e812b467b015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14380572-e4cd-4b7c-ac82-217041efd0cb', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:43:30 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-19cfc17a-75a8-49c9-9c8c-20906cce6d53 tempest-VolumesTransfersV355Test-185287744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (116670d9-5778-4398-b844-2e15c4262f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:43:30 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-4b9d5325-1460-437c-b17e-b14ac7956ddb tempest-SnapshotMetadataTestJSON-733843792 None] Lock "cinder-a7492edf-0309-4028-954e-1f402d820d1c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.069s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:43:30 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-4b9d5325-1460-437c-b17e-b14ac7956ddb tempest-SnapshotMetadataTestJSON-733843792 None] Acquiring lock "cinder-quobyte-2fa6dc84-5a50-4c77-bc35-51538bcf20fa" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:43:30 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-19cfc17a-75a8-49c9-9c8c-20906cce6d53 tempest-VolumesTransfersV355Test-185287744 None] Volume volume-14380572-e4cd-4b7c-ac82-217041efd0cb (14380572-e4cd-4b7c-ac82-217041efd0cb): created successfully
Jul 10 12:43:30 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-19cfc17a-75a8-49c9-9c8c-20906cce6d53 tempest-VolumesTransfersV355Test-185287744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (116670d9-5778-4398-b844-2e15c4262f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:43:30 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-19cfc17a-75a8-49c9-9c8c-20906cce6d53 tempest-VolumesTransfersV355Test-185287744 None] Flow 'volume_create_manager' (5c64e0d5-5f8d-4c5d-bb11-9a07de7efa2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:43:30 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-4b9d5325-1460-437c-b17e-b14ac7956ddb tempest-SnapshotMetadataTestJSON-733843792 None] Lock "cinder-quobyte-2fa6dc84-5a50-4c77-bc35-51538bcf20fa" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:43:30 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-4b9d5325-1460-437c-b17e-b14ac7956ddb tempest-SnapshotMetadataTestJSON-733843792 None] Acquiring lock "cinder-quobyte-a7492edf-0309-4028-954e-1f402d820d1c" by "_delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:43:30 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-19cfc17a-75a8-49c9-9c8c-20906cce6d53 tempest-VolumesTransfersV355Test-185287744 None] Created volume successfully.
Jul 10 12:43:30 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-4b9d5325-1460-437c-b17e-b14ac7956ddb tempest-SnapshotMetadataTestJSON-733843792 None] Lock "cinder-quobyte-a7492edf-0309-4028-954e-1f402d820d1c" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:43:30 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-4b9d5325-1460-437c-b17e-b14ac7956ddb tempest-SnapshotMetadataTestJSON-733843792 None] Deleting offline snapshot a7492edf-0309-4028-954e-1f402d820d1c of volume 2fa6dc84-5a50-4c77-bc35-51538bcf20fa {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 10 12:43:30 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-4b9d5325-1460-437c-b17e-b14ac7956ddb tempest-SnapshotMetadataTestJSON-733843792 None] snapshot_file for this snap is: volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa.a7492edf-0309-4028-954e-1f402d820d1c {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 10 12:43:30 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[264b67f6-418b-4746-a913-7e6232488a99]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:43:30 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4b9d5325-1460-437c-b17e-b14ac7956ddb tempest-SnapshotMetadataTestJSON-733843792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa.a7492edf-0309-4028-954e-1f402d820d1c {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:30 devstack sudo[94216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa.a7492edf-0309-4028-954e-1f402d820d1c
Jul 10 12:43:30 devstack sudo[94216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:31 devstack sudo[94216]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4b9d5325-1460-437c-b17e-b14ac7956ddb tempest-SnapshotMetadataTestJSON-733843792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa.a7492edf-0309-4028-954e-1f402d820d1c" returned: 0 in 1.089s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:31 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-4b9d5325-1460-437c-b17e-b14ac7956ddb tempest-SnapshotMetadataTestJSON-733843792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:43:31 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c543da-bb98-4d02-a82a-1ad889a0c8bc]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:43:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4b9d5325-1460-437c-b17e-b14ac7956ddb tempest-SnapshotMetadataTestJSON-733843792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:31 devstack sudo[94237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa
Jul 10 12:43:31 devstack sudo[94237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:32 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-d93c7e66-4722-4075-a06b-37d0aeb23fc1 tempest-VolumesTransfersV355Test-1499618385 None] Transfer volume completed successfully.
Jul 10 12:43:32 devstack sudo[94237]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4b9d5325-1460-437c-b17e-b14ac7956ddb tempest-SnapshotMetadataTestJSON-733843792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa" returned: 0 in 0.912s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4b9d5325-1460-437c-b17e-b14ac7956ddb tempest-SnapshotMetadataTestJSON-733843792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa.a7492edf-0309-4028-954e-1f402d820d1c {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:32 devstack sudo[94250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa.a7492edf-0309-4028-954e-1f402d820d1c
Jul 10 12:43:32 devstack sudo[94250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:33 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-52330dbb-38d6-4f03-89d1-b9e20d5eac8b tempest-VolumesTransfersV355Test-2021489913 None] Acquiring lock "cinder-14380572-e4cd-4b7c-ac82-217041efd0cb-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:43:33 devstack sudo[94250]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4b9d5325-1460-437c-b17e-b14ac7956ddb tempest-SnapshotMetadataTestJSON-733843792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa.a7492edf-0309-4028-954e-1f402d820d1c" returned: 0 in 0.882s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4b9d5325-1460-437c-b17e-b14ac7956ddb tempest-SnapshotMetadataTestJSON-733843792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa.a7492edf-0309-4028-954e-1f402d820d1c {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:33 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-52330dbb-38d6-4f03-89d1-b9e20d5eac8b tempest-VolumesTransfersV355Test-2021489913 None] Lock "cinder-14380572-e4cd-4b7c-ac82-217041efd0cb-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:43:33 devstack sudo[94267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa.a7492edf-0309-4028-954e-1f402d820d1c
Jul 10 12:43:33 devstack sudo[94267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:33 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-52330dbb-38d6-4f03-89d1-b9e20d5eac8b tempest-VolumesTransfersV355Test-2021489913 None] Acquiring lock "cinder-quobyte-14380572-e4cd-4b7c-ac82-217041efd0cb" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:43:33 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-52330dbb-38d6-4f03-89d1-b9e20d5eac8b tempest-VolumesTransfersV355Test-2021489913 None] Lock "cinder-quobyte-14380572-e4cd-4b7c-ac82-217041efd0cb" acquired by "delete_volume" :: waited 0.019s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:43:33 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b706e1e1-9534-4e3e-a592-22a6a17daf65]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:43:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-52330dbb-38d6-4f03-89d1-b9e20d5eac8b tempest-VolumesTransfersV355Test-2021489913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-14380572-e4cd-4b7c-ac82-217041efd0cb {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:33 devstack sudo[94272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-14380572-e4cd-4b7c-ac82-217041efd0cb
Jul 10 12:43:33 devstack sudo[94272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:34 devstack sudo[94267]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4b9d5325-1460-437c-b17e-b14ac7956ddb tempest-SnapshotMetadataTestJSON-733843792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa.a7492edf-0309-4028-954e-1f402d820d1c" returned: 0 in 1.446s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:34 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-4b9d5325-1460-437c-b17e-b14ac7956ddb tempest-SnapshotMetadataTestJSON-733843792 None] Lock "cinder-quobyte-a7492edf-0309-4028-954e-1f402d820d1c" released by "_delete_snapshot" :: held 4.508s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:43:34 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-4b9d5325-1460-437c-b17e-b14ac7956ddb tempest-SnapshotMetadataTestJSON-733843792 None] Lock "cinder-quobyte-2fa6dc84-5a50-4c77-bc35-51538bcf20fa" released by "delete_snapshot" :: held 4.548s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:43:35 devstack cinder-volume[87378]: WARNING cinder.quota [None req-4b9d5325-1460-437c-b17e-b14ac7956ddb tempest-SnapshotMetadataTestJSON-733843792 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 10 12:43:35 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-4b9d5325-1460-437c-b17e-b14ac7956ddb tempest-SnapshotMetadataTestJSON-733843792 None] Created reservations ['52d067ef-9f00-4579-a115-ddf03b3a7b98', '846d5862-d614-4a69-8584-cb2e1ac7e993', 'a6ac110c-cda3-4769-97f3-ab940eb262a0', 'd0e0a8c4-dccf-4b95-9f16-6b9692db008c'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:43:35 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-4b9d5325-1460-437c-b17e-b14ac7956ddb tempest-SnapshotMetadataTestJSON-733843792 None] Delete snapshot completed successfully.
Jul 10 12:43:35 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-4b9d5325-1460-437c-b17e-b14ac7956ddb tempest-SnapshotMetadataTestJSON-733843792 None] Lock "cinder-a7492edf-0309-4028-954e-1f402d820d1c-delete_snapshot" released by "delete_snapshot" :: held 4.834s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:43:35 devstack sudo[94272]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-52330dbb-38d6-4f03-89d1-b9e20d5eac8b tempest-VolumesTransfersV355Test-2021489913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-14380572-e4cd-4b7c-ac82-217041efd0cb" returned: 0 in 1.770s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-52330dbb-38d6-4f03-89d1-b9e20d5eac8b tempest-VolumesTransfersV355Test-2021489913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-14380572-e4cd-4b7c-ac82-217041efd0cb {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:35 devstack sudo[94340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-14380572-e4cd-4b7c-ac82-217041efd0cb
Jul 10 12:43:35 devstack sudo[94340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:35 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-09b09077-87e3-4342-a441-6d368b185e68 tempest-SnapshotMetadataTestJSON-733843792 None] Acquiring lock "cinder-2fa6dc84-5a50-4c77-bc35-51538bcf20fa-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:43:35 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-09b09077-87e3-4342-a441-6d368b185e68 tempest-SnapshotMetadataTestJSON-733843792 None] Lock "cinder-2fa6dc84-5a50-4c77-bc35-51538bcf20fa-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:43:35 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-09b09077-87e3-4342-a441-6d368b185e68 tempest-SnapshotMetadataTestJSON-733843792 None] Acquiring lock "cinder-quobyte-2fa6dc84-5a50-4c77-bc35-51538bcf20fa" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:43:36 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-09b09077-87e3-4342-a441-6d368b185e68 tempest-SnapshotMetadataTestJSON-733843792 None] Lock "cinder-quobyte-2fa6dc84-5a50-4c77-bc35-51538bcf20fa" acquired by "delete_volume" :: waited 0.031s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:43:36 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b58c60-5a47-427c-97ef-883ae1d4304d]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:43:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-09b09077-87e3-4342-a441-6d368b185e68 tempest-SnapshotMetadataTestJSON-733843792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:36 devstack sudo[94383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa
Jul 10 12:43:36 devstack sudo[94383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:36 devstack sudo[94340]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-52330dbb-38d6-4f03-89d1-b9e20d5eac8b tempest-VolumesTransfersV355Test-2021489913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-14380572-e4cd-4b7c-ac82-217041efd0cb" returned: 0 in 0.922s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:36 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-52330dbb-38d6-4f03-89d1-b9e20d5eac8b tempest-VolumesTransfersV355Test-2021489913 None] Lock "cinder-quobyte-14380572-e4cd-4b7c-ac82-217041efd0cb" released by "delete_volume" :: held 2.735s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:43:36 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-52330dbb-38d6-4f03-89d1-b9e20d5eac8b tempest-VolumesTransfersV355Test-2021489913 None] Created reservations ['8bc6d559-95a7-4edd-a33a-0ddf96eefe3b', 'f0b940bc-a6fe-4730-bfed-6fca61d36dea', 'd4f4f72c-c23c-472e-92a1-8020eec67df4', 'a13cc5be-2930-4a34-9506-ac4ababec328'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:43:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-52330dbb-38d6-4f03-89d1-b9e20d5eac8b tempest-VolumesTransfersV355Test-2021489913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:43:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-52330dbb-38d6-4f03-89d1-b9e20d5eac8b tempest-VolumesTransfersV355Test-2021489913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:43:36 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-52330dbb-38d6-4f03-89d1-b9e20d5eac8b tempest-VolumesTransfersV355Test-2021489913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:43:36 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-52330dbb-38d6-4f03-89d1-b9e20d5eac8b tempest-VolumesTransfersV355Test-2021489913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:43:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-52330dbb-38d6-4f03-89d1-b9e20d5eac8b tempest-VolumesTransfersV355Test-2021489913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:43:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-52330dbb-38d6-4f03-89d1-b9e20d5eac8b tempest-VolumesTransfersV355Test-2021489913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:36 devstack sudo[94386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:43:36 devstack sudo[94386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:37 devstack sudo[94383]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-09b09077-87e3-4342-a441-6d368b185e68 tempest-SnapshotMetadataTestJSON-733843792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa" returned: 0 in 0.954s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-09b09077-87e3-4342-a441-6d368b185e68 tempest-SnapshotMetadataTestJSON-733843792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:37 devstack sudo[94392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa
Jul 10 12:43:37 devstack sudo[94392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:37 devstack sudo[94386]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-52330dbb-38d6-4f03-89d1-b9e20d5eac8b tempest-VolumesTransfersV355Test-2021489913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.811s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:37 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-52330dbb-38d6-4f03-89d1-b9e20d5eac8b tempest-VolumesTransfersV355Test-2021489913 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:43:37 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-52330dbb-38d6-4f03-89d1-b9e20d5eac8b tempest-VolumesTransfersV355Test-2021489913 None] Deleted volume successfully.
Jul 10 12:43:37 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-52330dbb-38d6-4f03-89d1-b9e20d5eac8b tempest-VolumesTransfersV355Test-2021489913 None] Lock "cinder-14380572-e4cd-4b7c-ac82-217041efd0cb-delete_volume" released by "delete_volume" :: held 3.853s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:43:37 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd7ac1b4-a920-494a-8796-2af94cb3417c tempest-VolumesTransfersV355Test-185287744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:43:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-dd7ac1b4-a920-494a-8796-2af94cb3417c tempest-VolumesTransfersV355Test-185287744 None] Flow 'volume_create_manager' (4a8f2c47-d2af-462e-8c6f-960ec8074c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:43:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-dd7ac1b4-a920-494a-8796-2af94cb3417c tempest-VolumesTransfersV355Test-185287744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3410626e-f3bf-48cc-98f3-78a984191b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:43:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-dd7ac1b4-a920-494a-8796-2af94cb3417c tempest-VolumesTransfersV355Test-185287744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3410626e-f3bf-48cc-98f3-78a984191b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:43:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-843231560',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c3525ba-7df1-46f0-a3e4-0ba467e6fccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc4fdeb45da640c8a5c123b2e4a3f73b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:43:38Z,use_quota=True,user_id='d5fffce42d2f4b7cae0972f060cc99ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:43:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-dd7ac1b4-a920-494a-8796-2af94cb3417c tempest-VolumesTransfersV355Test-185287744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b648639-5dce-4c5b-a506-099200819dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:43:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-dd7ac1b4-a920-494a-8796-2af94cb3417c tempest-VolumesTransfersV355Test-185287744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b648639-5dce-4c5b-a506-099200819dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:43:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-dd7ac1b4-a920-494a-8796-2af94cb3417c tempest-VolumesTransfersV355Test-185287744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22283372-a58d-479b-82d7-a66da65047fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:43:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-dd7ac1b4-a920-494a-8796-2af94cb3417c tempest-VolumesTransfersV355Test-185287744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22283372-a58d-479b-82d7-a66da65047fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c3525ba-7df1-46f0-a3e4-0ba467e6fccb', 'volume_name': 'volume-2c3525ba-7df1-46f0-a3e4-0ba467e6fccb', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:43:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-dd7ac1b4-a920-494a-8796-2af94cb3417c tempest-VolumesTransfersV355Test-185287744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0174d46c-8c86-4551-b2ec-0e6fead2ae84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:43:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-dd7ac1b4-a920-494a-8796-2af94cb3417c tempest-VolumesTransfersV355Test-185287744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0174d46c-8c86-4551-b2ec-0e6fead2ae84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:43:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-dd7ac1b4-a920-494a-8796-2af94cb3417c tempest-VolumesTransfersV355Test-185287744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (679bf0df-9b63-4f20-b040-5be07ab595f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:43:37 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-dd7ac1b4-a920-494a-8796-2af94cb3417c tempest-VolumesTransfersV355Test-185287744 None] Volume 2c3525ba-7df1-46f0-a3e4-0ba467e6fccb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c3525ba-7df1-46f0-a3e4-0ba467e6fccb', 'volume_size': 1}
Jul 10 12:43:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-dd7ac1b4-a920-494a-8796-2af94cb3417c tempest-VolumesTransfersV355Test-185287744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:43:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-dd7ac1b4-a920-494a-8796-2af94cb3417c tempest-VolumesTransfersV355Test-185287744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:43:37 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-dd7ac1b4-a920-494a-8796-2af94cb3417c tempest-VolumesTransfersV355Test-185287744 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:43:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-843231560',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c3525ba-7df1-46f0-a3e4-0ba467e6fccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc4fdeb45da640c8a5c123b2e4a3f73b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:43:38Z,use_quota=True,user_id='d5fffce42d2f4b7cae0972f060cc99ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:43:37 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-dd7ac1b4-a920-494a-8796-2af94cb3417c tempest-VolumesTransfersV355Test-185287744 None] Creating volume 2c3525ba-7df1-46f0-a3e4-0ba467e6fccb {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:43:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-dd7ac1b4-a920-494a-8796-2af94cb3417c tempest-VolumesTransfersV355Test-185287744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:43:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-dd7ac1b4-a920-494a-8796-2af94cb3417c tempest-VolumesTransfersV355Test-185287744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:43:37 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-dd7ac1b4-a920-494a-8796-2af94cb3417c tempest-VolumesTransfersV355Test-185287744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:43:37 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-dd7ac1b4-a920-494a-8796-2af94cb3417c tempest-VolumesTransfersV355Test-185287744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:43:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-dd7ac1b4-a920-494a-8796-2af94cb3417c tempest-VolumesTransfersV355Test-185287744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:43:37 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-dd7ac1b4-a920-494a-8796-2af94cb3417c tempest-VolumesTransfersV355Test-185287744 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:43:37 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-dd7ac1b4-a920-494a-8796-2af94cb3417c tempest-VolumesTransfersV355Test-185287744 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:43:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-dd7ac1b4-a920-494a-8796-2af94cb3417c tempest-VolumesTransfersV355Test-185287744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2c3525ba-7df1-46f0-a3e4-0ba467e6fccb 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:37 devstack sudo[94395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2c3525ba-7df1-46f0-a3e4-0ba467e6fccb 1073741824
Jul 10 12:43:37 devstack sudo[94395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:37 devstack sudo[94392]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-09b09077-87e3-4342-a441-6d368b185e68 tempest-SnapshotMetadataTestJSON-733843792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2fa6dc84-5a50-4c77-bc35-51538bcf20fa" returned: 0 in 0.885s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:37 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-09b09077-87e3-4342-a441-6d368b185e68 tempest-SnapshotMetadataTestJSON-733843792 None] Lock "cinder-quobyte-2fa6dc84-5a50-4c77-bc35-51538bcf20fa" released by "delete_volume" :: held 1.921s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:43:38 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-09b09077-87e3-4342-a441-6d368b185e68 tempest-SnapshotMetadataTestJSON-733843792 None] Created reservations ['a86e8ef9-6314-4a52-9078-3d5a43d56cb5', '08cda500-9837-44b1-aa1e-cecb9afabbc3', 'dfffbd0e-f493-4af3-9c77-6ab26f0582bf', 'd3cc1f07-19f5-423d-9c2e-e551c948aa20'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:43:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-09b09077-87e3-4342-a441-6d368b185e68 tempest-SnapshotMetadataTestJSON-733843792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:43:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-09b09077-87e3-4342-a441-6d368b185e68 tempest-SnapshotMetadataTestJSON-733843792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:43:38 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-09b09077-87e3-4342-a441-6d368b185e68 tempest-SnapshotMetadataTestJSON-733843792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:43:38 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-09b09077-87e3-4342-a441-6d368b185e68 tempest-SnapshotMetadataTestJSON-733843792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:43:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-09b09077-87e3-4342-a441-6d368b185e68 tempest-SnapshotMetadataTestJSON-733843792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:43:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-09b09077-87e3-4342-a441-6d368b185e68 tempest-SnapshotMetadataTestJSON-733843792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:38 devstack sudo[94398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:43:38 devstack sudo[94398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:38 devstack sudo[94395]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-dd7ac1b4-a920-494a-8796-2af94cb3417c tempest-VolumesTransfersV355Test-185287744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2c3525ba-7df1-46f0-a3e4-0ba467e6fccb 1073741824" returned: 0 in 1.081s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-dd7ac1b4-a920-494a-8796-2af94cb3417c tempest-VolumesTransfersV355Test-185287744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2c3525ba-7df1-46f0-a3e4-0ba467e6fccb {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:38 devstack sudo[94406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2c3525ba-7df1-46f0-a3e4-0ba467e6fccb
Jul 10 12:43:38 devstack sudo[94406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:38 devstack sudo[94398]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-09b09077-87e3-4342-a441-6d368b185e68 tempest-SnapshotMetadataTestJSON-733843792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.808s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:38 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-09b09077-87e3-4342-a441-6d368b185e68 tempest-SnapshotMetadataTestJSON-733843792 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:43:38 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-09b09077-87e3-4342-a441-6d368b185e68 tempest-SnapshotMetadataTestJSON-733843792 None] Deleted volume successfully.
Jul 10 12:43:38 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-09b09077-87e3-4342-a441-6d368b185e68 tempest-SnapshotMetadataTestJSON-733843792 None] Lock "cinder-2fa6dc84-5a50-4c77-bc35-51538bcf20fa-delete_volume" released by "delete_volume" :: held 3.035s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:43:39 devstack sudo[94406]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-dd7ac1b4-a920-494a-8796-2af94cb3417c tempest-VolumesTransfersV355Test-185287744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2c3525ba-7df1-46f0-a3e4-0ba467e6fccb" returned: 0 in 0.725s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-dd7ac1b4-a920-494a-8796-2af94cb3417c tempest-VolumesTransfersV355Test-185287744 None] <== create_volume: return (1854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:43:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-dd7ac1b4-a920-494a-8796-2af94cb3417c tempest-VolumesTransfersV355Test-185287744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.856s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:43:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-dd7ac1b4-a920-494a-8796-2af94cb3417c tempest-VolumesTransfersV355Test-185287744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (679bf0df-9b63-4f20-b040-5be07ab595f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c3525ba-7df1-46f0-a3e4-0ba467e6fccb', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:43:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-dd7ac1b4-a920-494a-8796-2af94cb3417c tempest-VolumesTransfersV355Test-185287744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5d4504a-d20d-4fd0-aa53-8391e2478d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:43:39 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-dd7ac1b4-a920-494a-8796-2af94cb3417c tempest-VolumesTransfersV355Test-185287744 None] Volume volume-2c3525ba-7df1-46f0-a3e4-0ba467e6fccb (2c3525ba-7df1-46f0-a3e4-0ba467e6fccb): created successfully
Jul 10 12:43:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-dd7ac1b4-a920-494a-8796-2af94cb3417c tempest-VolumesTransfersV355Test-185287744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5d4504a-d20d-4fd0-aa53-8391e2478d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:43:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-dd7ac1b4-a920-494a-8796-2af94cb3417c tempest-VolumesTransfersV355Test-185287744 None] Flow 'volume_create_manager' (4a8f2c47-d2af-462e-8c6f-960ec8074c41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:43:39 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-dd7ac1b4-a920-494a-8796-2af94cb3417c tempest-VolumesTransfersV355Test-185287744 None] Created volume successfully.
Jul 10 12:43:40 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-2b71368e-80fb-4fae-a8c1-9ef4bedf40b7 tempest-VolumesTransfersV355Test-2021489913 None] Acquiring lock "cinder-2c3525ba-7df1-46f0-a3e4-0ba467e6fccb-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:43:40 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-2b71368e-80fb-4fae-a8c1-9ef4bedf40b7 tempest-VolumesTransfersV355Test-2021489913 None] Lock "cinder-2c3525ba-7df1-46f0-a3e4-0ba467e6fccb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:43:40 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-2b71368e-80fb-4fae-a8c1-9ef4bedf40b7 tempest-VolumesTransfersV355Test-2021489913 None] Acquiring lock "cinder-quobyte-2c3525ba-7df1-46f0-a3e4-0ba467e6fccb" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:43:40 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-2b71368e-80fb-4fae-a8c1-9ef4bedf40b7 tempest-VolumesTransfersV355Test-2021489913 None] Lock "cinder-quobyte-2c3525ba-7df1-46f0-a3e4-0ba467e6fccb" acquired by "delete_volume" :: waited 0.021s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:43:40 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3fd47d-3029-4584-886c-6eeb194ca8ac]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:43:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2b71368e-80fb-4fae-a8c1-9ef4bedf40b7 tempest-VolumesTransfersV355Test-2021489913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2c3525ba-7df1-46f0-a3e4-0ba467e6fccb {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:40 devstack sudo[94409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2c3525ba-7df1-46f0-a3e4-0ba467e6fccb
Jul 10 12:43:40 devstack sudo[94409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:41 devstack sudo[94409]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2b71368e-80fb-4fae-a8c1-9ef4bedf40b7 tempest-VolumesTransfersV355Test-2021489913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2c3525ba-7df1-46f0-a3e4-0ba467e6fccb" returned: 0 in 0.823s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2b71368e-80fb-4fae-a8c1-9ef4bedf40b7 tempest-VolumesTransfersV355Test-2021489913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2c3525ba-7df1-46f0-a3e4-0ba467e6fccb {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:41 devstack sudo[94414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2c3525ba-7df1-46f0-a3e4-0ba467e6fccb
Jul 10 12:43:41 devstack sudo[94414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:41 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8a75951-927c-4a03-8588-6958975e21fc tempest-VolumesDeleteCascade-115765563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:43:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e8a75951-927c-4a03-8588-6958975e21fc tempest-VolumesDeleteCascade-115765563 None] Flow 'volume_create_manager' (5de637fd-3715-4764-bfd9-31f09e833770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:43:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e8a75951-927c-4a03-8588-6958975e21fc tempest-VolumesDeleteCascade-115765563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11c479e1-f3dc-408b-aab8-82bd7075b404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:43:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e8a75951-927c-4a03-8588-6958975e21fc tempest-VolumesDeleteCascade-115765563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11c479e1-f3dc-408b-aab8-82bd7075b404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1944024734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e6f6ac2-a59f-4fdc-898a-e3d1552bb313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='736971a320d94d248b5ec688f7b08635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:43:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:43:41Z,use_quota=True,user_id='22cf595150194520b5823020820edb83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:43:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e8a75951-927c-4a03-8588-6958975e21fc tempest-VolumesDeleteCascade-115765563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (187beecb-0648-420b-ba25-e0898ca615ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:43:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e8a75951-927c-4a03-8588-6958975e21fc tempest-VolumesDeleteCascade-115765563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (187beecb-0648-420b-ba25-e0898ca615ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:43:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e8a75951-927c-4a03-8588-6958975e21fc tempest-VolumesDeleteCascade-115765563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2132559c-90ed-4f7a-b012-7d7138aa4150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:43:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e8a75951-927c-4a03-8588-6958975e21fc tempest-VolumesDeleteCascade-115765563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2132559c-90ed-4f7a-b012-7d7138aa4150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e6f6ac2-a59f-4fdc-898a-e3d1552bb313', 'volume_name': 'volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:43:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e8a75951-927c-4a03-8588-6958975e21fc tempest-VolumesDeleteCascade-115765563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (666e53a5-4a65-4119-a778-b239a8647d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:43:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e8a75951-927c-4a03-8588-6958975e21fc tempest-VolumesDeleteCascade-115765563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (666e53a5-4a65-4119-a778-b239a8647d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:43:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e8a75951-927c-4a03-8588-6958975e21fc tempest-VolumesDeleteCascade-115765563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (960d9ca6-04d9-4653-9862-a237bb1c3364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:43:41 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-e8a75951-927c-4a03-8588-6958975e21fc tempest-VolumesDeleteCascade-115765563 None] Volume 5e6f6ac2-a59f-4fdc-898a-e3d1552bb313: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313', 'volume_size': 1}
Jul 10 12:43:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e8a75951-927c-4a03-8588-6958975e21fc tempest-VolumesDeleteCascade-115765563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:43:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e8a75951-927c-4a03-8588-6958975e21fc tempest-VolumesDeleteCascade-115765563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:43:41 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-e8a75951-927c-4a03-8588-6958975e21fc tempest-VolumesDeleteCascade-115765563 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1944024734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e6f6ac2-a59f-4fdc-898a-e3d1552bb313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='736971a320d94d248b5ec688f7b08635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:43:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:43:41Z,use_quota=True,user_id='22cf595150194520b5823020820edb83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:43:41 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-e8a75951-927c-4a03-8588-6958975e21fc tempest-VolumesDeleteCascade-115765563 None] Creating volume 5e6f6ac2-a59f-4fdc-898a-e3d1552bb313 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:43:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e8a75951-927c-4a03-8588-6958975e21fc tempest-VolumesDeleteCascade-115765563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:43:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e8a75951-927c-4a03-8588-6958975e21fc tempest-VolumesDeleteCascade-115765563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:43:41 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-e8a75951-927c-4a03-8588-6958975e21fc tempest-VolumesDeleteCascade-115765563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:43:41 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-e8a75951-927c-4a03-8588-6958975e21fc tempest-VolumesDeleteCascade-115765563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:43:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e8a75951-927c-4a03-8588-6958975e21fc tempest-VolumesDeleteCascade-115765563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:43:41 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-e8a75951-927c-4a03-8588-6958975e21fc tempest-VolumesDeleteCascade-115765563 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:43:41 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-e8a75951-927c-4a03-8588-6958975e21fc tempest-VolumesDeleteCascade-115765563 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:43:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e8a75951-927c-4a03-8588-6958975e21fc tempest-VolumesDeleteCascade-115765563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:41 devstack sudo[94416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313 1073741824
Jul 10 12:43:41 devstack sudo[94416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:41 devstack sudo[94414]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2b71368e-80fb-4fae-a8c1-9ef4bedf40b7 tempest-VolumesTransfersV355Test-2021489913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2c3525ba-7df1-46f0-a3e4-0ba467e6fccb" returned: 0 in 0.737s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:41 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-2b71368e-80fb-4fae-a8c1-9ef4bedf40b7 tempest-VolumesTransfersV355Test-2021489913 None] Lock "cinder-quobyte-2c3525ba-7df1-46f0-a3e4-0ba467e6fccb" released by "delete_volume" :: held 1.612s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:43:41 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-2b71368e-80fb-4fae-a8c1-9ef4bedf40b7 tempest-VolumesTransfersV355Test-2021489913 None] Created reservations ['64da99bd-6a82-4050-b910-edceb8b6a590', 'b8b1d695-c007-4453-bb1e-e9ec1e48b654', '754f5366-38c9-4d72-97f5-2af572c3f550', '135f0e63-1452-4a8d-9778-20fa65a9c24a'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:43:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2b71368e-80fb-4fae-a8c1-9ef4bedf40b7 tempest-VolumesTransfersV355Test-2021489913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:43:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2b71368e-80fb-4fae-a8c1-9ef4bedf40b7 tempest-VolumesTransfersV355Test-2021489913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:43:41 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-2b71368e-80fb-4fae-a8c1-9ef4bedf40b7 tempest-VolumesTransfersV355Test-2021489913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:43:41 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-2b71368e-80fb-4fae-a8c1-9ef4bedf40b7 tempest-VolumesTransfersV355Test-2021489913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:43:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2b71368e-80fb-4fae-a8c1-9ef4bedf40b7 tempest-VolumesTransfersV355Test-2021489913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:43:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2b71368e-80fb-4fae-a8c1-9ef4bedf40b7 tempest-VolumesTransfersV355Test-2021489913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:42 devstack sudo[94419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:43:42 devstack sudo[94419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:42 devstack sudo[94416]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e8a75951-927c-4a03-8588-6958975e21fc tempest-VolumesDeleteCascade-115765563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313 1073741824" returned: 0 in 0.923s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e8a75951-927c-4a03-8588-6958975e21fc tempest-VolumesDeleteCascade-115765563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:42 devstack sudo[94425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313
Jul 10 12:43:42 devstack sudo[94425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:42 devstack sudo[94419]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2b71368e-80fb-4fae-a8c1-9ef4bedf40b7 tempest-VolumesTransfersV355Test-2021489913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.832s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:42 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-2b71368e-80fb-4fae-a8c1-9ef4bedf40b7 tempest-VolumesTransfersV355Test-2021489913 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:43:42 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-2b71368e-80fb-4fae-a8c1-9ef4bedf40b7 tempest-VolumesTransfersV355Test-2021489913 None] Deleted volume successfully.
Jul 10 12:43:42 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-2b71368e-80fb-4fae-a8c1-9ef4bedf40b7 tempest-VolumesTransfersV355Test-2021489913 None] Lock "cinder-2c3525ba-7df1-46f0-a3e4-0ba467e6fccb-delete_volume" released by "delete_volume" :: held 2.709s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:43:43 devstack sudo[94425]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e8a75951-927c-4a03-8588-6958975e21fc tempest-VolumesDeleteCascade-115765563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313" returned: 0 in 0.850s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:43 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-e8a75951-927c-4a03-8588-6958975e21fc tempest-VolumesDeleteCascade-115765563 None] <== create_volume: return (1823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:43:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e8a75951-927c-4a03-8588-6958975e21fc tempest-VolumesDeleteCascade-115765563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.825s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:43:43 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e8a75951-927c-4a03-8588-6958975e21fc tempest-VolumesDeleteCascade-115765563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (960d9ca6-04d9-4653-9862-a237bb1c3364) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:43:43 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e8a75951-927c-4a03-8588-6958975e21fc tempest-VolumesDeleteCascade-115765563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ab2a965-7954-4c74-b547-9bb5042897e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:43:43 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-e8a75951-927c-4a03-8588-6958975e21fc tempest-VolumesDeleteCascade-115765563 None] Volume volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313 (5e6f6ac2-a59f-4fdc-898a-e3d1552bb313): created successfully
Jul 10 12:43:43 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e8a75951-927c-4a03-8588-6958975e21fc tempest-VolumesDeleteCascade-115765563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ab2a965-7954-4c74-b547-9bb5042897e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:43:43 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e8a75951-927c-4a03-8588-6958975e21fc tempest-VolumesDeleteCascade-115765563 None] Flow 'volume_create_manager' (5de637fd-3715-4764-bfd9-31f09e833770) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:43:43 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-e8a75951-927c-4a03-8588-6958975e21fc tempest-VolumesDeleteCascade-115765563 None] Created volume successfully.
Jul 10 12:43:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1757c6cf-8ef5-43a2-bdfc-04d5930e4e3d tempest-VolumesDeleteCascade-115765563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:43:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1757c6cf-8ef5-43a2-bdfc-04d5930e4e3d tempest-VolumesDeleteCascade-115765563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:43:44 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-1757c6cf-8ef5-43a2-bdfc-04d5930e4e3d tempest-VolumesDeleteCascade-115765563 None] Creating offline snapshot d9a8d45f-7910-487c-ab52-f0ae3333e56e of volume 5e6f6ac2-a59f-4fdc-898a-e3d1552bb313 {{(pid=87378) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 10 12:43:44 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a219f360-1a3e-4d7e-8a3d-1a4e02d332ad]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:43:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1757c6cf-8ef5-43a2-bdfc-04d5930e4e3d tempest-VolumesDeleteCascade-115765563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:44 devstack sudo[94429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313
Jul 10 12:43:44 devstack sudo[94429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:45 devstack sudo[94429]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1757c6cf-8ef5-43a2-bdfc-04d5930e4e3d tempest-VolumesDeleteCascade-115765563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313" returned: 0 in 0.982s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1757c6cf-8ef5-43a2-bdfc-04d5930e4e3d tempest-VolumesDeleteCascade-115765563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.d9a8d45f-7910-487c-ab52-f0ae3333e56e 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:45 devstack sudo[94436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.d9a8d45f-7910-487c-ab52-f0ae3333e56e 1G
Jul 10 12:43:45 devstack sudo[94436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:46 devstack sudo[94436]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1757c6cf-8ef5-43a2-bdfc-04d5930e4e3d tempest-VolumesDeleteCascade-115765563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.d9a8d45f-7910-487c-ab52-f0ae3333e56e 1G" returned: 0 in 1.051s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1757c6cf-8ef5-43a2-bdfc-04d5930e4e3d tempest-VolumesDeleteCascade-115765563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.d9a8d45f-7910-487c-ab52-f0ae3333e56e {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:46 devstack sudo[94442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.d9a8d45f-7910-487c-ab52-f0ae3333e56e
Jul 10 12:43:46 devstack sudo[94442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:46 devstack sudo[94442]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1757c6cf-8ef5-43a2-bdfc-04d5930e4e3d tempest-VolumesDeleteCascade-115765563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.d9a8d45f-7910-487c-ab52-f0ae3333e56e" returned: 0 in 0.884s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:46 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-1757c6cf-8ef5-43a2-bdfc-04d5930e4e3d tempest-VolumesDeleteCascade-115765563 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.d9a8d45f-7910-487c-ab52-f0ae3333e56e is being set with open permissions: ugo+rw
Jul 10 12:43:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1757c6cf-8ef5-43a2-bdfc-04d5930e4e3d tempest-VolumesDeleteCascade-115765563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.d9a8d45f-7910-487c-ab52-f0ae3333e56e {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:47 devstack sudo[94450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.d9a8d45f-7910-487c-ab52-f0ae3333e56e
Jul 10 12:43:47 devstack sudo[94450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:47 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b0d5459-0c39-491f-93aa-4cb9fe4b674d tempest-AttachVolumeNegativeTest-2056769334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:43:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9b0d5459-0c39-491f-93aa-4cb9fe4b674d tempest-AttachVolumeNegativeTest-2056769334 None] Flow 'volume_create_manager' (1f18c2c5-d2f1-4c08-8505-0330f33878f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:43:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9b0d5459-0c39-491f-93aa-4cb9fe4b674d tempest-AttachVolumeNegativeTest-2056769334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23f9beab-036c-4dd1-bd75-099d1143f800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:43:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9b0d5459-0c39-491f-93aa-4cb9fe4b674d tempest-AttachVolumeNegativeTest-2056769334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23f9beab-036c-4dd1-bd75-099d1143f800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:43:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1497258342',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb401785-82c0-433d-b15f-42ba10548f08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a63dc9ad7bb64e71947d627c39ccb30a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:43:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:43:47Z,use_quota=True,user_id='4e2b69d2fc924858bd316c21d4da30cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:43:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9b0d5459-0c39-491f-93aa-4cb9fe4b674d tempest-AttachVolumeNegativeTest-2056769334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a4e5779-bc3f-40d3-9b1c-9eb39bf9e978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:43:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9b0d5459-0c39-491f-93aa-4cb9fe4b674d tempest-AttachVolumeNegativeTest-2056769334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a4e5779-bc3f-40d3-9b1c-9eb39bf9e978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:43:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9b0d5459-0c39-491f-93aa-4cb9fe4b674d tempest-AttachVolumeNegativeTest-2056769334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e6a76c4-bba4-4cb7-9538-37349038a892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:43:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9b0d5459-0c39-491f-93aa-4cb9fe4b674d tempest-AttachVolumeNegativeTest-2056769334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e6a76c4-bba4-4cb7-9538-37349038a892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb401785-82c0-433d-b15f-42ba10548f08', 'volume_name': 'volume-cb401785-82c0-433d-b15f-42ba10548f08', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:43:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9b0d5459-0c39-491f-93aa-4cb9fe4b674d tempest-AttachVolumeNegativeTest-2056769334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38972037-f3f9-49b4-a10e-a8cc8d618abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:43:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9b0d5459-0c39-491f-93aa-4cb9fe4b674d tempest-AttachVolumeNegativeTest-2056769334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38972037-f3f9-49b4-a10e-a8cc8d618abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:43:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9b0d5459-0c39-491f-93aa-4cb9fe4b674d tempest-AttachVolumeNegativeTest-2056769334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58025b41-45e9-4459-bbdd-98c21adbe46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:43:47 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-9b0d5459-0c39-491f-93aa-4cb9fe4b674d tempest-AttachVolumeNegativeTest-2056769334 None] Volume cb401785-82c0-433d-b15f-42ba10548f08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb401785-82c0-433d-b15f-42ba10548f08', 'volume_size': 1}
Jul 10 12:43:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-9b0d5459-0c39-491f-93aa-4cb9fe4b674d tempest-AttachVolumeNegativeTest-2056769334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:43:47 devstack sudo[94450]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1757c6cf-8ef5-43a2-bdfc-04d5930e4e3d tempest-VolumesDeleteCascade-115765563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.d9a8d45f-7910-487c-ab52-f0ae3333e56e" returned: 0 in 0.882s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1757c6cf-8ef5-43a2-bdfc-04d5930e4e3d tempest-VolumesDeleteCascade-115765563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:47 devstack sudo[94453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.info
Jul 10 12:43:47 devstack sudo[94453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:48 devstack sudo[94453]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1757c6cf-8ef5-43a2-bdfc-04d5930e4e3d tempest-VolumesDeleteCascade-115765563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.info" returned: 0 in 0.759s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:48 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-1757c6cf-8ef5-43a2-bdfc-04d5930e4e3d tempest-VolumesDeleteCascade-115765563 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.info is being set with open permissions: ugo+rw
Jul 10 12:43:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1757c6cf-8ef5-43a2-bdfc-04d5930e4e3d tempest-VolumesDeleteCascade-115765563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:48 devstack sudo[94460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.info
Jul 10 12:43:48 devstack sudo[94460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:49 devstack sudo[94460]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1757c6cf-8ef5-43a2-bdfc-04d5930e4e3d tempest-VolumesDeleteCascade-115765563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.info" returned: 0 in 0.675s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1757c6cf-8ef5-43a2-bdfc-04d5930e4e3d tempest-VolumesDeleteCascade-115765563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.387s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:43:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-9b0d5459-0c39-491f-93aa-4cb9fe4b674d tempest-AttachVolumeNegativeTest-2056769334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.776s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:43:49 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-9b0d5459-0c39-491f-93aa-4cb9fe4b674d tempest-AttachVolumeNegativeTest-2056769334 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:43:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1497258342',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb401785-82c0-433d-b15f-42ba10548f08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a63dc9ad7bb64e71947d627c39ccb30a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:43:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:43:47Z,use_quota=True,user_id='4e2b69d2fc924858bd316c21d4da30cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:43:49 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-9b0d5459-0c39-491f-93aa-4cb9fe4b674d tempest-AttachVolumeNegativeTest-2056769334 None] Creating volume cb401785-82c0-433d-b15f-42ba10548f08 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:43:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-9b0d5459-0c39-491f-93aa-4cb9fe4b674d tempest-AttachVolumeNegativeTest-2056769334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:43:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-9b0d5459-0c39-491f-93aa-4cb9fe4b674d tempest-AttachVolumeNegativeTest-2056769334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:43:49 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-9b0d5459-0c39-491f-93aa-4cb9fe4b674d tempest-AttachVolumeNegativeTest-2056769334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:43:49 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-9b0d5459-0c39-491f-93aa-4cb9fe4b674d tempest-AttachVolumeNegativeTest-2056769334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:43:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-9b0d5459-0c39-491f-93aa-4cb9fe4b674d tempest-AttachVolumeNegativeTest-2056769334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:43:49 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-9b0d5459-0c39-491f-93aa-4cb9fe4b674d tempest-AttachVolumeNegativeTest-2056769334 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:43:49 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-9b0d5459-0c39-491f-93aa-4cb9fe4b674d tempest-AttachVolumeNegativeTest-2056769334 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:43:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9b0d5459-0c39-491f-93aa-4cb9fe4b674d tempest-AttachVolumeNegativeTest-2056769334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cb401785-82c0-433d-b15f-42ba10548f08 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:49 devstack sudo[94463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cb401785-82c0-433d-b15f-42ba10548f08 1073741824
Jul 10 12:43:49 devstack sudo[94463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:49 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-1757c6cf-8ef5-43a2-bdfc-04d5930e4e3d tempest-VolumesDeleteCascade-115765563 None] Create snapshot completed successfully
Jul 10 12:43:50 devstack sudo[94463]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9b0d5459-0c39-491f-93aa-4cb9fe4b674d tempest-AttachVolumeNegativeTest-2056769334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cb401785-82c0-433d-b15f-42ba10548f08 1073741824" returned: 0 in 0.914s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9b0d5459-0c39-491f-93aa-4cb9fe4b674d tempest-AttachVolumeNegativeTest-2056769334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cb401785-82c0-433d-b15f-42ba10548f08 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:50 devstack sudo[94469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cb401785-82c0-433d-b15f-42ba10548f08
Jul 10 12:43:50 devstack sudo[94469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a10ed160-bc57-4451-a8f2-c78c298ebd2d tempest-VolumesDeleteCascade-115765563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:43:51 devstack sudo[94469]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9b0d5459-0c39-491f-93aa-4cb9fe4b674d tempest-AttachVolumeNegativeTest-2056769334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cb401785-82c0-433d-b15f-42ba10548f08" returned: 0 in 0.692s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:51 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-9b0d5459-0c39-491f-93aa-4cb9fe4b674d tempest-AttachVolumeNegativeTest-2056769334 None] <== create_volume: return (1653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:43:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-9b0d5459-0c39-491f-93aa-4cb9fe4b674d tempest-AttachVolumeNegativeTest-2056769334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.656s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:43:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a10ed160-bc57-4451-a8f2-c78c298ebd2d tempest-VolumesDeleteCascade-115765563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.591s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:43:51 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-a10ed160-bc57-4451-a8f2-c78c298ebd2d tempest-VolumesDeleteCascade-115765563 None] Creating offline snapshot dfe529dd-0358-4fea-b22e-a43969fc7b23 of volume 5e6f6ac2-a59f-4fdc-898a-e3d1552bb313 {{(pid=87378) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 10 12:43:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9b0d5459-0c39-491f-93aa-4cb9fe4b674d tempest-AttachVolumeNegativeTest-2056769334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58025b41-45e9-4459-bbdd-98c21adbe46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb401785-82c0-433d-b15f-42ba10548f08', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:43:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9b0d5459-0c39-491f-93aa-4cb9fe4b674d tempest-AttachVolumeNegativeTest-2056769334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33180f1b-7c67-4769-845b-9264f4961ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:43:51 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[86234af7-9d21-430f-a669-fd7ab358f77e]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:43:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a10ed160-bc57-4451-a8f2-c78c298ebd2d tempest-VolumesDeleteCascade-115765563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.d9a8d45f-7910-487c-ab52-f0ae3333e56e {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:51 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-9b0d5459-0c39-491f-93aa-4cb9fe4b674d tempest-AttachVolumeNegativeTest-2056769334 None] Volume volume-cb401785-82c0-433d-b15f-42ba10548f08 (cb401785-82c0-433d-b15f-42ba10548f08): created successfully
Jul 10 12:43:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9b0d5459-0c39-491f-93aa-4cb9fe4b674d tempest-AttachVolumeNegativeTest-2056769334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33180f1b-7c67-4769-845b-9264f4961ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:43:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9b0d5459-0c39-491f-93aa-4cb9fe4b674d tempest-AttachVolumeNegativeTest-2056769334 None] Flow 'volume_create_manager' (1f18c2c5-d2f1-4c08-8505-0330f33878f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:43:51 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-9b0d5459-0c39-491f-93aa-4cb9fe4b674d tempest-AttachVolumeNegativeTest-2056769334 None] Created volume successfully.
Jul 10 12:43:51 devstack sudo[94472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.d9a8d45f-7910-487c-ab52-f0ae3333e56e
Jul 10 12:43:51 devstack sudo[94472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:51 devstack sudo[94472]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a10ed160-bc57-4451-a8f2-c78c298ebd2d tempest-VolumesDeleteCascade-115765563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.d9a8d45f-7910-487c-ab52-f0ae3333e56e" returned: 0 in 0.833s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:51 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-a10ed160-bc57-4451-a8f2-c78c298ebd2d tempest-VolumesDeleteCascade-115765563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:43:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a10ed160-bc57-4451-a8f2-c78c298ebd2d tempest-VolumesDeleteCascade-115765563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.d9a8d45f-7910-487c-ab52-f0ae3333e56e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.dfe529dd-0358-4fea-b22e-a43969fc7b23 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:51 devstack sudo[94481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.d9a8d45f-7910-487c-ab52-f0ae3333e56e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.dfe529dd-0358-4fea-b22e-a43969fc7b23 1G
Jul 10 12:43:51 devstack sudo[94481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:52 devstack sudo[94481]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a10ed160-bc57-4451-a8f2-c78c298ebd2d tempest-VolumesDeleteCascade-115765563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.d9a8d45f-7910-487c-ab52-f0ae3333e56e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.dfe529dd-0358-4fea-b22e-a43969fc7b23 1G" returned: 0 in 0.929s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a10ed160-bc57-4451-a8f2-c78c298ebd2d tempest-VolumesDeleteCascade-115765563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.d9a8d45f-7910-487c-ab52-f0ae3333e56e -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.dfe529dd-0358-4fea-b22e-a43969fc7b23 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:52 devstack sudo[94487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.d9a8d45f-7910-487c-ab52-f0ae3333e56e -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.dfe529dd-0358-4fea-b22e-a43969fc7b23
Jul 10 12:43:52 devstack sudo[94487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:53 devstack sudo[94487]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a10ed160-bc57-4451-a8f2-c78c298ebd2d tempest-VolumesDeleteCascade-115765563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.d9a8d45f-7910-487c-ab52-f0ae3333e56e -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.dfe529dd-0358-4fea-b22e-a43969fc7b23" returned: 0 in 0.732s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:53 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-a10ed160-bc57-4451-a8f2-c78c298ebd2d tempest-VolumesDeleteCascade-115765563 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.dfe529dd-0358-4fea-b22e-a43969fc7b23 is being set with open permissions: ugo+rw
Jul 10 12:43:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a10ed160-bc57-4451-a8f2-c78c298ebd2d tempest-VolumesDeleteCascade-115765563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.dfe529dd-0358-4fea-b22e-a43969fc7b23 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:53 devstack sudo[94492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.dfe529dd-0358-4fea-b22e-a43969fc7b23
Jul 10 12:43:53 devstack sudo[94492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:54 devstack sudo[94492]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a10ed160-bc57-4451-a8f2-c78c298ebd2d tempest-VolumesDeleteCascade-115765563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.dfe529dd-0358-4fea-b22e-a43969fc7b23" returned: 0 in 0.785s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a10ed160-bc57-4451-a8f2-c78c298ebd2d tempest-VolumesDeleteCascade-115765563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.404s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:43:54 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-a10ed160-bc57-4451-a8f2-c78c298ebd2d tempest-VolumesDeleteCascade-115765563 None] Create snapshot completed successfully
Jul 10 12:43:54 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Acquiring lock "cinder-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:43:54 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Lock "cinder-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:43:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Performing cascade delete. {{(pid=87378) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jul 10 12:43:54 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Acquiring lock "cinder-d9a8d45f-7910-487c-ab52-f0ae3333e56e-delete_snapshot" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:43:54 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Lock "cinder-d9a8d45f-7910-487c-ab52-f0ae3333e56e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:43:54 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Acquiring lock "cinder-quobyte-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:43:54 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Lock "cinder-quobyte-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:43:54 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Acquiring lock "cinder-quobyte-d9a8d45f-7910-487c-ab52-f0ae3333e56e" by "_delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:43:54 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Lock "cinder-quobyte-d9a8d45f-7910-487c-ab52-f0ae3333e56e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:43:54 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Deleting offline snapshot d9a8d45f-7910-487c-ab52-f0ae3333e56e of volume 5e6f6ac2-a59f-4fdc-898a-e3d1552bb313 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 10 12:43:54 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] snapshot_file for this snap is: volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.d9a8d45f-7910-487c-ab52-f0ae3333e56e {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 10 12:43:54 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e1b19a-171d-41a8-a251-43223cee97f1]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:43:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.d9a8d45f-7910-487c-ab52-f0ae3333e56e {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:54 devstack sudo[94496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.d9a8d45f-7910-487c-ab52-f0ae3333e56e
Jul 10 12:43:54 devstack sudo[94496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-91edd031-1673-43d1-a967-d00d4d5af16d req-69e9c006-29cf-45ce-860c-2a9f753c3932 tempest-AttachVolumeNegativeTest-2056769334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:43:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-91edd031-1673-43d1-a967-d00d4d5af16d req-69e9c006-29cf-45ce-860c-2a9f753c3932 tempest-AttachVolumeNegativeTest-2056769334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:43:55 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53b4785-101e-4fac-bf78-38808b93876c]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:43:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-91edd031-1673-43d1-a967-d00d4d5af16d req-69e9c006-29cf-45ce-860c-2a9f753c3932 tempest-AttachVolumeNegativeTest-2056769334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cb401785-82c0-433d-b15f-42ba10548f08 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:55 devstack sudo[94506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cb401785-82c0-433d-b15f-42ba10548f08
Jul 10 12:43:55 devstack sudo[94506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:55 devstack sudo[94496]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.d9a8d45f-7910-487c-ab52-f0ae3333e56e" returned: 0 in 0.870s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:55 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:43:55 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[231564f4-4307-4b53-b4a5-1a9b915f516d]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:43:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:55 devstack sudo[94512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313
Jul 10 12:43:55 devstack sudo[94512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:56 devstack sudo[94506]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-91edd031-1673-43d1-a967-d00d4d5af16d req-69e9c006-29cf-45ce-860c-2a9f753c3932 tempest-AttachVolumeNegativeTest-2056769334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cb401785-82c0-433d-b15f-42ba10548f08" returned: 0 in 0.963s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-91edd031-1673-43d1-a967-d00d4d5af16d req-69e9c006-29cf-45ce-860c-2a9f753c3932 tempest-AttachVolumeNegativeTest-2056769334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.986s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:43:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-91edd031-1673-43d1-a967-d00d4d5af16d req-69e9c006-29cf-45ce-860c-2a9f753c3932 tempest-AttachVolumeNegativeTest-2056769334 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be', 'name': 'volume-cb401785-82c0-433d-b15f-42ba10548f08', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '12e1ba29-5464-44f3-9451-3c9f99f3b529', 'enforce_multipath': True} {{(pid=87378) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 10 12:43:56 devstack cinder-volume[87378]: INFO cinder.volume.manager [req-91edd031-1673-43d1-a967-d00d4d5af16d req-69e9c006-29cf-45ce-860c-2a9f753c3932 tempest-AttachVolumeNegativeTest-2056769334 None] attachment_update completed successfully.
Jul 10 12:43:56 devstack sudo[94512]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313" returned: 0 in 1.180s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:57 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea91439-c401-4500-8def-ac1685d0e08e]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:43:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.dfe529dd-0358-4fea-b22e-a43969fc7b23 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:57 devstack sudo[94588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.dfe529dd-0358-4fea-b22e-a43969fc7b23
Jul 10 12:43:57 devstack sudo[94588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:57 devstack sudo[94588]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.dfe529dd-0358-4fea-b22e-a43969fc7b23" returned: 0 in 0.887s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:57 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:43:57 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3270023-170e-4b1c-9938-c6c74ebb5907]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:43:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.d9a8d45f-7910-487c-ab52-f0ae3333e56e {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:58 devstack sudo[94911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.d9a8d45f-7910-487c-ab52-f0ae3333e56e
Jul 10 12:43:58 devstack sudo[94911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:58 devstack sudo[94911]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.d9a8d45f-7910-487c-ab52-f0ae3333e56e" returned: 0 in 0.931s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:58 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:43:58 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a5250a-2091-4bee-85a4-13fb8fdf5ef2]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:43:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:59 devstack sudo[94918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313
Jul 10 12:43:59 devstack sudo[94918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:43:59 devstack sudo[94918]: pam_unix(sudo:session): session closed for user root
Jul 10 12:43:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313" returned: 0 in 0.956s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:43:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.d9a8d45f-7910-487c-ab52-f0ae3333e56e {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:43:59 devstack sudo[94930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.d9a8d45f-7910-487c-ab52-f0ae3333e56e
Jul 10 12:43:59 devstack sudo[94930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:44:00 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-994876cd-bf50-4e3c-97a7-c4ed4939ac05 tempest-VolumesActionsTest-1987453551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:44:00 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-994876cd-bf50-4e3c-97a7-c4ed4939ac05 tempest-VolumesActionsTest-1987453551 None] Flow 'volume_create_manager' (e3260da5-d002-423d-98e8-9e136d469080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:44:00 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-994876cd-bf50-4e3c-97a7-c4ed4939ac05 tempest-VolumesActionsTest-1987453551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d39ce480-9c65-43c5-bd3b-73640ce92d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:44:00 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-994876cd-bf50-4e3c-97a7-c4ed4939ac05 tempest-VolumesActionsTest-1987453551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d39ce480-9c65-43c5-bd3b-73640ce92d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:44:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-975784799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1224ba53-385c-414b-9176-9508e8815da8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2563817fde9e42ad8c273545bbe46c9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:44:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:44:00Z,use_quota=True,user_id='6e222a71535345249fc8d1f074f7c50e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:44:00 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-994876cd-bf50-4e3c-97a7-c4ed4939ac05 tempest-VolumesActionsTest-1987453551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (182d8188-c34b-4e59-9316-43f3677b2218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:44:00 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-994876cd-bf50-4e3c-97a7-c4ed4939ac05 tempest-VolumesActionsTest-1987453551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (182d8188-c34b-4e59-9316-43f3677b2218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:44:00 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-994876cd-bf50-4e3c-97a7-c4ed4939ac05 tempest-VolumesActionsTest-1987453551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23d1b7e0-b2a0-44f5-bee4-fdf431374537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:44:00 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-994876cd-bf50-4e3c-97a7-c4ed4939ac05 tempest-VolumesActionsTest-1987453551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23d1b7e0-b2a0-44f5-bee4-fdf431374537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1224ba53-385c-414b-9176-9508e8815da8', 'volume_name': 'volume-1224ba53-385c-414b-9176-9508e8815da8', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:44:00 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-994876cd-bf50-4e3c-97a7-c4ed4939ac05 tempest-VolumesActionsTest-1987453551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f449d0da-c0b8-4b86-906f-20d29ec1b519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:44:00 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-994876cd-bf50-4e3c-97a7-c4ed4939ac05 tempest-VolumesActionsTest-1987453551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f449d0da-c0b8-4b86-906f-20d29ec1b519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:44:00 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-994876cd-bf50-4e3c-97a7-c4ed4939ac05 tempest-VolumesActionsTest-1987453551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d54eda48-2ebf-440f-85db-dca36d125025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:44:00 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-994876cd-bf50-4e3c-97a7-c4ed4939ac05 tempest-VolumesActionsTest-1987453551 None] Volume 1224ba53-385c-414b-9176-9508e8815da8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1224ba53-385c-414b-9176-9508e8815da8', 'volume_size': 1}
Jul 10 12:44:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-994876cd-bf50-4e3c-97a7-c4ed4939ac05 tempest-VolumesActionsTest-1987453551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:44:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-994876cd-bf50-4e3c-97a7-c4ed4939ac05 tempest-VolumesActionsTest-1987453551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:44:00 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-994876cd-bf50-4e3c-97a7-c4ed4939ac05 tempest-VolumesActionsTest-1987453551 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:44:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-975784799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1224ba53-385c-414b-9176-9508e8815da8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2563817fde9e42ad8c273545bbe46c9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:44:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:44:00Z,use_quota=True,user_id='6e222a71535345249fc8d1f074f7c50e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:44:00 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-994876cd-bf50-4e3c-97a7-c4ed4939ac05 tempest-VolumesActionsTest-1987453551 None] Creating volume 1224ba53-385c-414b-9176-9508e8815da8 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:44:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-994876cd-bf50-4e3c-97a7-c4ed4939ac05 tempest-VolumesActionsTest-1987453551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:44:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-994876cd-bf50-4e3c-97a7-c4ed4939ac05 tempest-VolumesActionsTest-1987453551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:44:00 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-994876cd-bf50-4e3c-97a7-c4ed4939ac05 tempest-VolumesActionsTest-1987453551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:44:00 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-994876cd-bf50-4e3c-97a7-c4ed4939ac05 tempest-VolumesActionsTest-1987453551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:44:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-994876cd-bf50-4e3c-97a7-c4ed4939ac05 tempest-VolumesActionsTest-1987453551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:44:00 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-994876cd-bf50-4e3c-97a7-c4ed4939ac05 tempest-VolumesActionsTest-1987453551 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:44:00 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-994876cd-bf50-4e3c-97a7-c4ed4939ac05 tempest-VolumesActionsTest-1987453551 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:44:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-994876cd-bf50-4e3c-97a7-c4ed4939ac05 tempest-VolumesActionsTest-1987453551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1224ba53-385c-414b-9176-9508e8815da8 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:44:00 devstack sudo[94946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1224ba53-385c-414b-9176-9508e8815da8 1073741824
Jul 10 12:44:00 devstack sudo[94946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:44:00 devstack sudo[94930]: pam_unix(sudo:session): session closed for user root
Jul 10 12:44:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.d9a8d45f-7910-487c-ab52-f0ae3333e56e" returned: 0 in 1.011s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:44:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.d9a8d45f-7910-487c-ab52-f0ae3333e56e {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:44:00 devstack sudo[94954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.d9a8d45f-7910-487c-ab52-f0ae3333e56e
Jul 10 12:44:00 devstack sudo[94954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:44:01 devstack sudo[94946]: pam_unix(sudo:session): session closed for user root
Jul 10 12:44:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-994876cd-bf50-4e3c-97a7-c4ed4939ac05 tempest-VolumesActionsTest-1987453551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1224ba53-385c-414b-9176-9508e8815da8 1073741824" returned: 0 in 1.084s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:44:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-994876cd-bf50-4e3c-97a7-c4ed4939ac05 tempest-VolumesActionsTest-1987453551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1224ba53-385c-414b-9176-9508e8815da8 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:44:01 devstack sudo[94963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1224ba53-385c-414b-9176-9508e8815da8
Jul 10 12:44:01 devstack sudo[94963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:44:01 devstack sudo[94954]: pam_unix(sudo:session): session closed for user root
Jul 10 12:44:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.d9a8d45f-7910-487c-ab52-f0ae3333e56e" returned: 0 in 0.884s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:44:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.dfe529dd-0358-4fea-b22e-a43969fc7b23 -F qcow2 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:44:01 devstack sudo[94965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.dfe529dd-0358-4fea-b22e-a43969fc7b23 -F qcow2
Jul 10 12:44:01 devstack sudo[94965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:44:02 devstack sudo[94963]: pam_unix(sudo:session): session closed for user root
Jul 10 12:44:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-994876cd-bf50-4e3c-97a7-c4ed4939ac05 tempest-VolumesActionsTest-1987453551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1224ba53-385c-414b-9176-9508e8815da8" returned: 0 in 0.813s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:44:02 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-994876cd-bf50-4e3c-97a7-c4ed4939ac05 tempest-VolumesActionsTest-1987453551 None] <== create_volume: return (1960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:44:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-994876cd-bf50-4e3c-97a7-c4ed4939ac05 tempest-VolumesActionsTest-1987453551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.963s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:44:02 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-994876cd-bf50-4e3c-97a7-c4ed4939ac05 tempest-VolumesActionsTest-1987453551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d54eda48-2ebf-440f-85db-dca36d125025) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1224ba53-385c-414b-9176-9508e8815da8', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:44:02 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-994876cd-bf50-4e3c-97a7-c4ed4939ac05 tempest-VolumesActionsTest-1987453551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08a432da-9961-4a93-a43c-4d368d5cae71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:44:02 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-994876cd-bf50-4e3c-97a7-c4ed4939ac05 tempest-VolumesActionsTest-1987453551 None] Volume volume-1224ba53-385c-414b-9176-9508e8815da8 (1224ba53-385c-414b-9176-9508e8815da8): created successfully
Jul 10 12:44:02 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-994876cd-bf50-4e3c-97a7-c4ed4939ac05 tempest-VolumesActionsTest-1987453551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08a432da-9961-4a93-a43c-4d368d5cae71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:44:02 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-994876cd-bf50-4e3c-97a7-c4ed4939ac05 tempest-VolumesActionsTest-1987453551 None] Flow 'volume_create_manager' (e3260da5-d002-423d-98e8-9e136d469080) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:44:02 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-994876cd-bf50-4e3c-97a7-c4ed4939ac05 tempest-VolumesActionsTest-1987453551 None] Created volume successfully.
Jul 10 12:44:02 devstack sudo[94965]: pam_unix(sudo:session): session closed for user root
Jul 10 12:44:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.dfe529dd-0358-4fea-b22e-a43969fc7b23 -F qcow2" returned: 0 in 0.943s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:44:02 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Lock "cinder-quobyte-d9a8d45f-7910-487c-ab52-f0ae3333e56e" released by "_delete_snapshot" :: held 7.915s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:44:02 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Lock "cinder-quobyte-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313" released by "delete_snapshot" :: held 7.938s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:44:02 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Created reservations ['a18120ca-dea8-4b86-8b45-882208fc4863', 'bb33a53d-5ecf-481b-a6bd-6a97cdbd1dea', '27bc172c-7cdc-4c03-a898-d0951c4129c8', '58fa7c29-a96d-40b6-a1aa-0397ffdc360a'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:44:02 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Delete snapshot completed successfully.
Jul 10 12:44:02 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Lock "cinder-d9a8d45f-7910-487c-ab52-f0ae3333e56e-delete_snapshot" released by "delete_snapshot" :: held 8.116s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:44:02 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Acquiring lock "cinder-dfe529dd-0358-4fea-b22e-a43969fc7b23-delete_snapshot" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:44:02 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Lock "cinder-dfe529dd-0358-4fea-b22e-a43969fc7b23-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:44:02 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Acquiring lock "cinder-quobyte-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:44:02 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Lock "cinder-quobyte-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:44:02 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Acquiring lock "cinder-quobyte-dfe529dd-0358-4fea-b22e-a43969fc7b23" by "_delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:44:02 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Lock "cinder-quobyte-dfe529dd-0358-4fea-b22e-a43969fc7b23" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:44:02 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Deleting offline snapshot dfe529dd-0358-4fea-b22e-a43969fc7b23 of volume 5e6f6ac2-a59f-4fdc-898a-e3d1552bb313 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 10 12:44:02 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] snapshot_file for this snap is: volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.dfe529dd-0358-4fea-b22e-a43969fc7b23 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 10 12:44:02 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[171d8603-c217-4580-a905-9b4d5680449f]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:44:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.dfe529dd-0358-4fea-b22e-a43969fc7b23 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:44:03 devstack sudo[94973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.dfe529dd-0358-4fea-b22e-a43969fc7b23
Jul 10 12:44:03 devstack sudo[94973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:44:03 devstack sudo[94973]: pam_unix(sudo:session): session closed for user root
Jul 10 12:44:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.dfe529dd-0358-4fea-b22e-a43969fc7b23" returned: 0 in 0.870s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:44:03 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:44:03 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20ceb63-d757-4081-bee7-aaa856007f9a]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:44:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:44:04 devstack sudo[94978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313
Jul 10 12:44:04 devstack sudo[94978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:44:04 devstack sudo[94978]: pam_unix(sudo:session): session closed for user root
Jul 10 12:44:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313" returned: 0 in 0.918s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:44:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.dfe529dd-0358-4fea-b22e-a43969fc7b23 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:44:04 devstack sudo[94989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.dfe529dd-0358-4fea-b22e-a43969fc7b23
Jul 10 12:44:04 devstack sudo[94989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:44:05 devstack sudo[94989]: pam_unix(sudo:session): session closed for user root
Jul 10 12:44:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.dfe529dd-0358-4fea-b22e-a43969fc7b23" returned: 0 in 0.914s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:44:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.dfe529dd-0358-4fea-b22e-a43969fc7b23 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:44:05 devstack sudo[94997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.dfe529dd-0358-4fea-b22e-a43969fc7b23
Jul 10 12:44:05 devstack sudo[94997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:44:06 devstack sudo[94997]: pam_unix(sudo:session): session closed for user root
Jul 10 12:44:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313.dfe529dd-0358-4fea-b22e-a43969fc7b23" returned: 0 in 0.761s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:44:06 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Lock "cinder-quobyte-dfe529dd-0358-4fea-b22e-a43969fc7b23" released by "_delete_snapshot" :: held 3.590s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:44:06 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Lock "cinder-quobyte-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313" released by "delete_snapshot" :: held 3.616s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:44:06 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Created reservations ['50448077-02cb-4eab-86b7-207c6c7226a6', 'b8220ba0-f6a3-46ef-b63f-c396af9061f7', 'fca2467b-9d31-4af6-a11e-46bbf74f0241', '3bf5b10f-e02a-4b47-8949-084dbd96245e'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:44:06 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Delete snapshot completed successfully.
Jul 10 12:44:06 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Lock "cinder-dfe529dd-0358-4fea-b22e-a43969fc7b23-delete_snapshot" released by "delete_snapshot" :: held 3.836s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:44:06 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Snapshots deleted, issuing volume delete {{(pid=87378) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jul 10 12:44:06 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Acquiring lock "cinder-quobyte-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:44:06 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Lock "cinder-quobyte-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313" acquired by "delete_volume" :: waited 0.018s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:44:06 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0a9574-07a5-4403-9e68-8144b2048c65]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:44:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:44:06 devstack sudo[95000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313
Jul 10 12:44:06 devstack sudo[95000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:44:07 devstack sudo[95000]: pam_unix(sudo:session): session closed for user root
Jul 10 12:44:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313" returned: 0 in 0.828s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:44:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:44:07 devstack sudo[95005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313
Jul 10 12:44:07 devstack sudo[95005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:44:08 devstack sudo[95005]: pam_unix(sudo:session): session closed for user root
Jul 10 12:44:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313" returned: 0 in 0.713s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:44:08 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Lock "cinder-quobyte-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313" released by "delete_volume" :: held 1.603s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:44:08 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Created reservations ['91bafcdf-d824-44cf-ad37-7ccc041831cb', 'd821d342-73d6-44cc-989c-88da072b366b', '1358c9d6-57b3-4d00-b042-c55689c2d140', '6437753e-cc87-4ecd-8bd7-ab564facc880'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:44:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:44:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:44:08 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:44:08 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:44:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:44:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:44:08 devstack sudo[95008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:44:08 devstack sudo[95008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:44:09 devstack sudo[95008]: pam_unix(sudo:session): session closed for user root
Jul 10 12:44:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.759s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:44:09 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:44:09 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Deleted volume successfully.
Jul 10 12:44:09 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3f1c4e70-08f7-4f82-a277-bdecc184a971 tempest-VolumesDeleteCascade-115765563 None] Lock "cinder-5e6f6ac2-a59f-4fdc-898a-e3d1552bb313-delete_volume" released by "delete_volume" :: held 14.638s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:44:09 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1a29d49-a938-4917-be38-826bb823ba84 tempest-VolumesDeleteCascade-115765563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:44:09 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d1a29d49-a938-4917-be38-826bb823ba84 tempest-VolumesDeleteCascade-115765563 None] Flow 'volume_create_manager' (06792d72-da7f-4103-aad8-a1e051923bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:44:09 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d1a29d49-a938-4917-be38-826bb823ba84 tempest-VolumesDeleteCascade-115765563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb9e4d11-6eb0-49bb-ad90-7e41652e09bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:44:10 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d1a29d49-a938-4917-be38-826bb823ba84 tempest-VolumesDeleteCascade-115765563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb9e4d11-6eb0-49bb-ad90-7e41652e09bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:44:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1263855805',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c1390ad-4062-4ec7-b4f3-b2cd5666ede3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='736971a320d94d248b5ec688f7b08635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:44:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:44:10Z,use_quota=True,user_id='22cf595150194520b5823020820edb83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:44:10 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d1a29d49-a938-4917-be38-826bb823ba84 tempest-VolumesDeleteCascade-115765563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90d6efc8-bce6-40b1-a535-2e7c8c81367d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:44:10 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d1a29d49-a938-4917-be38-826bb823ba84 tempest-VolumesDeleteCascade-115765563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90d6efc8-bce6-40b1-a535-2e7c8c81367d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:44:10 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d1a29d49-a938-4917-be38-826bb823ba84 tempest-VolumesDeleteCascade-115765563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6365d399-add1-48de-890e-ed88985d0e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:44:10 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d1a29d49-a938-4917-be38-826bb823ba84 tempest-VolumesDeleteCascade-115765563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6365d399-add1-48de-890e-ed88985d0e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c1390ad-4062-4ec7-b4f3-b2cd5666ede3', 'volume_name': 'volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:44:10 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d1a29d49-a938-4917-be38-826bb823ba84 tempest-VolumesDeleteCascade-115765563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f706529-1d74-4c91-9f76-1c9b2b324761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:44:10 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d1a29d49-a938-4917-be38-826bb823ba84 tempest-VolumesDeleteCascade-115765563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f706529-1d74-4c91-9f76-1c9b2b324761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:44:10 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d1a29d49-a938-4917-be38-826bb823ba84 tempest-VolumesDeleteCascade-115765563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad1f611-c107-49fc-9407-5f3b11c33560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:44:10 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-d1a29d49-a938-4917-be38-826bb823ba84 tempest-VolumesDeleteCascade-115765563 None] Volume 0c1390ad-4062-4ec7-b4f3-b2cd5666ede3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3', 'volume_size': 1}
Jul 10 12:44:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d1a29d49-a938-4917-be38-826bb823ba84 tempest-VolumesDeleteCascade-115765563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:44:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d1a29d49-a938-4917-be38-826bb823ba84 tempest-VolumesDeleteCascade-115765563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:44:10 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-d1a29d49-a938-4917-be38-826bb823ba84 tempest-VolumesDeleteCascade-115765563 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:44:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1263855805',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c1390ad-4062-4ec7-b4f3-b2cd5666ede3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='736971a320d94d248b5ec688f7b08635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:44:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:44:10Z,use_quota=True,user_id='22cf595150194520b5823020820edb83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:44:10 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-d1a29d49-a938-4917-be38-826bb823ba84 tempest-VolumesDeleteCascade-115765563 None] Creating volume 0c1390ad-4062-4ec7-b4f3-b2cd5666ede3 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:44:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d1a29d49-a938-4917-be38-826bb823ba84 tempest-VolumesDeleteCascade-115765563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:44:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d1a29d49-a938-4917-be38-826bb823ba84 tempest-VolumesDeleteCascade-115765563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:44:10 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-d1a29d49-a938-4917-be38-826bb823ba84 tempest-VolumesDeleteCascade-115765563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:44:10 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-d1a29d49-a938-4917-be38-826bb823ba84 tempest-VolumesDeleteCascade-115765563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:44:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d1a29d49-a938-4917-be38-826bb823ba84 tempest-VolumesDeleteCascade-115765563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:44:10 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-d1a29d49-a938-4917-be38-826bb823ba84 tempest-VolumesDeleteCascade-115765563 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:44:10 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-d1a29d49-a938-4917-be38-826bb823ba84 tempest-VolumesDeleteCascade-115765563 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:44:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d1a29d49-a938-4917-be38-826bb823ba84 tempest-VolumesDeleteCascade-115765563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:44:10 devstack sudo[95015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3 1073741824
Jul 10 12:44:10 devstack sudo[95015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:44:11 devstack sudo[95015]: pam_unix(sudo:session): session closed for user root
Jul 10 12:44:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d1a29d49-a938-4917-be38-826bb823ba84 tempest-VolumesDeleteCascade-115765563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3 1073741824" returned: 0 in 1.027s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:44:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d1a29d49-a938-4917-be38-826bb823ba84 tempest-VolumesDeleteCascade-115765563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:44:11 devstack sudo[95027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3
Jul 10 12:44:11 devstack sudo[95027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:44:12 devstack sudo[95027]: pam_unix(sudo:session): session closed for user root
Jul 10 12:44:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d1a29d49-a938-4917-be38-826bb823ba84 tempest-VolumesDeleteCascade-115765563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3" returned: 0 in 0.888s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:44:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-d1a29d49-a938-4917-be38-826bb823ba84 tempest-VolumesDeleteCascade-115765563 None] <== create_volume: return (1968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:44:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d1a29d49-a938-4917-be38-826bb823ba84 tempest-VolumesDeleteCascade-115765563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.971s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:44:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d1a29d49-a938-4917-be38-826bb823ba84 tempest-VolumesDeleteCascade-115765563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad1f611-c107-49fc-9407-5f3b11c33560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:44:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d1a29d49-a938-4917-be38-826bb823ba84 tempest-VolumesDeleteCascade-115765563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9808add2-7b3f-43af-8c82-a010400c4484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:44:12 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-d1a29d49-a938-4917-be38-826bb823ba84 tempest-VolumesDeleteCascade-115765563 None] Volume volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3 (0c1390ad-4062-4ec7-b4f3-b2cd5666ede3): created successfully
Jul 10 12:44:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d1a29d49-a938-4917-be38-826bb823ba84 tempest-VolumesDeleteCascade-115765563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9808add2-7b3f-43af-8c82-a010400c4484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:44:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d1a29d49-a938-4917-be38-826bb823ba84 tempest-VolumesDeleteCascade-115765563 None] Flow 'volume_create_manager' (06792d72-da7f-4103-aad8-a1e051923bd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:44:12 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-d1a29d49-a938-4917-be38-826bb823ba84 tempest-VolumesDeleteCascade-115765563 None] Created volume successfully.
Jul 10 12:44:12 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:44:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:44:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:44:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:44:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:44:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:44:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:44:12 devstack sudo[95042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:44:12 devstack sudo[95042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:44:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-be0616a3-7427-40a8-b130-7b61b7da904e tempest-VolumesDeleteCascade-115765563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:44:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-be0616a3-7427-40a8-b130-7b61b7da904e tempest-VolumesDeleteCascade-115765563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:44:13 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-be0616a3-7427-40a8-b130-7b61b7da904e tempest-VolumesDeleteCascade-115765563 None] Creating offline snapshot 0db3dedf-50e6-46bd-b264-d77290266c8c of volume 0c1390ad-4062-4ec7-b4f3-b2cd5666ede3 {{(pid=87378) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 10 12:44:13 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[312a4a62-12a3-4c3a-b6f8-9298a6bfbe4b]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:44:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-be0616a3-7427-40a8-b130-7b61b7da904e tempest-VolumesDeleteCascade-115765563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:44:13 devstack sudo[95044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3
Jul 10 12:44:13 devstack sudo[95044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:44:14 devstack sudo[95042]: pam_unix(sudo:session): session closed for user root
Jul 10 12:44:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 1.050s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:44:14 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:44:14 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager._thread_info {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:44:14 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread count: 28 {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 10 12:44:14 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread info: [<_MainThread(MainThread, started 128233544536192)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128233445424704)>, <Thread(Thread-3 (stat_writer), started daemon 128233435118528)>, <Thread(Rabbit-heartbeat, started daemon 128233435718016)>, <Thread(Thread-5 (_runner), started daemon 128233432624448)>, <Thread(Thread-7 (_runner), started daemon 128233432674688)>, <Thread(fd_logger, started daemon 128233428569472)>, <Thread(privsep_reader, started daemon 128233429417088)>, <Thread(tpool_thread_0, started daemon 128233421182656)>, <Thread(tpool_thread_1, started daemon 128233412789952)>, <Thread(tpool_thread_2, started daemon 128233404397248)>, <Thread(tpool_thread_3, started daemon 128233396004544)>, <Thread(tpool_thread_4, started daemon 128233387611840)>, <Thread(tpool_thread_5, started daemon 128233379219136)>, <Thread(tpool_thread_6, started daemon 128233370826432)>, <Thread(tpool_thread_7, started daemon 128233362433728)>, <Thread(tpool_thread_8, started daemon 128233354041024)>, <Thread(tpool_thread_9, started daemon 128233345631936)>, <Thread(tpool_thread_10, started daemon 128233337222848)>, <Thread(tpool_thread_11, started daemon 128233328813760)>, <Thread(tpool_thread_12, started daemon 128233320404672)>, <Thread(tpool_thread_13, started daemon 128233311995584)>, <Thread(tpool_thread_14, started daemon 128233303586496)>, <Thread(tpool_thread_15, started daemon 128233295177408)>, <Thread(tpool_thread_16, started daemon 128233286768320)>, <Thread(tpool_thread_17, started daemon 128233278359232)>, <Thread(tpool_thread_18, started daemon 128233269950144)>, <Thread(tpool_thread_19, started daemon 128233261541056)>] {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 10 12:44:14 devstack sudo[95044]: pam_unix(sudo:session): session closed for user root
Jul 10 12:44:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-be0616a3-7427-40a8-b130-7b61b7da904e tempest-VolumesDeleteCascade-115765563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3" returned: 0 in 1.178s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:44:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-be0616a3-7427-40a8-b130-7b61b7da904e tempest-VolumesDeleteCascade-115765563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3.0db3dedf-50e6-46bd-b264-d77290266c8c 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:44:14 devstack sudo[95069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3.0db3dedf-50e6-46bd-b264-d77290266c8c 1G
Jul 10 12:44:14 devstack sudo[95069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:44:15 devstack sudo[95069]: pam_unix(sudo:session): session closed for user root
Jul 10 12:44:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-be0616a3-7427-40a8-b130-7b61b7da904e tempest-VolumesDeleteCascade-115765563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3.0db3dedf-50e6-46bd-b264-d77290266c8c 1G" returned: 0 in 1.133s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:44:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-be0616a3-7427-40a8-b130-7b61b7da904e tempest-VolumesDeleteCascade-115765563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3.0db3dedf-50e6-46bd-b264-d77290266c8c {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:44:15 devstack sudo[95108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3.0db3dedf-50e6-46bd-b264-d77290266c8c
Jul 10 12:44:15 devstack sudo[95108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:44:16 devstack sudo[95108]: pam_unix(sudo:session): session closed for user root
Jul 10 12:44:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-be0616a3-7427-40a8-b130-7b61b7da904e tempest-VolumesDeleteCascade-115765563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3.0db3dedf-50e6-46bd-b264-d77290266c8c" returned: 0 in 1.120s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:44:16 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-be0616a3-7427-40a8-b130-7b61b7da904e tempest-VolumesDeleteCascade-115765563 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3.0db3dedf-50e6-46bd-b264-d77290266c8c is being set with open permissions: ugo+rw
Jul 10 12:44:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-be0616a3-7427-40a8-b130-7b61b7da904e tempest-VolumesDeleteCascade-115765563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3.0db3dedf-50e6-46bd-b264-d77290266c8c {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:44:16 devstack sudo[95127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3.0db3dedf-50e6-46bd-b264-d77290266c8c
Jul 10 12:44:16 devstack sudo[95127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:44:18 devstack sudo[95127]: pam_unix(sudo:session): session closed for user root
Jul 10 12:44:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-be0616a3-7427-40a8-b130-7b61b7da904e tempest-VolumesDeleteCascade-115765563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3.0db3dedf-50e6-46bd-b264-d77290266c8c" returned: 0 in 1.297s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:44:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-be0616a3-7427-40a8-b130-7b61b7da904e tempest-VolumesDeleteCascade-115765563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:44:18 devstack sudo[95229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3.info
Jul 10 12:44:18 devstack sudo[95229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:44:18 devstack sudo[95229]: pam_unix(sudo:session): session closed for user root
Jul 10 12:44:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-be0616a3-7427-40a8-b130-7b61b7da904e tempest-VolumesDeleteCascade-115765563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3.info" returned: 0 in 0.883s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:44:18 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-be0616a3-7427-40a8-b130-7b61b7da904e tempest-VolumesDeleteCascade-115765563 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3.info is being set with open permissions: ugo+rw
Jul 10 12:44:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-be0616a3-7427-40a8-b130-7b61b7da904e tempest-VolumesDeleteCascade-115765563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:44:19 devstack sudo[95233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3.info
Jul 10 12:44:19 devstack sudo[95233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:44:19 devstack sudo[95233]: pam_unix(sudo:session): session closed for user root
Jul 10 12:44:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-be0616a3-7427-40a8-b130-7b61b7da904e tempest-VolumesDeleteCascade-115765563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3.info" returned: 0 in 1.021s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:44:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-be0616a3-7427-40a8-b130-7b61b7da904e tempest-VolumesDeleteCascade-115765563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.810s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:44:20 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-be0616a3-7427-40a8-b130-7b61b7da904e tempest-VolumesDeleteCascade-115765563 None] Create snapshot completed successfully
Jul 10 12:44:21 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1d0e1da8-5ba0-4b76-a6a5-471703ab2ade tempest-VolumesActionsTest-1987453551 None] Acquiring lock "cinder-1224ba53-385c-414b-9176-9508e8815da8" by "attach_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:44:22 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1d0e1da8-5ba0-4b76-a6a5-471703ab2ade tempest-VolumesActionsTest-1987453551 None] Lock "cinder-1224ba53-385c-414b-9176-9508e8815da8" acquired by "attach_volume" :: waited 0.054s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:44:22 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-1d0e1da8-5ba0-4b76-a6a5-471703ab2ade tempest-VolumesActionsTest-1987453551 None] Attaching volume 1224ba53-385c-414b-9176-9508e8815da8 to instance 7eff2178-7582-46c0-bfa7-20d5964ac29c at mountpoint /dev/vdb on host None.
Jul 10 12:44:22 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-1d0e1da8-5ba0-4b76-a6a5-471703ab2ade tempest-VolumesActionsTest-1987453551 None] Attach volume completed successfully.
Jul 10 12:44:22 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1d0e1da8-5ba0-4b76-a6a5-471703ab2ade tempest-VolumesActionsTest-1987453551 None] Lock "cinder-1224ba53-385c-414b-9176-9508e8815da8" released by "attach_volume" :: held 0.219s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:44:22 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:44:22 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] Flow 'volume_create_manager' (767c1b14-06a1-4ce8-8b03-a3c98bef6173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:44:22 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b78fdf4-1575-4bc2-827a-7f89ef8b558c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:44:22 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b78fdf4-1575-4bc2-827a-7f89ef8b558c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:44:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2005517585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50025f24-4b59-4892-ba6e-645d158f23c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='736971a320d94d248b5ec688f7b08635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:44:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0db3dedf-50e6-46bd-b264-d77290266c8c,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:44:22Z,use_quota=True,user_id='22cf595150194520b5823020820edb83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:44:22 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61730588-bfe0-4ab4-a302-1124276358da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:44:22 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61730588-bfe0-4ab4-a302-1124276358da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:44:22 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fc0b62c-6479-44f6-bfac-2b418cfa23ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:44:22 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fc0b62c-6479-44f6-bfac-2b418cfa23ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '50025f24-4b59-4892-ba6e-645d158f23c0', 'volume_name': 'volume-50025f24-4b59-4892-ba6e-645d158f23c0', 'volume_size': 1, 'snapshot_id': '0db3dedf-50e6-46bd-b264-d77290266c8c'}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:44:22 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f2cb8bd-4172-4903-9a49-d04356929311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:44:22 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f2cb8bd-4172-4903-9a49-d04356929311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:44:22 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f499eaa8-374f-42d1-bcd6-0f2857f1c32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:44:22 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] Volume 50025f24-4b59-4892-ba6e-645d158f23c0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-50025f24-4b59-4892-ba6e-645d158f23c0', 'volume_size': 1, 'snapshot_id': '0db3dedf-50e6-46bd-b264-d77290266c8c'}
Jul 10 12:44:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:44:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:44:22 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] Acquiring lock "cinder-quobyte-0db3dedf-50e6-46bd-b264-d77290266c8c-50025f24-4b59-4892-ba6e-645d158f23c0" by "_create_volume_from_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:44:22 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] Lock "cinder-quobyte-0db3dedf-50e6-46bd-b264-d77290266c8c-50025f24-4b59-4892-ba6e-645d158f23c0" acquired by "_create_volume_from_snapshot" :: waited 0.050s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:44:22 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] Creating volume 50025f24-4b59-4892-ba6e-645d158f23c0 from snapshot 0db3dedf-50e6-46bd-b264-d77290266c8c {{(pid=87378) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 10 12:44:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:44:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:44:22 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:44:22 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:44:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:44:22 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:44:22 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] Acquiring lock "cinder-quobyte-50025f24-4b59-4892-ba6e-645d158f23c0" by "_copy_volume_from_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:44:22 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] Lock "cinder-quobyte-50025f24-4b59-4892-ba6e-645d158f23c0" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:44:22 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] snapshot: 0db3dedf-50e6-46bd-b264-d77290266c8c, volume: 50025f24-4b59-4892-ba6e-645d158f23c0,  {{(pid=87378) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 10 12:44:22 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9e3fa24e-6137-4ecf-a03f-dc3a0aa6a45b tempest-VolumesActionsTest-1987453551 None] Acquiring lock "cinder-1224ba53-385c-414b-9176-9508e8815da8-detach_volume" by "detach_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:44:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:44:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:44:22 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:44:22 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:44:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:44:22 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f70c6d-df75-4e65-a55f-2235cb98cd69]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:44:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3.0db3dedf-50e6-46bd-b264-d77290266c8c {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:44:22 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9e3fa24e-6137-4ecf-a03f-dc3a0aa6a45b tempest-VolumesActionsTest-1987453551 None] Lock "cinder-1224ba53-385c-414b-9176-9508e8815da8-detach_volume" acquired by "detach_volume" :: waited 0.133s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:44:22 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-9e3fa24e-6137-4ecf-a03f-dc3a0aa6a45b tempest-VolumesActionsTest-1987453551 None] Detaching volume 1224ba53-385c-414b-9176-9508e8815da8 from instance 7eff2178-7582-46c0-bfa7-20d5964ac29c.
Jul 10 12:44:23 devstack sudo[95325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3.0db3dedf-50e6-46bd-b264-d77290266c8c
Jul 10 12:44:23 devstack sudo[95325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:44:23 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-9e3fa24e-6137-4ecf-a03f-dc3a0aa6a45b tempest-VolumesActionsTest-1987453551 None] Detach volume completed successfully.
Jul 10 12:44:23 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9e3fa24e-6137-4ecf-a03f-dc3a0aa6a45b tempest-VolumesActionsTest-1987453551 None] Lock "cinder-1224ba53-385c-414b-9176-9508e8815da8-detach_volume" released by "detach_volume" :: held 0.261s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:44:24 devstack sudo[95325]: pam_unix(sudo:session): session closed for user root
Jul 10 12:44:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3.0db3dedf-50e6-46bd-b264-d77290266c8c" returned: 0 in 1.558s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:44:24 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:44:24 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] will copy from snapshot at /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3 {{(pid=87378) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 10 12:44:24 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] Creating direct copy from snapshot {{(pid=87378) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 10 12:44:24 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce4f0d2-4f6b-4c4e-b07f-9ddea210087f]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:44:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:44:24 devstack sudo[95343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3
Jul 10 12:44:24 devstack sudo[95343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:44:26 devstack sudo[95343]: pam_unix(sudo:session): session closed for user root
Jul 10 12:44:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3" returned: 0 in 1.535s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:44:26 devstack cinder-volume[87378]: DEBUG cinder.utils [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] Path /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-50025f24-4b59-4892-ba6e-645d158f23c0 not found in is_blk_device check {{(pid=87378) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 10 12:44:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-50025f24-4b59-4892-ba6e-645d158f23c0 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:44:26 devstack sudo[95367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-50025f24-4b59-4892-ba6e-645d158f23c0
Jul 10 12:44:26 devstack sudo[95367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:44:33 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:UPDATE=80,cinder:SELECT=76,cinder:INSERT=22,cinder:DELETE=4 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:44:33 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:SELECT=71,cinder:UPDATE=73,cinder:INSERT=17,cinder:DELETE=10 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:44:38 devstack sudo[95367]: pam_unix(sudo:session): session closed for user root
Jul 10 12:44:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-50025f24-4b59-4892-ba6e-645d158f23c0" returned: 0 in 11.956s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:44:38 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fdf2c66-94f8-4c40-9ccb-b14447f6b107]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:44:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:44:38 devstack sudo[95420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3
Jul 10 12:44:38 devstack sudo[95420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:44:39 devstack sudo[95420]: pam_unix(sudo:session): session closed for user root
Jul 10 12:44:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3" returned: 0 in 1.606s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:44:39 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] Image conversion details: src /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3, size 1024.00 MB, duration 11.96 sec, destination /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-50025f24-4b59-4892-ba6e-645d158f23c0 {{(pid=87378) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 10 12:44:39 devstack cinder-volume[87378]: INFO cinder.image.image_utils [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] Converted 1024.00 MB image at 85.64 MB/s
Jul 10 12:44:39 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-50025f24-4b59-4892-ba6e-645d158f23c0 is being set with open permissions: ugo+rw
Jul 10 12:44:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-50025f24-4b59-4892-ba6e-645d158f23c0 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:44:39 devstack sudo[95460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-50025f24-4b59-4892-ba6e-645d158f23c0
Jul 10 12:44:39 devstack sudo[95460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:44:40 devstack sudo[95460]: pam_unix(sudo:session): session closed for user root
Jul 10 12:44:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-50025f24-4b59-4892-ba6e-645d158f23c0" returned: 0 in 0.789s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:44:40 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] Lock "cinder-quobyte-50025f24-4b59-4892-ba6e-645d158f23c0" released by "_copy_volume_from_snapshot" :: held 17.727s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:44:40 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] Lock "cinder-quobyte-0db3dedf-50e6-46bd-b264-d77290266c8c-50025f24-4b59-4892-ba6e-645d158f23c0" released by "_create_volume_from_snapshot" :: held 17.811s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:44:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 17.870s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:44:40 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f499eaa8-374f-42d1-bcd6-0f2857f1c32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50025f24-4b59-4892-ba6e-645d158f23c0', 'volume_size': 1, 'snapshot_id': '0db3dedf-50e6-46bd-b264-d77290266c8c'}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:44:40 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82da10fc-37fd-4cf8-b4f7-6cee043b578e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:44:40 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] Volume volume-50025f24-4b59-4892-ba6e-645d158f23c0 (50025f24-4b59-4892-ba6e-645d158f23c0): created successfully
Jul 10 12:44:40 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82da10fc-37fd-4cf8-b4f7-6cee043b578e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:44:40 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] Flow 'volume_create_manager' (767c1b14-06a1-4ce8-8b03-a3c98bef6173) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:44:40 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-4c780921-4962-46c1-a7b6-d4ecafeb247f tempest-VolumesDeleteCascade-115765563 None] Created volume successfully.
Jul 10 12:44:41 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-763c4295-f345-44a9-b438-c1c1bd3cd7e9 tempest-VolumesDeleteCascade-115765563 None] Acquiring lock "cinder-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:44:41 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-763c4295-f345-44a9-b438-c1c1bd3cd7e9 tempest-VolumesDeleteCascade-115765563 None] Lock "cinder-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:44:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-763c4295-f345-44a9-b438-c1c1bd3cd7e9 tempest-VolumesDeleteCascade-115765563 None] Performing cascade delete. {{(pid=87378) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jul 10 12:44:41 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-763c4295-f345-44a9-b438-c1c1bd3cd7e9 tempest-VolumesDeleteCascade-115765563 None] Acquiring lock "cinder-0db3dedf-50e6-46bd-b264-d77290266c8c-delete_snapshot" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:44:41 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-763c4295-f345-44a9-b438-c1c1bd3cd7e9 tempest-VolumesDeleteCascade-115765563 None] Lock "cinder-0db3dedf-50e6-46bd-b264-d77290266c8c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:44:41 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-763c4295-f345-44a9-b438-c1c1bd3cd7e9 tempest-VolumesDeleteCascade-115765563 None] Acquiring lock "cinder-quobyte-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:44:41 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-763c4295-f345-44a9-b438-c1c1bd3cd7e9 tempest-VolumesDeleteCascade-115765563 None] Lock "cinder-quobyte-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3" acquired by "delete_snapshot" :: waited 0.012s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:44:41 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-763c4295-f345-44a9-b438-c1c1bd3cd7e9 tempest-VolumesDeleteCascade-115765563 None] Acquiring lock "cinder-quobyte-0db3dedf-50e6-46bd-b264-d77290266c8c" by "_delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:44:41 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-763c4295-f345-44a9-b438-c1c1bd3cd7e9 tempest-VolumesDeleteCascade-115765563 None] Lock "cinder-quobyte-0db3dedf-50e6-46bd-b264-d77290266c8c" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:44:41 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-763c4295-f345-44a9-b438-c1c1bd3cd7e9 tempest-VolumesDeleteCascade-115765563 None] Deleting offline snapshot 0db3dedf-50e6-46bd-b264-d77290266c8c of volume 0c1390ad-4062-4ec7-b4f3-b2cd5666ede3 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 10 12:44:41 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-763c4295-f345-44a9-b438-c1c1bd3cd7e9 tempest-VolumesDeleteCascade-115765563 None] snapshot_file for this snap is: volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3.0db3dedf-50e6-46bd-b264-d77290266c8c {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 10 12:44:41 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92da3a2-a061-4298-ad86-f45ef047fc2e]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:44:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-763c4295-f345-44a9-b438-c1c1bd3cd7e9 tempest-VolumesDeleteCascade-115765563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3.0db3dedf-50e6-46bd-b264-d77290266c8c {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:44:41 devstack sudo[95485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3.0db3dedf-50e6-46bd-b264-d77290266c8c
Jul 10 12:44:41 devstack sudo[95485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:44:42 devstack sudo[95485]: pam_unix(sudo:session): session closed for user root
Jul 10 12:44:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-763c4295-f345-44a9-b438-c1c1bd3cd7e9 tempest-VolumesDeleteCascade-115765563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3.0db3dedf-50e6-46bd-b264-d77290266c8c" returned: 0 in 0.782s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:44:42 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-763c4295-f345-44a9-b438-c1c1bd3cd7e9 tempest-VolumesDeleteCascade-115765563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:44:42 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa66b31-f603-45d5-8fab-1c1faab304ae]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:44:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-763c4295-f345-44a9-b438-c1c1bd3cd7e9 tempest-VolumesDeleteCascade-115765563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:44:42 devstack sudo[95490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3
Jul 10 12:44:42 devstack sudo[95490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:44:43 devstack sudo[95490]: pam_unix(sudo:session): session closed for user root
Jul 10 12:44:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-763c4295-f345-44a9-b438-c1c1bd3cd7e9 tempest-VolumesDeleteCascade-115765563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3" returned: 0 in 0.768s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:44:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-763c4295-f345-44a9-b438-c1c1bd3cd7e9 tempest-VolumesDeleteCascade-115765563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3.0db3dedf-50e6-46bd-b264-d77290266c8c {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:44:43 devstack sudo[95495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3.0db3dedf-50e6-46bd-b264-d77290266c8c
Jul 10 12:44:43 devstack sudo[95495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:44:44 devstack sudo[95495]: pam_unix(sudo:session): session closed for user root
Jul 10 12:44:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-763c4295-f345-44a9-b438-c1c1bd3cd7e9 tempest-VolumesDeleteCascade-115765563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3.0db3dedf-50e6-46bd-b264-d77290266c8c" returned: 0 in 0.733s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:44:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-763c4295-f345-44a9-b438-c1c1bd3cd7e9 tempest-VolumesDeleteCascade-115765563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3.0db3dedf-50e6-46bd-b264-d77290266c8c {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:44:44 devstack sudo[95501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3.0db3dedf-50e6-46bd-b264-d77290266c8c
Jul 10 12:44:44 devstack sudo[95501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:44:44 devstack sudo[95501]: pam_unix(sudo:session): session closed for user root
Jul 10 12:44:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-763c4295-f345-44a9-b438-c1c1bd3cd7e9 tempest-VolumesDeleteCascade-115765563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3.0db3dedf-50e6-46bd-b264-d77290266c8c" returned: 0 in 0.667s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:44:44 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-763c4295-f345-44a9-b438-c1c1bd3cd7e9 tempest-VolumesDeleteCascade-115765563 None] Lock "cinder-quobyte-0db3dedf-50e6-46bd-b264-d77290266c8c" released by "_delete_snapshot" :: held 3.040s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:44:44 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-763c4295-f345-44a9-b438-c1c1bd3cd7e9 tempest-VolumesDeleteCascade-115765563 None] Lock "cinder-quobyte-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3" released by "delete_snapshot" :: held 3.064s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:44:44 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-763c4295-f345-44a9-b438-c1c1bd3cd7e9 tempest-VolumesDeleteCascade-115765563 None] Created reservations ['270230f3-68c8-4ab5-98ae-f125202d7bb6', '5a39f316-465e-4df5-8a3d-3ae5e10c9395', '44eef0f9-6f47-4af4-bfb3-65fb1538ff08', '688ca2eb-254a-42f1-a90d-74871cfe08d2'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:44:44 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-763c4295-f345-44a9-b438-c1c1bd3cd7e9 tempest-VolumesDeleteCascade-115765563 None] Delete snapshot completed successfully.
Jul 10 12:44:44 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-763c4295-f345-44a9-b438-c1c1bd3cd7e9 tempest-VolumesDeleteCascade-115765563 None] Lock "cinder-0db3dedf-50e6-46bd-b264-d77290266c8c-delete_snapshot" released by "delete_snapshot" :: held 3.232s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:44:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-763c4295-f345-44a9-b438-c1c1bd3cd7e9 tempest-VolumesDeleteCascade-115765563 None] Snapshots deleted, issuing volume delete {{(pid=87378) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jul 10 12:44:44 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-763c4295-f345-44a9-b438-c1c1bd3cd7e9 tempest-VolumesDeleteCascade-115765563 None] Acquiring lock "cinder-quobyte-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:44:44 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-763c4295-f345-44a9-b438-c1c1bd3cd7e9 tempest-VolumesDeleteCascade-115765563 None] Lock "cinder-quobyte-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3" acquired by "delete_volume" :: waited 0.016s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:44:44 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1312c3-e1a8-4d5d-b9aa-d7bd2482bf13]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:44:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-763c4295-f345-44a9-b438-c1c1bd3cd7e9 tempest-VolumesDeleteCascade-115765563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:44:45 devstack sudo[95504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3
Jul 10 12:44:45 devstack sudo[95504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:44:45 devstack sudo[95504]: pam_unix(sudo:session): session closed for user root
Jul 10 12:44:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-763c4295-f345-44a9-b438-c1c1bd3cd7e9 tempest-VolumesDeleteCascade-115765563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3" returned: 0 in 0.955s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:44:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-763c4295-f345-44a9-b438-c1c1bd3cd7e9 tempest-VolumesDeleteCascade-115765563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:44:45 devstack sudo[95509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3
Jul 10 12:44:45 devstack sudo[95509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:44:46 devstack sudo[95509]: pam_unix(sudo:session): session closed for user root
Jul 10 12:44:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-763c4295-f345-44a9-b438-c1c1bd3cd7e9 tempest-VolumesDeleteCascade-115765563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3" returned: 0 in 0.786s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:44:46 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-763c4295-f345-44a9-b438-c1c1bd3cd7e9 tempest-VolumesDeleteCascade-115765563 None] Lock "cinder-quobyte-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3" released by "delete_volume" :: held 1.825s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:44:46 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-763c4295-f345-44a9-b438-c1c1bd3cd7e9 tempest-VolumesDeleteCascade-115765563 None] Created reservations ['5a17cc98-21a5-4a65-b844-9491b1549d1e', '028e90b2-ad30-40a9-8762-3008dbfe9da4', '55b47218-aea7-4733-abf3-9f201fac7523', '661a59b0-6315-462a-9aa0-1cf80b7cabac'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:44:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-763c4295-f345-44a9-b438-c1c1bd3cd7e9 tempest-VolumesDeleteCascade-115765563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:44:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-763c4295-f345-44a9-b438-c1c1bd3cd7e9 tempest-VolumesDeleteCascade-115765563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:44:46 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-763c4295-f345-44a9-b438-c1c1bd3cd7e9 tempest-VolumesDeleteCascade-115765563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:44:46 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-763c4295-f345-44a9-b438-c1c1bd3cd7e9 tempest-VolumesDeleteCascade-115765563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:44:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-763c4295-f345-44a9-b438-c1c1bd3cd7e9 tempest-VolumesDeleteCascade-115765563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:44:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-763c4295-f345-44a9-b438-c1c1bd3cd7e9 tempest-VolumesDeleteCascade-115765563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:44:46 devstack sudo[95535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:44:46 devstack sudo[95535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:44:47 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8870ca15-1849-490e-adbc-82e176e60238 tempest-VolumesDeleteCascade-115765563 None] Acquiring lock "cinder-50025f24-4b59-4892-ba6e-645d158f23c0-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:44:47 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8870ca15-1849-490e-adbc-82e176e60238 tempest-VolumesDeleteCascade-115765563 None] Lock "cinder-50025f24-4b59-4892-ba6e-645d158f23c0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:44:47 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8870ca15-1849-490e-adbc-82e176e60238 tempest-VolumesDeleteCascade-115765563 None] Acquiring lock "cinder-quobyte-50025f24-4b59-4892-ba6e-645d158f23c0" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:44:47 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8870ca15-1849-490e-adbc-82e176e60238 tempest-VolumesDeleteCascade-115765563 None] Lock "cinder-quobyte-50025f24-4b59-4892-ba6e-645d158f23c0" acquired by "delete_volume" :: waited 0.030s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:44:47 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33cdd7b-7e5f-4c40-afe7-93529cc4230b]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:44:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8870ca15-1849-490e-adbc-82e176e60238 tempest-VolumesDeleteCascade-115765563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-50025f24-4b59-4892-ba6e-645d158f23c0 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:44:47 devstack sudo[95547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-50025f24-4b59-4892-ba6e-645d158f23c0
Jul 10 12:44:47 devstack sudo[95547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:44:47 devstack sudo[95535]: pam_unix(sudo:session): session closed for user root
Jul 10 12:44:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-763c4295-f345-44a9-b438-c1c1bd3cd7e9 tempest-VolumesDeleteCascade-115765563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 1.033s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:44:47 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-763c4295-f345-44a9-b438-c1c1bd3cd7e9 tempest-VolumesDeleteCascade-115765563 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:44:47 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-763c4295-f345-44a9-b438-c1c1bd3cd7e9 tempest-VolumesDeleteCascade-115765563 None] Deleted volume successfully.
Jul 10 12:44:47 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-763c4295-f345-44a9-b438-c1c1bd3cd7e9 tempest-VolumesDeleteCascade-115765563 None] Lock "cinder-0c1390ad-4062-4ec7-b4f3-b2cd5666ede3-delete_volume" released by "delete_volume" :: held 6.341s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:44:48 devstack sudo[95547]: pam_unix(sudo:session): session closed for user root
Jul 10 12:44:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8870ca15-1849-490e-adbc-82e176e60238 tempest-VolumesDeleteCascade-115765563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-50025f24-4b59-4892-ba6e-645d158f23c0" returned: 0 in 0.999s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:44:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8870ca15-1849-490e-adbc-82e176e60238 tempest-VolumesDeleteCascade-115765563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-50025f24-4b59-4892-ba6e-645d158f23c0 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:44:48 devstack sudo[95555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-50025f24-4b59-4892-ba6e-645d158f23c0
Jul 10 12:44:48 devstack sudo[95555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:44:49 devstack sudo[95555]: pam_unix(sudo:session): session closed for user root
Jul 10 12:44:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8870ca15-1849-490e-adbc-82e176e60238 tempest-VolumesDeleteCascade-115765563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-50025f24-4b59-4892-ba6e-645d158f23c0" returned: 0 in 0.731s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:44:49 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8870ca15-1849-490e-adbc-82e176e60238 tempest-VolumesDeleteCascade-115765563 None] Lock "cinder-quobyte-50025f24-4b59-4892-ba6e-645d158f23c0" released by "delete_volume" :: held 1.809s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:44:49 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-8870ca15-1849-490e-adbc-82e176e60238 tempest-VolumesDeleteCascade-115765563 None] Created reservations ['2f9f605d-27ba-4e3d-9c53-e11d627f8d8d', '110dbdca-a920-45bf-b27b-8d3740a4972e', '3c57375e-2d4b-4515-80da-d06ad460ed65', '89bac03f-7553-4905-834f-ad373fa354da'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:44:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-8870ca15-1849-490e-adbc-82e176e60238 tempest-VolumesDeleteCascade-115765563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:44:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-8870ca15-1849-490e-adbc-82e176e60238 tempest-VolumesDeleteCascade-115765563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:44:49 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-8870ca15-1849-490e-adbc-82e176e60238 tempest-VolumesDeleteCascade-115765563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:44:49 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-8870ca15-1849-490e-adbc-82e176e60238 tempest-VolumesDeleteCascade-115765563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:44:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-8870ca15-1849-490e-adbc-82e176e60238 tempest-VolumesDeleteCascade-115765563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:44:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8870ca15-1849-490e-adbc-82e176e60238 tempest-VolumesDeleteCascade-115765563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:44:49 devstack sudo[95560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:44:49 devstack sudo[95560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:44:50 devstack sudo[95560]: pam_unix(sudo:session): session closed for user root
Jul 10 12:44:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8870ca15-1849-490e-adbc-82e176e60238 tempest-VolumesDeleteCascade-115765563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.751s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:44:50 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-8870ca15-1849-490e-adbc-82e176e60238 tempest-VolumesDeleteCascade-115765563 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:44:50 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-8870ca15-1849-490e-adbc-82e176e60238 tempest-VolumesDeleteCascade-115765563 None] Deleted volume successfully.
Jul 10 12:44:50 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8870ca15-1849-490e-adbc-82e176e60238 tempest-VolumesDeleteCascade-115765563 None] Lock "cinder-50025f24-4b59-4892-ba6e-645d158f23c0-delete_volume" released by "delete_volume" :: held 2.836s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:44:50 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1ca3647-b6bb-49a4-af94-466ec5c05767 tempest-AttachVolumeTestJSON-147786180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:44:50 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-b1ca3647-b6bb-49a4-af94-466ec5c05767 tempest-AttachVolumeTestJSON-147786180 None] Flow 'volume_create_manager' (508e846a-f898-4b10-80ca-afc727b1eea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:44:50 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-b1ca3647-b6bb-49a4-af94-466ec5c05767 tempest-AttachVolumeTestJSON-147786180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e32c9d20-08e8-4a27-b06d-a54ceb5e8bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:44:50 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-b1ca3647-b6bb-49a4-af94-466ec5c05767 tempest-AttachVolumeTestJSON-147786180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e32c9d20-08e8-4a27-b06d-a54ceb5e8bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1846724606',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc90a237-5ec8-4ba3-a6ae-8eec705926f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a10ae46bd4e462db6a43d01ae1754c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:44:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:44:50Z,use_quota=True,user_id='a40bbe2f79f54b509b2c9fa1400ea628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:44:50 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-b1ca3647-b6bb-49a4-af94-466ec5c05767 tempest-AttachVolumeTestJSON-147786180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30d63a17-6968-40c6-a537-904bd94fec0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:44:50 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-b1ca3647-b6bb-49a4-af94-466ec5c05767 tempest-AttachVolumeTestJSON-147786180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30d63a17-6968-40c6-a537-904bd94fec0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:44:50 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-b1ca3647-b6bb-49a4-af94-466ec5c05767 tempest-AttachVolumeTestJSON-147786180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a570dbae-457c-4cd9-926d-cba166583daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:44:50 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-b1ca3647-b6bb-49a4-af94-466ec5c05767 tempest-AttachVolumeTestJSON-147786180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a570dbae-457c-4cd9-926d-cba166583daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc90a237-5ec8-4ba3-a6ae-8eec705926f8', 'volume_name': 'volume-bc90a237-5ec8-4ba3-a6ae-8eec705926f8', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:44:50 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-b1ca3647-b6bb-49a4-af94-466ec5c05767 tempest-AttachVolumeTestJSON-147786180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfb61853-a3a7-4545-8565-e66a6eee1093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:44:50 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-b1ca3647-b6bb-49a4-af94-466ec5c05767 tempest-AttachVolumeTestJSON-147786180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfb61853-a3a7-4545-8565-e66a6eee1093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:44:50 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-b1ca3647-b6bb-49a4-af94-466ec5c05767 tempest-AttachVolumeTestJSON-147786180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c34858e-d75f-4d0f-9e70-237c84f76dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:44:50 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-b1ca3647-b6bb-49a4-af94-466ec5c05767 tempest-AttachVolumeTestJSON-147786180 None] Volume bc90a237-5ec8-4ba3-a6ae-8eec705926f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc90a237-5ec8-4ba3-a6ae-8eec705926f8', 'volume_size': 1}
Jul 10 12:44:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-b1ca3647-b6bb-49a4-af94-466ec5c05767 tempest-AttachVolumeTestJSON-147786180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:44:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-b1ca3647-b6bb-49a4-af94-466ec5c05767 tempest-AttachVolumeTestJSON-147786180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:44:50 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-b1ca3647-b6bb-49a4-af94-466ec5c05767 tempest-AttachVolumeTestJSON-147786180 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1846724606',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc90a237-5ec8-4ba3-a6ae-8eec705926f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a10ae46bd4e462db6a43d01ae1754c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:44:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:44:50Z,use_quota=True,user_id='a40bbe2f79f54b509b2c9fa1400ea628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:44:50 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-b1ca3647-b6bb-49a4-af94-466ec5c05767 tempest-AttachVolumeTestJSON-147786180 None] Creating volume bc90a237-5ec8-4ba3-a6ae-8eec705926f8 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:44:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-b1ca3647-b6bb-49a4-af94-466ec5c05767 tempest-AttachVolumeTestJSON-147786180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:44:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-b1ca3647-b6bb-49a4-af94-466ec5c05767 tempest-AttachVolumeTestJSON-147786180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:44:50 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-b1ca3647-b6bb-49a4-af94-466ec5c05767 tempest-AttachVolumeTestJSON-147786180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:44:50 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-b1ca3647-b6bb-49a4-af94-466ec5c05767 tempest-AttachVolumeTestJSON-147786180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:44:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-b1ca3647-b6bb-49a4-af94-466ec5c05767 tempest-AttachVolumeTestJSON-147786180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:44:50 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-b1ca3647-b6bb-49a4-af94-466ec5c05767 tempest-AttachVolumeTestJSON-147786180 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:44:50 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-b1ca3647-b6bb-49a4-af94-466ec5c05767 tempest-AttachVolumeTestJSON-147786180 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:44:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b1ca3647-b6bb-49a4-af94-466ec5c05767 tempest-AttachVolumeTestJSON-147786180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-bc90a237-5ec8-4ba3-a6ae-8eec705926f8 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:44:50 devstack sudo[95586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-bc90a237-5ec8-4ba3-a6ae-8eec705926f8 1073741824
Jul 10 12:44:50 devstack sudo[95586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:44:52 devstack sudo[95586]: pam_unix(sudo:session): session closed for user root
Jul 10 12:44:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b1ca3647-b6bb-49a4-af94-466ec5c05767 tempest-AttachVolumeTestJSON-147786180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-bc90a237-5ec8-4ba3-a6ae-8eec705926f8 1073741824" returned: 0 in 1.284s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:44:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b1ca3647-b6bb-49a4-af94-466ec5c05767 tempest-AttachVolumeTestJSON-147786180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-bc90a237-5ec8-4ba3-a6ae-8eec705926f8 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:44:52 devstack sudo[95642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-bc90a237-5ec8-4ba3-a6ae-8eec705926f8
Jul 10 12:44:52 devstack sudo[95642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:44:53 devstack sudo[95642]: pam_unix(sudo:session): session closed for user root
Jul 10 12:44:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b1ca3647-b6bb-49a4-af94-466ec5c05767 tempest-AttachVolumeTestJSON-147786180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-bc90a237-5ec8-4ba3-a6ae-8eec705926f8" returned: 0 in 1.101s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:44:53 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-b1ca3647-b6bb-49a4-af94-466ec5c05767 tempest-AttachVolumeTestJSON-147786180 None] <== create_volume: return (2499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:44:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-b1ca3647-b6bb-49a4-af94-466ec5c05767 tempest-AttachVolumeTestJSON-147786180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.502s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:44:53 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-b1ca3647-b6bb-49a4-af94-466ec5c05767 tempest-AttachVolumeTestJSON-147786180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c34858e-d75f-4d0f-9e70-237c84f76dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc90a237-5ec8-4ba3-a6ae-8eec705926f8', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:44:53 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-b1ca3647-b6bb-49a4-af94-466ec5c05767 tempest-AttachVolumeTestJSON-147786180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab526d76-8f34-4b65-9f29-9dcdfe555dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:44:53 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-b1ca3647-b6bb-49a4-af94-466ec5c05767 tempest-AttachVolumeTestJSON-147786180 None] Volume volume-bc90a237-5ec8-4ba3-a6ae-8eec705926f8 (bc90a237-5ec8-4ba3-a6ae-8eec705926f8): created successfully
Jul 10 12:44:53 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-b1ca3647-b6bb-49a4-af94-466ec5c05767 tempest-AttachVolumeTestJSON-147786180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab526d76-8f34-4b65-9f29-9dcdfe555dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:44:53 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-b1ca3647-b6bb-49a4-af94-466ec5c05767 tempest-AttachVolumeTestJSON-147786180 None] Flow 'volume_create_manager' (508e846a-f898-4b10-80ca-afc727b1eea7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:44:53 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-b1ca3647-b6bb-49a4-af94-466ec5c05767 tempest-AttachVolumeTestJSON-147786180 None] Created volume successfully.
Jul 10 12:44:55 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-37fb6224-d9e3-4cb2-a1b0-ea83ea101121 tempest-VolumesActionsTest-1987453551 None] Acquiring lock "cinder-1224ba53-385c-414b-9176-9508e8815da8" by "attach_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:44:55 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-37fb6224-d9e3-4cb2-a1b0-ea83ea101121 tempest-VolumesActionsTest-1987453551 None] Lock "cinder-1224ba53-385c-414b-9176-9508e8815da8" acquired by "attach_volume" :: waited 0.023s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:44:55 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-37fb6224-d9e3-4cb2-a1b0-ea83ea101121 tempest-VolumesActionsTest-1987453551 None] Attaching volume 1224ba53-385c-414b-9176-9508e8815da8 to instance 4ce7cbff-a950-49fd-b2a8-ea66dbba9733 at mountpoint /dev/vdb on host None.
Jul 10 12:44:55 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-37fb6224-d9e3-4cb2-a1b0-ea83ea101121 tempest-VolumesActionsTest-1987453551 None] Attach volume completed successfully.
Jul 10 12:44:55 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-37fb6224-d9e3-4cb2-a1b0-ea83ea101121 tempest-VolumesActionsTest-1987453551 None] Lock "cinder-1224ba53-385c-414b-9176-9508e8815da8" released by "attach_volume" :: held 0.131s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:44:56 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-cd456d68-da67-48a1-a184-4761ed0381fd tempest-VolumesActionsTest-1987453551 None] Acquiring lock "cinder-1224ba53-385c-414b-9176-9508e8815da8-detach_volume" by "detach_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:44:56 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-cd456d68-da67-48a1-a184-4761ed0381fd tempest-VolumesActionsTest-1987453551 None] Lock "cinder-1224ba53-385c-414b-9176-9508e8815da8-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:44:56 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-cd456d68-da67-48a1-a184-4761ed0381fd tempest-VolumesActionsTest-1987453551 None] Detaching volume 1224ba53-385c-414b-9176-9508e8815da8 from instance 4ce7cbff-a950-49fd-b2a8-ea66dbba9733.
Jul 10 12:44:56 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-6146e6bf-7b18-4db7-90ac-e97f0a46154d tempest-VolumesTransfersV357Test-1301279955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:44:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6146e6bf-7b18-4db7-90ac-e97f0a46154d tempest-VolumesTransfersV357Test-1301279955 None] Flow 'volume_create_manager' (a3f2958b-3ac9-405a-bffb-39235e0a8318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:44:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6146e6bf-7b18-4db7-90ac-e97f0a46154d tempest-VolumesTransfersV357Test-1301279955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39930dc9-aae7-44ab-aee9-6674d9e3afb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:44:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6146e6bf-7b18-4db7-90ac-e97f0a46154d tempest-VolumesTransfersV357Test-1301279955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39930dc9-aae7-44ab-aee9-6674d9e3afb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-339643262',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e562c0c-07b2-4bde-b147-b0cb95e99c30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cb4e2a7bb2047be87744cd8bdde430a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:44:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:44:57Z,use_quota=True,user_id='d3f556fd41514f7cb684dff392de49eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:44:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6146e6bf-7b18-4db7-90ac-e97f0a46154d tempest-VolumesTransfersV357Test-1301279955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (567bad06-0944-4f0e-a356-6fea551b22f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:44:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6146e6bf-7b18-4db7-90ac-e97f0a46154d tempest-VolumesTransfersV357Test-1301279955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (567bad06-0944-4f0e-a356-6fea551b22f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:44:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6146e6bf-7b18-4db7-90ac-e97f0a46154d tempest-VolumesTransfersV357Test-1301279955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6f524e7-648e-4381-b8eb-e6a9f19e422c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:44:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6146e6bf-7b18-4db7-90ac-e97f0a46154d tempest-VolumesTransfersV357Test-1301279955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6f524e7-648e-4381-b8eb-e6a9f19e422c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e562c0c-07b2-4bde-b147-b0cb95e99c30', 'volume_name': 'volume-7e562c0c-07b2-4bde-b147-b0cb95e99c30', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:44:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6146e6bf-7b18-4db7-90ac-e97f0a46154d tempest-VolumesTransfersV357Test-1301279955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f515b61b-e9f0-4d08-8c68-8673750f9804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:44:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6146e6bf-7b18-4db7-90ac-e97f0a46154d tempest-VolumesTransfersV357Test-1301279955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f515b61b-e9f0-4d08-8c68-8673750f9804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:44:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6146e6bf-7b18-4db7-90ac-e97f0a46154d tempest-VolumesTransfersV357Test-1301279955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a04a674-8763-4d1d-bf5e-a59e44c0b540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:44:56 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-6146e6bf-7b18-4db7-90ac-e97f0a46154d tempest-VolumesTransfersV357Test-1301279955 None] Volume 7e562c0c-07b2-4bde-b147-b0cb95e99c30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e562c0c-07b2-4bde-b147-b0cb95e99c30', 'volume_size': 1}
Jul 10 12:44:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-6146e6bf-7b18-4db7-90ac-e97f0a46154d tempest-VolumesTransfersV357Test-1301279955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:44:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-6146e6bf-7b18-4db7-90ac-e97f0a46154d tempest-VolumesTransfersV357Test-1301279955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:44:56 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-6146e6bf-7b18-4db7-90ac-e97f0a46154d tempest-VolumesTransfersV357Test-1301279955 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-339643262',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e562c0c-07b2-4bde-b147-b0cb95e99c30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cb4e2a7bb2047be87744cd8bdde430a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:44:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:44:57Z,use_quota=True,user_id='d3f556fd41514f7cb684dff392de49eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:44:56 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-6146e6bf-7b18-4db7-90ac-e97f0a46154d tempest-VolumesTransfersV357Test-1301279955 None] Creating volume 7e562c0c-07b2-4bde-b147-b0cb95e99c30 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:44:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-6146e6bf-7b18-4db7-90ac-e97f0a46154d tempest-VolumesTransfersV357Test-1301279955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:44:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-6146e6bf-7b18-4db7-90ac-e97f0a46154d tempest-VolumesTransfersV357Test-1301279955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:44:56 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-6146e6bf-7b18-4db7-90ac-e97f0a46154d tempest-VolumesTransfersV357Test-1301279955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:44:56 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-6146e6bf-7b18-4db7-90ac-e97f0a46154d tempest-VolumesTransfersV357Test-1301279955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:44:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-6146e6bf-7b18-4db7-90ac-e97f0a46154d tempest-VolumesTransfersV357Test-1301279955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:44:56 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-6146e6bf-7b18-4db7-90ac-e97f0a46154d tempest-VolumesTransfersV357Test-1301279955 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:44:56 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-6146e6bf-7b18-4db7-90ac-e97f0a46154d tempest-VolumesTransfersV357Test-1301279955 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:44:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6146e6bf-7b18-4db7-90ac-e97f0a46154d tempest-VolumesTransfersV357Test-1301279955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-7e562c0c-07b2-4bde-b147-b0cb95e99c30 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:44:56 devstack sudo[95675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-7e562c0c-07b2-4bde-b147-b0cb95e99c30 1073741824
Jul 10 12:44:56 devstack sudo[95675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:44:56 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-cd456d68-da67-48a1-a184-4761ed0381fd tempest-VolumesActionsTest-1987453551 None] Detach volume completed successfully.
Jul 10 12:44:56 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-cd456d68-da67-48a1-a184-4761ed0381fd tempest-VolumesActionsTest-1987453551 None] Lock "cinder-1224ba53-385c-414b-9176-9508e8815da8-detach_volume" released by "detach_volume" :: held 0.188s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:44:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-97ed409b-67f3-412b-85f3-afd03a3ef5c1 req-d1248491-540c-4630-9c89-3479c2537453 tempest-AttachVolumeTestJSON-147786180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:44:57 devstack sudo[95675]: pam_unix(sudo:session): session closed for user root
Jul 10 12:44:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6146e6bf-7b18-4db7-90ac-e97f0a46154d tempest-VolumesTransfersV357Test-1301279955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-7e562c0c-07b2-4bde-b147-b0cb95e99c30 1073741824" returned: 0 in 1.111s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:44:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6146e6bf-7b18-4db7-90ac-e97f0a46154d tempest-VolumesTransfersV357Test-1301279955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-7e562c0c-07b2-4bde-b147-b0cb95e99c30 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:44:58 devstack sudo[95690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-7e562c0c-07b2-4bde-b147-b0cb95e99c30
Jul 10 12:44:58 devstack sudo[95690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:44:58 devstack sudo[95690]: pam_unix(sudo:session): session closed for user root
Jul 10 12:44:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6146e6bf-7b18-4db7-90ac-e97f0a46154d tempest-VolumesTransfersV357Test-1301279955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-7e562c0c-07b2-4bde-b147-b0cb95e99c30" returned: 0 in 0.717s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:44:58 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-6146e6bf-7b18-4db7-90ac-e97f0a46154d tempest-VolumesTransfersV357Test-1301279955 None] <== create_volume: return (1893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:44:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-6146e6bf-7b18-4db7-90ac-e97f0a46154d tempest-VolumesTransfersV357Test-1301279955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.898s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:44:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-97ed409b-67f3-412b-85f3-afd03a3ef5c1 req-d1248491-540c-4630-9c89-3479c2537453 tempest-AttachVolumeTestJSON-147786180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.983s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:44:58 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6146e6bf-7b18-4db7-90ac-e97f0a46154d tempest-VolumesTransfersV357Test-1301279955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a04a674-8763-4d1d-bf5e-a59e44c0b540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e562c0c-07b2-4bde-b147-b0cb95e99c30', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:44:58 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6146e6bf-7b18-4db7-90ac-e97f0a46154d tempest-VolumesTransfersV357Test-1301279955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bc67d40-7afa-4029-bebd-4e5e6764d200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:44:58 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[40bf86c0-cfb4-4ffb-90d7-a49f8b19a1b4]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:44:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-97ed409b-67f3-412b-85f3-afd03a3ef5c1 req-d1248491-540c-4630-9c89-3479c2537453 tempest-AttachVolumeTestJSON-147786180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-bc90a237-5ec8-4ba3-a6ae-8eec705926f8 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:44:58 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-6146e6bf-7b18-4db7-90ac-e97f0a46154d tempest-VolumesTransfersV357Test-1301279955 None] Volume volume-7e562c0c-07b2-4bde-b147-b0cb95e99c30 (7e562c0c-07b2-4bde-b147-b0cb95e99c30): created successfully
Jul 10 12:44:58 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6146e6bf-7b18-4db7-90ac-e97f0a46154d tempest-VolumesTransfersV357Test-1301279955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bc67d40-7afa-4029-bebd-4e5e6764d200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:44:58 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6146e6bf-7b18-4db7-90ac-e97f0a46154d tempest-VolumesTransfersV357Test-1301279955 None] Flow 'volume_create_manager' (a3f2958b-3ac9-405a-bffb-39235e0a8318) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:44:58 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-6146e6bf-7b18-4db7-90ac-e97f0a46154d tempest-VolumesTransfersV357Test-1301279955 None] Created volume successfully.
Jul 10 12:44:58 devstack sudo[95698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-bc90a237-5ec8-4ba3-a6ae-8eec705926f8
Jul 10 12:44:58 devstack sudo[95698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:44:59 devstack sudo[95698]: pam_unix(sudo:session): session closed for user root
Jul 10 12:44:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-97ed409b-67f3-412b-85f3-afd03a3ef5c1 req-d1248491-540c-4630-9c89-3479c2537453 tempest-AttachVolumeTestJSON-147786180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-bc90a237-5ec8-4ba3-a6ae-8eec705926f8" returned: 0 in 0.898s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:44:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-97ed409b-67f3-412b-85f3-afd03a3ef5c1 req-d1248491-540c-4630-9c89-3479c2537453 tempest-AttachVolumeTestJSON-147786180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.937s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:44:59 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-97ed409b-67f3-412b-85f3-afd03a3ef5c1 req-d1248491-540c-4630-9c89-3479c2537453 tempest-AttachVolumeTestJSON-147786180 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be', 'name': 'volume-bc90a237-5ec8-4ba3-a6ae-8eec705926f8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '651fbe08-15e0-4e83-a5c9-7b9f479d5fc6', 'enforce_multipath': True} {{(pid=87378) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 10 12:44:59 devstack cinder-volume[87378]: INFO cinder.volume.manager [req-97ed409b-67f3-412b-85f3-afd03a3ef5c1 req-d1248491-540c-4630-9c89-3479c2537453 tempest-AttachVolumeTestJSON-147786180 None] attachment_update completed successfully.
Jul 10 12:45:00 devstack cinder-volume[87378]: INFO cinder.volume.manager [req-b62e7632-2e6c-4611-8076-f10482530104 req-f2068ecd-b63d-4395-b9d8-cd5b93c62b63 tempest-AttachVolumeNegativeTest-2056769334 None] Terminate volume connection completed successfully.
Jul 10 12:45:00 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-b62e7632-2e6c-4611-8076-f10482530104 req-f2068ecd-b63d-4395-b9d8-cd5b93c62b63 tempest-AttachVolumeNegativeTest-2056769334 None] Deleting attachment 12e1ba29-5464-44f3-9451-3c9f99f3b529. {{(pid=87378) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 10 12:45:00 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-987e2c50-e748-4f07-a383-ccd53b982a38 tempest-VolumesTransfersV357Test-1786552746 None] Transfer volume completed successfully.
Jul 10 12:45:01 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b9239e65-8dc5-4759-829f-60a1d85da49f tempest-VolumesTransfersV357Test-822839962 None] Acquiring lock "cinder-7e562c0c-07b2-4bde-b147-b0cb95e99c30-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:45:01 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b9239e65-8dc5-4759-829f-60a1d85da49f tempest-VolumesTransfersV357Test-822839962 None] Lock "cinder-7e562c0c-07b2-4bde-b147-b0cb95e99c30-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:45:01 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b9239e65-8dc5-4759-829f-60a1d85da49f tempest-VolumesTransfersV357Test-822839962 None] Acquiring lock "cinder-quobyte-7e562c0c-07b2-4bde-b147-b0cb95e99c30" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:45:01 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b9239e65-8dc5-4759-829f-60a1d85da49f tempest-VolumesTransfersV357Test-822839962 None] Lock "cinder-quobyte-7e562c0c-07b2-4bde-b147-b0cb95e99c30" acquired by "delete_volume" :: waited 0.015s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:45:01 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab312aa8-8599-45fc-b9a7-a240ca8c5461]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:45:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b9239e65-8dc5-4759-829f-60a1d85da49f tempest-VolumesTransfersV357Test-822839962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-7e562c0c-07b2-4bde-b147-b0cb95e99c30 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:45:01 devstack sudo[96111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-7e562c0c-07b2-4bde-b147-b0cb95e99c30
Jul 10 12:45:01 devstack sudo[96111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:45:02 devstack sudo[96111]: pam_unix(sudo:session): session closed for user root
Jul 10 12:45:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b9239e65-8dc5-4759-829f-60a1d85da49f tempest-VolumesTransfersV357Test-822839962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-7e562c0c-07b2-4bde-b147-b0cb95e99c30" returned: 0 in 0.822s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:45:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b9239e65-8dc5-4759-829f-60a1d85da49f tempest-VolumesTransfersV357Test-822839962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-7e562c0c-07b2-4bde-b147-b0cb95e99c30 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:45:02 devstack sudo[96117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-7e562c0c-07b2-4bde-b147-b0cb95e99c30
Jul 10 12:45:02 devstack sudo[96117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:45:03 devstack sudo[96117]: pam_unix(sudo:session): session closed for user root
Jul 10 12:45:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b9239e65-8dc5-4759-829f-60a1d85da49f tempest-VolumesTransfersV357Test-822839962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-7e562c0c-07b2-4bde-b147-b0cb95e99c30" returned: 0 in 0.662s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:45:03 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b9239e65-8dc5-4759-829f-60a1d85da49f tempest-VolumesTransfersV357Test-822839962 None] Lock "cinder-quobyte-7e562c0c-07b2-4bde-b147-b0cb95e99c30" released by "delete_volume" :: held 1.530s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:45:03 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-b9239e65-8dc5-4759-829f-60a1d85da49f tempest-VolumesTransfersV357Test-822839962 None] Created reservations ['1b0d6014-bf19-43f1-841e-240398656ac0', 'a8a73e57-fa1f-42c8-b641-bc8e99bc85f3', '2e15908b-ca1c-4222-8e5e-bfe59391f35b', '124986a9-7d3a-443c-8501-1ce130774e70'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:45:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-b9239e65-8dc5-4759-829f-60a1d85da49f tempest-VolumesTransfersV357Test-822839962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:45:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-b9239e65-8dc5-4759-829f-60a1d85da49f tempest-VolumesTransfersV357Test-822839962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:45:03 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-b9239e65-8dc5-4759-829f-60a1d85da49f tempest-VolumesTransfersV357Test-822839962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:45:03 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-b9239e65-8dc5-4759-829f-60a1d85da49f tempest-VolumesTransfersV357Test-822839962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:45:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-b9239e65-8dc5-4759-829f-60a1d85da49f tempest-VolumesTransfersV357Test-822839962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:45:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b9239e65-8dc5-4759-829f-60a1d85da49f tempest-VolumesTransfersV357Test-822839962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:45:03 devstack sudo[96122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:45:03 devstack sudo[96122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:45:04 devstack sudo[96122]: pam_unix(sudo:session): session closed for user root
Jul 10 12:45:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b9239e65-8dc5-4759-829f-60a1d85da49f tempest-VolumesTransfersV357Test-822839962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.719s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:45:04 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-b9239e65-8dc5-4759-829f-60a1d85da49f tempest-VolumesTransfersV357Test-822839962 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:45:04 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-b9239e65-8dc5-4759-829f-60a1d85da49f tempest-VolumesTransfersV357Test-822839962 None] Deleted volume successfully.
Jul 10 12:45:04 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b9239e65-8dc5-4759-829f-60a1d85da49f tempest-VolumesTransfersV357Test-822839962 None] Lock "cinder-7e562c0c-07b2-4bde-b147-b0cb95e99c30-delete_volume" released by "delete_volume" :: held 2.476s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:45:04 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ce808fd-cffb-4bc8-b8b5-0cc47dc9cbc2 tempest-VolumesTransfersV357Test-1301279955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:45:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0ce808fd-cffb-4bc8-b8b5-0cc47dc9cbc2 tempest-VolumesTransfersV357Test-1301279955 None] Flow 'volume_create_manager' (dcb2d4d7-1b6b-4331-b64e-a95a5eb93181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:45:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0ce808fd-cffb-4bc8-b8b5-0cc47dc9cbc2 tempest-VolumesTransfersV357Test-1301279955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ef1fc6a-5a02-4255-870a-10336013ea70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:45:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0ce808fd-cffb-4bc8-b8b5-0cc47dc9cbc2 tempest-VolumesTransfersV357Test-1301279955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ef1fc6a-5a02-4255-870a-10336013ea70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1300519557',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61a88ea3-8f10-4703-8764-b2a2594b470b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cb4e2a7bb2047be87744cd8bdde430a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:45:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:45:04Z,use_quota=True,user_id='d3f556fd41514f7cb684dff392de49eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:45:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0ce808fd-cffb-4bc8-b8b5-0cc47dc9cbc2 tempest-VolumesTransfersV357Test-1301279955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a29cfac6-63a7-45d5-95c8-535704ddee13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:45:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0ce808fd-cffb-4bc8-b8b5-0cc47dc9cbc2 tempest-VolumesTransfersV357Test-1301279955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a29cfac6-63a7-45d5-95c8-535704ddee13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:45:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0ce808fd-cffb-4bc8-b8b5-0cc47dc9cbc2 tempest-VolumesTransfersV357Test-1301279955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78101db8-f966-4a46-aa56-9c1558778d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:45:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0ce808fd-cffb-4bc8-b8b5-0cc47dc9cbc2 tempest-VolumesTransfersV357Test-1301279955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78101db8-f966-4a46-aa56-9c1558778d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61a88ea3-8f10-4703-8764-b2a2594b470b', 'volume_name': 'volume-61a88ea3-8f10-4703-8764-b2a2594b470b', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:45:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0ce808fd-cffb-4bc8-b8b5-0cc47dc9cbc2 tempest-VolumesTransfersV357Test-1301279955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7a31cff-2829-4ea4-a29e-f2ee08830eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:45:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0ce808fd-cffb-4bc8-b8b5-0cc47dc9cbc2 tempest-VolumesTransfersV357Test-1301279955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7a31cff-2829-4ea4-a29e-f2ee08830eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:45:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0ce808fd-cffb-4bc8-b8b5-0cc47dc9cbc2 tempest-VolumesTransfersV357Test-1301279955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7b2d338-c716-44d7-a1b7-67e011509231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:45:04 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-0ce808fd-cffb-4bc8-b8b5-0cc47dc9cbc2 tempest-VolumesTransfersV357Test-1301279955 None] Volume 61a88ea3-8f10-4703-8764-b2a2594b470b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61a88ea3-8f10-4703-8764-b2a2594b470b', 'volume_size': 1}
Jul 10 12:45:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0ce808fd-cffb-4bc8-b8b5-0cc47dc9cbc2 tempest-VolumesTransfersV357Test-1301279955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:45:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0ce808fd-cffb-4bc8-b8b5-0cc47dc9cbc2 tempest-VolumesTransfersV357Test-1301279955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:45:04 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-0ce808fd-cffb-4bc8-b8b5-0cc47dc9cbc2 tempest-VolumesTransfersV357Test-1301279955 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1300519557',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61a88ea3-8f10-4703-8764-b2a2594b470b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cb4e2a7bb2047be87744cd8bdde430a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:45:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:45:04Z,use_quota=True,user_id='d3f556fd41514f7cb684dff392de49eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:45:04 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-0ce808fd-cffb-4bc8-b8b5-0cc47dc9cbc2 tempest-VolumesTransfersV357Test-1301279955 None] Creating volume 61a88ea3-8f10-4703-8764-b2a2594b470b {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:45:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0ce808fd-cffb-4bc8-b8b5-0cc47dc9cbc2 tempest-VolumesTransfersV357Test-1301279955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:45:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0ce808fd-cffb-4bc8-b8b5-0cc47dc9cbc2 tempest-VolumesTransfersV357Test-1301279955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:45:04 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-0ce808fd-cffb-4bc8-b8b5-0cc47dc9cbc2 tempest-VolumesTransfersV357Test-1301279955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:45:04 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-0ce808fd-cffb-4bc8-b8b5-0cc47dc9cbc2 tempest-VolumesTransfersV357Test-1301279955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:45:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0ce808fd-cffb-4bc8-b8b5-0cc47dc9cbc2 tempest-VolumesTransfersV357Test-1301279955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:45:04 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-0ce808fd-cffb-4bc8-b8b5-0cc47dc9cbc2 tempest-VolumesTransfersV357Test-1301279955 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:45:04 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-0ce808fd-cffb-4bc8-b8b5-0cc47dc9cbc2 tempest-VolumesTransfersV357Test-1301279955 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:45:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0ce808fd-cffb-4bc8-b8b5-0cc47dc9cbc2 tempest-VolumesTransfersV357Test-1301279955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-61a88ea3-8f10-4703-8764-b2a2594b470b 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:45:04 devstack sudo[96145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-61a88ea3-8f10-4703-8764-b2a2594b470b 1073741824
Jul 10 12:45:04 devstack sudo[96145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:45:05 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-123cbfc0-ce9a-4862-bdc9-2f5d262f3c98 tempest-AttachVolumeTestJSON-147786180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:45:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-123cbfc0-ce9a-4862-bdc9-2f5d262f3c98 tempest-AttachVolumeTestJSON-147786180 None] Flow 'volume_create_manager' (c9b476af-39ac-4dfd-8638-f58f3c3fa8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:45:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-123cbfc0-ce9a-4862-bdc9-2f5d262f3c98 tempest-AttachVolumeTestJSON-147786180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3627b592-c126-44ed-bd0a-045d0a3b72fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:45:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-123cbfc0-ce9a-4862-bdc9-2f5d262f3c98 tempest-AttachVolumeTestJSON-147786180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3627b592-c126-44ed-bd0a-045d0a3b72fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:45:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1795426281',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b45f049-05c4-46a9-bfc1-dd15841f8e30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a10ae46bd4e462db6a43d01ae1754c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:45:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:45:06Z,use_quota=True,user_id='a40bbe2f79f54b509b2c9fa1400ea628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:45:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-123cbfc0-ce9a-4862-bdc9-2f5d262f3c98 tempest-AttachVolumeTestJSON-147786180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (725c7431-ec70-4b94-8e64-0fde89d2f199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:45:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-123cbfc0-ce9a-4862-bdc9-2f5d262f3c98 tempest-AttachVolumeTestJSON-147786180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (725c7431-ec70-4b94-8e64-0fde89d2f199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:45:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-123cbfc0-ce9a-4862-bdc9-2f5d262f3c98 tempest-AttachVolumeTestJSON-147786180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39106de9-1ae6-4048-ad4b-fdd2f76341ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:45:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-123cbfc0-ce9a-4862-bdc9-2f5d262f3c98 tempest-AttachVolumeTestJSON-147786180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39106de9-1ae6-4048-ad4b-fdd2f76341ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b45f049-05c4-46a9-bfc1-dd15841f8e30', 'volume_name': 'volume-9b45f049-05c4-46a9-bfc1-dd15841f8e30', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:45:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-123cbfc0-ce9a-4862-bdc9-2f5d262f3c98 tempest-AttachVolumeTestJSON-147786180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b97d172-1e54-405a-ba1d-74340f3e6f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:45:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-123cbfc0-ce9a-4862-bdc9-2f5d262f3c98 tempest-AttachVolumeTestJSON-147786180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b97d172-1e54-405a-ba1d-74340f3e6f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:45:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-123cbfc0-ce9a-4862-bdc9-2f5d262f3c98 tempest-AttachVolumeTestJSON-147786180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f694b513-c69d-4ded-90ae-7578b333293c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:45:05 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-123cbfc0-ce9a-4862-bdc9-2f5d262f3c98 tempest-AttachVolumeTestJSON-147786180 None] Volume 9b45f049-05c4-46a9-bfc1-dd15841f8e30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b45f049-05c4-46a9-bfc1-dd15841f8e30', 'volume_size': 1}
Jul 10 12:45:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-123cbfc0-ce9a-4862-bdc9-2f5d262f3c98 tempest-AttachVolumeTestJSON-147786180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:45:05 devstack sudo[96145]: pam_unix(sudo:session): session closed for user root
Jul 10 12:45:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0ce808fd-cffb-4bc8-b8b5-0cc47dc9cbc2 tempest-VolumesTransfersV357Test-1301279955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-61a88ea3-8f10-4703-8764-b2a2594b470b 1073741824" returned: 0 in 1.298s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:45:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0ce808fd-cffb-4bc8-b8b5-0cc47dc9cbc2 tempest-VolumesTransfersV357Test-1301279955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-61a88ea3-8f10-4703-8764-b2a2594b470b {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:45:06 devstack sudo[96154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-61a88ea3-8f10-4703-8764-b2a2594b470b
Jul 10 12:45:06 devstack sudo[96154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:45:06 devstack sudo[96154]: pam_unix(sudo:session): session closed for user root
Jul 10 12:45:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0ce808fd-cffb-4bc8-b8b5-0cc47dc9cbc2 tempest-VolumesTransfersV357Test-1301279955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-61a88ea3-8f10-4703-8764-b2a2594b470b" returned: 0 in 0.696s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:45:06 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-0ce808fd-cffb-4bc8-b8b5-0cc47dc9cbc2 tempest-VolumesTransfersV357Test-1301279955 None] <== create_volume: return (2082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:45:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0ce808fd-cffb-4bc8-b8b5-0cc47dc9cbc2 tempest-VolumesTransfersV357Test-1301279955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.086s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:45:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-123cbfc0-ce9a-4862-bdc9-2f5d262f3c98 tempest-AttachVolumeTestJSON-147786180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.809s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:45:06 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-123cbfc0-ce9a-4862-bdc9-2f5d262f3c98 tempest-AttachVolumeTestJSON-147786180 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:45:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1795426281',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b45f049-05c4-46a9-bfc1-dd15841f8e30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a10ae46bd4e462db6a43d01ae1754c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:45:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:45:06Z,use_quota=True,user_id='a40bbe2f79f54b509b2c9fa1400ea628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:45:06 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-123cbfc0-ce9a-4862-bdc9-2f5d262f3c98 tempest-AttachVolumeTestJSON-147786180 None] Creating volume 9b45f049-05c4-46a9-bfc1-dd15841f8e30 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:45:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-123cbfc0-ce9a-4862-bdc9-2f5d262f3c98 tempest-AttachVolumeTestJSON-147786180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:45:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-123cbfc0-ce9a-4862-bdc9-2f5d262f3c98 tempest-AttachVolumeTestJSON-147786180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:45:06 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-123cbfc0-ce9a-4862-bdc9-2f5d262f3c98 tempest-AttachVolumeTestJSON-147786180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:45:06 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-123cbfc0-ce9a-4862-bdc9-2f5d262f3c98 tempest-AttachVolumeTestJSON-147786180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:45:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-123cbfc0-ce9a-4862-bdc9-2f5d262f3c98 tempest-AttachVolumeTestJSON-147786180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:45:06 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-123cbfc0-ce9a-4862-bdc9-2f5d262f3c98 tempest-AttachVolumeTestJSON-147786180 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:45:06 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-123cbfc0-ce9a-4862-bdc9-2f5d262f3c98 tempest-AttachVolumeTestJSON-147786180 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:45:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-123cbfc0-ce9a-4862-bdc9-2f5d262f3c98 tempest-AttachVolumeTestJSON-147786180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9b45f049-05c4-46a9-bfc1-dd15841f8e30 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:45:06 devstack sudo[96157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9b45f049-05c4-46a9-bfc1-dd15841f8e30 1073741824
Jul 10 12:45:06 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0ce808fd-cffb-4bc8-b8b5-0cc47dc9cbc2 tempest-VolumesTransfersV357Test-1301279955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7b2d338-c716-44d7-a1b7-67e011509231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61a88ea3-8f10-4703-8764-b2a2594b470b', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:45:06 devstack sudo[96157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:45:06 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0ce808fd-cffb-4bc8-b8b5-0cc47dc9cbc2 tempest-VolumesTransfersV357Test-1301279955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3db25283-b8cc-4bea-b328-bacfa015c25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:45:06 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-0ce808fd-cffb-4bc8-b8b5-0cc47dc9cbc2 tempest-VolumesTransfersV357Test-1301279955 None] Volume volume-61a88ea3-8f10-4703-8764-b2a2594b470b (61a88ea3-8f10-4703-8764-b2a2594b470b): created successfully
Jul 10 12:45:06 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0ce808fd-cffb-4bc8-b8b5-0cc47dc9cbc2 tempest-VolumesTransfersV357Test-1301279955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3db25283-b8cc-4bea-b328-bacfa015c25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:45:06 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0ce808fd-cffb-4bc8-b8b5-0cc47dc9cbc2 tempest-VolumesTransfersV357Test-1301279955 None] Flow 'volume_create_manager' (dcb2d4d7-1b6b-4331-b64e-a95a5eb93181) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:45:06 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-0ce808fd-cffb-4bc8-b8b5-0cc47dc9cbc2 tempest-VolumesTransfersV357Test-1301279955 None] Created volume successfully.
Jul 10 12:45:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-597d97a6-cf3c-4d9b-9f4b-cccd02d12b97 tempest-VolumesActionsTest-1987453551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:45:07 devstack sudo[96157]: pam_unix(sudo:session): session closed for user root
Jul 10 12:45:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-123cbfc0-ce9a-4862-bdc9-2f5d262f3c98 tempest-AttachVolumeTestJSON-147786180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9b45f049-05c4-46a9-bfc1-dd15841f8e30 1073741824" returned: 0 in 0.828s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:45:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-123cbfc0-ce9a-4862-bdc9-2f5d262f3c98 tempest-AttachVolumeTestJSON-147786180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9b45f049-05c4-46a9-bfc1-dd15841f8e30 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:45:07 devstack sudo[96162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9b45f049-05c4-46a9-bfc1-dd15841f8e30
Jul 10 12:45:07 devstack sudo[96162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:45:08 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-aa62aebd-baea-4ca6-bd9c-d9f96fd3f62c tempest-VolumesTransfersV357Test-822839962 None] Acquiring lock "cinder-61a88ea3-8f10-4703-8764-b2a2594b470b-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:45:08 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-aa62aebd-baea-4ca6-bd9c-d9f96fd3f62c tempest-VolumesTransfersV357Test-822839962 None] Lock "cinder-61a88ea3-8f10-4703-8764-b2a2594b470b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:45:08 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-aa62aebd-baea-4ca6-bd9c-d9f96fd3f62c tempest-VolumesTransfersV357Test-822839962 None] Acquiring lock "cinder-quobyte-61a88ea3-8f10-4703-8764-b2a2594b470b" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:45:08 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-aa62aebd-baea-4ca6-bd9c-d9f96fd3f62c tempest-VolumesTransfersV357Test-822839962 None] Lock "cinder-quobyte-61a88ea3-8f10-4703-8764-b2a2594b470b" acquired by "delete_volume" :: waited 0.020s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:45:08 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[252648cc-f1bb-4081-92c2-7a26bcbf2155]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:45:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-aa62aebd-baea-4ca6-bd9c-d9f96fd3f62c tempest-VolumesTransfersV357Test-822839962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-61a88ea3-8f10-4703-8764-b2a2594b470b {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:45:08 devstack sudo[96162]: pam_unix(sudo:session): session closed for user root
Jul 10 12:45:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-123cbfc0-ce9a-4862-bdc9-2f5d262f3c98 tempest-AttachVolumeTestJSON-147786180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9b45f049-05c4-46a9-bfc1-dd15841f8e30" returned: 0 in 0.651s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:45:08 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-123cbfc0-ce9a-4862-bdc9-2f5d262f3c98 tempest-AttachVolumeTestJSON-147786180 None] <== create_volume: return (1523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:45:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-123cbfc0-ce9a-4862-bdc9-2f5d262f3c98 tempest-AttachVolumeTestJSON-147786180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:45:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-597d97a6-cf3c-4d9b-9f4b-cccd02d12b97 tempest-VolumesActionsTest-1987453551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.084s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:45:08 devstack sudo[96165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-61a88ea3-8f10-4703-8764-b2a2594b470b
Jul 10 12:45:08 devstack sudo[96165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:45:08 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-123cbfc0-ce9a-4862-bdc9-2f5d262f3c98 tempest-AttachVolumeTestJSON-147786180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f694b513-c69d-4ded-90ae-7578b333293c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b45f049-05c4-46a9-bfc1-dd15841f8e30', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:45:08 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-123cbfc0-ce9a-4862-bdc9-2f5d262f3c98 tempest-AttachVolumeTestJSON-147786180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d7950fb-f164-4a3f-a69e-df5454159af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:45:08 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1115a8-e493-450b-be47-07c376346d8d]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:45:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-597d97a6-cf3c-4d9b-9f4b-cccd02d12b97 tempest-VolumesActionsTest-1987453551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1224ba53-385c-414b-9176-9508e8815da8 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:45:08 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-123cbfc0-ce9a-4862-bdc9-2f5d262f3c98 tempest-AttachVolumeTestJSON-147786180 None] Volume volume-9b45f049-05c4-46a9-bfc1-dd15841f8e30 (9b45f049-05c4-46a9-bfc1-dd15841f8e30): created successfully
Jul 10 12:45:08 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-123cbfc0-ce9a-4862-bdc9-2f5d262f3c98 tempest-AttachVolumeTestJSON-147786180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d7950fb-f164-4a3f-a69e-df5454159af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:45:08 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-123cbfc0-ce9a-4862-bdc9-2f5d262f3c98 tempest-AttachVolumeTestJSON-147786180 None] Flow 'volume_create_manager' (c9b476af-39ac-4dfd-8638-f58f3c3fa8a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:45:08 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-123cbfc0-ce9a-4862-bdc9-2f5d262f3c98 tempest-AttachVolumeTestJSON-147786180 None] Created volume successfully.
Jul 10 12:45:08 devstack sudo[96167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1224ba53-385c-414b-9176-9508e8815da8
Jul 10 12:45:08 devstack sudo[96167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:45:08 devstack sudo[96165]: pam_unix(sudo:session): session closed for user root
Jul 10 12:45:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-aa62aebd-baea-4ca6-bd9c-d9f96fd3f62c tempest-VolumesTransfersV357Test-822839962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-61a88ea3-8f10-4703-8764-b2a2594b470b" returned: 0 in 0.856s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:45:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-aa62aebd-baea-4ca6-bd9c-d9f96fd3f62c tempest-VolumesTransfersV357Test-822839962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-61a88ea3-8f10-4703-8764-b2a2594b470b {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:45:09 devstack sudo[96178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-61a88ea3-8f10-4703-8764-b2a2594b470b
Jul 10 12:45:09 devstack sudo[96178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:45:09 devstack sudo[96167]: pam_unix(sudo:session): session closed for user root
Jul 10 12:45:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-597d97a6-cf3c-4d9b-9f4b-cccd02d12b97 tempest-VolumesActionsTest-1987453551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1224ba53-385c-414b-9176-9508e8815da8" returned: 0 in 0.817s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:45:09 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa728e92-df74-4662-aad6-6483041a4338]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:45:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-597d97a6-cf3c-4d9b-9f4b-cccd02d12b97 tempest-VolumesActionsTest-1987453551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1224ba53-385c-414b-9176-9508e8815da8 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:45:09 devstack sudo[96182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1224ba53-385c-414b-9176-9508e8815da8
Jul 10 12:45:09 devstack sudo[96182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:45:09 devstack sudo[96178]: pam_unix(sudo:session): session closed for user root
Jul 10 12:45:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-aa62aebd-baea-4ca6-bd9c-d9f96fd3f62c tempest-VolumesTransfersV357Test-822839962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-61a88ea3-8f10-4703-8764-b2a2594b470b" returned: 0 in 0.680s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:45:09 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-aa62aebd-baea-4ca6-bd9c-d9f96fd3f62c tempest-VolumesTransfersV357Test-822839962 None] Lock "cinder-quobyte-61a88ea3-8f10-4703-8764-b2a2594b470b" released by "delete_volume" :: held 1.588s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:45:09 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-aa62aebd-baea-4ca6-bd9c-d9f96fd3f62c tempest-VolumesTransfersV357Test-822839962 None] Created reservations ['b95cdeec-d5eb-4db2-808b-596bf7027e42', '0ad24194-184f-41d1-b48e-27574885b67e', 'ce727bbe-6f2d-4a49-942d-6e68bacb7072', 'a9255d94-0bf9-40aa-9ca1-ca7ace77ff08'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:45:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-aa62aebd-baea-4ca6-bd9c-d9f96fd3f62c tempest-VolumesTransfersV357Test-822839962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:45:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-aa62aebd-baea-4ca6-bd9c-d9f96fd3f62c tempest-VolumesTransfersV357Test-822839962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:45:09 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-aa62aebd-baea-4ca6-bd9c-d9f96fd3f62c tempest-VolumesTransfersV357Test-822839962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:45:09 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-aa62aebd-baea-4ca6-bd9c-d9f96fd3f62c tempest-VolumesTransfersV357Test-822839962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:45:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-aa62aebd-baea-4ca6-bd9c-d9f96fd3f62c tempest-VolumesTransfersV357Test-822839962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:45:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-aa62aebd-baea-4ca6-bd9c-d9f96fd3f62c tempest-VolumesTransfersV357Test-822839962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:45:09 devstack sudo[96188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:45:09 devstack sudo[96188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:45:09 devstack sudo[96182]: pam_unix(sudo:session): session closed for user root
Jul 10 12:45:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-597d97a6-cf3c-4d9b-9f4b-cccd02d12b97 tempest-VolumesActionsTest-1987453551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1224ba53-385c-414b-9176-9508e8815da8" returned: 0 in 0.821s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:45:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-597d97a6-cf3c-4d9b-9f4b-cccd02d12b97 tempest-VolumesActionsTest-1987453551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1224ba53-385c-414b-9176-9508e8815da8 /opt/stack/data/cinder/conversion/1224ba53-385c-414b-9176-9508e8815da8.temp_image.0f298f40-6613-4e43-8de1-0879c2c29aa477a8m2uc.img {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:45:09 devstack sudo[96190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1224ba53-385c-414b-9176-9508e8815da8 /opt/stack/data/cinder/conversion/1224ba53-385c-414b-9176-9508e8815da8.temp_image.0f298f40-6613-4e43-8de1-0879c2c29aa477a8m2uc.img
Jul 10 12:45:09 devstack sudo[96190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:45:10 devstack sudo[96188]: pam_unix(sudo:session): session closed for user root
Jul 10 12:45:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-aa62aebd-baea-4ca6-bd9c-d9f96fd3f62c tempest-VolumesTransfersV357Test-822839962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.771s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:45:10 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-aa62aebd-baea-4ca6-bd9c-d9f96fd3f62c tempest-VolumesTransfersV357Test-822839962 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:45:10 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-aa62aebd-baea-4ca6-bd9c-d9f96fd3f62c tempest-VolumesTransfersV357Test-822839962 None] Deleted volume successfully.
Jul 10 12:45:10 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-aa62aebd-baea-4ca6-bd9c-d9f96fd3f62c tempest-VolumesTransfersV357Test-822839962 None] Lock "cinder-61a88ea3-8f10-4703-8764-b2a2594b470b-delete_volume" released by "delete_volume" :: held 2.601s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:45:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-22369e21-26aa-4173-8a74-21b7e2a2e023 req-947e89d3-4bfb-42cb-ae36-c411eb2025e1 tempest-AttachVolumeTestJSON-147786180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:45:12 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:45:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:45:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:45:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:45:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:45:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:45:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:45:13 devstack sudo[96212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:45:13 devstack sudo[96212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:45:14 devstack sudo[96212]: pam_unix(sudo:session): session closed for user root
Jul 10 12:45:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 1.094s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:45:14 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:45:14 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager._thread_info {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:45:14 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread count: 28 {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 10 12:45:14 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread info: [<_MainThread(MainThread, started 128233544536192)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128233445424704)>, <Thread(Thread-3 (stat_writer), started daemon 128233435118528)>, <Thread(Rabbit-heartbeat, started daemon 128233435718016)>, <Thread(Thread-5 (_runner), started daemon 128233432624448)>, <Thread(Thread-7 (_runner), started daemon 128233432674688)>, <Thread(fd_logger, started daemon 128233428569472)>, <Thread(privsep_reader, started daemon 128233429417088)>, <Thread(tpool_thread_0, started daemon 128233421182656)>, <Thread(tpool_thread_1, started daemon 128233412789952)>, <Thread(tpool_thread_2, started daemon 128233404397248)>, <Thread(tpool_thread_3, started daemon 128233396004544)>, <Thread(tpool_thread_4, started daemon 128233387611840)>, <Thread(tpool_thread_5, started daemon 128233379219136)>, <Thread(tpool_thread_6, started daemon 128233370826432)>, <Thread(tpool_thread_7, started daemon 128233362433728)>, <Thread(tpool_thread_8, started daemon 128233354041024)>, <Thread(tpool_thread_9, started daemon 128233345631936)>, <Thread(tpool_thread_10, started daemon 128233337222848)>, <Thread(tpool_thread_11, started daemon 128233328813760)>, <Thread(tpool_thread_12, started daemon 128233320404672)>, <Thread(tpool_thread_13, started daemon 128233311995584)>, <Thread(tpool_thread_14, started daemon 128233303586496)>, <Thread(tpool_thread_15, started daemon 128233295177408)>, <Thread(tpool_thread_16, started daemon 128233286768320)>, <Thread(tpool_thread_17, started daemon 128233278359232)>, <Thread(tpool_thread_18, started daemon 128233269950144)>, <Thread(tpool_thread_19, started daemon 128233261541056)>] {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 10 12:45:16 devstack sudo[96190]: pam_unix(sudo:session): session closed for user root
Jul 10 12:45:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-597d97a6-cf3c-4d9b-9f4b-cccd02d12b97 tempest-VolumesActionsTest-1987453551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1224ba53-385c-414b-9176-9508e8815da8 /opt/stack/data/cinder/conversion/1224ba53-385c-414b-9176-9508e8815da8.temp_image.0f298f40-6613-4e43-8de1-0879c2c29aa477a8m2uc.img" returned: 0 in 6.199s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:45:16 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f869609-6df6-40ec-999b-6fde208b2009]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:45:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-597d97a6-cf3c-4d9b-9f4b-cccd02d12b97 tempest-VolumesActionsTest-1987453551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1224ba53-385c-414b-9176-9508e8815da8 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:45:16 devstack sudo[96215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1224ba53-385c-414b-9176-9508e8815da8
Jul 10 12:45:16 devstack sudo[96215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:45:17 devstack sudo[96215]: pam_unix(sudo:session): session closed for user root
Jul 10 12:45:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-597d97a6-cf3c-4d9b-9f4b-cccd02d12b97 tempest-VolumesActionsTest-1987453551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1224ba53-385c-414b-9176-9508e8815da8" returned: 0 in 1.046s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:45:17 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-597d97a6-cf3c-4d9b-9f4b-cccd02d12b97 tempest-VolumesActionsTest-1987453551 None] Image conversion details: src /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1224ba53-385c-414b-9176-9508e8815da8, size 1024.00 MB, duration 6.20 sec, destination /opt/stack/data/cinder/conversion/1224ba53-385c-414b-9176-9508e8815da8.temp_image.0f298f40-6613-4e43-8de1-0879c2c29aa477a8m2uc.img {{(pid=87378) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 10 12:45:17 devstack cinder-volume[87378]: INFO cinder.image.image_utils [None req-597d97a6-cf3c-4d9b-9f4b-cccd02d12b97 tempest-VolumesActionsTest-1987453551 None] Converted 1024.00 MB image at 165.14 MB/s
Jul 10 12:45:17 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-597d97a6-cf3c-4d9b-9f4b-cccd02d12b97 tempest-VolumesActionsTest-1987453551 None] 0f298f40-6613-4e43-8de1-0879c2c29aa4 was raw, no need to convert to raw {{(pid=87378) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Jul 10 12:45:20 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-184544c7-338d-4c1c-ab12-9808fb054b0d tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:45:20 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-184544c7-338d-4c1c-ab12-9808fb054b0d tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Flow 'volume_create_manager' (363022de-55ef-414c-8b6c-200b33f0beee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:45:20 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-184544c7-338d-4c1c-ab12-9808fb054b0d tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32b44cc1-fc02-44a6-bcfb-415cc09ca3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:45:20 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-184544c7-338d-4c1c-ab12-9808fb054b0d tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32b44cc1-fc02-44a6-bcfb-415cc09ca3bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:45:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1193034381',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1659d890-c682-43b5-959d-f31a3b54e729,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3670ccc7421747c5b313630701ee4ef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:45:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:45:20Z,use_quota=True,user_id='6a429221d6b94eb789f3a42555d69f57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:45:20 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-184544c7-338d-4c1c-ab12-9808fb054b0d tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9768e40f-cdd9-44e9-a9af-720d0ed00e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:45:20 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-184544c7-338d-4c1c-ab12-9808fb054b0d tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9768e40f-cdd9-44e9-a9af-720d0ed00e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:45:20 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-184544c7-338d-4c1c-ab12-9808fb054b0d tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc01bb6f-52e0-49a7-b506-c97099904edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:45:20 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-184544c7-338d-4c1c-ab12-9808fb054b0d tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc01bb6f-52e0-49a7-b506-c97099904edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1659d890-c682-43b5-959d-f31a3b54e729', 'volume_name': 'volume-1659d890-c682-43b5-959d-f31a3b54e729', 'volume_size': 2}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:45:20 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-184544c7-338d-4c1c-ab12-9808fb054b0d tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb014a11-f5fb-424f-a384-b9fafb5e0844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:45:20 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-184544c7-338d-4c1c-ab12-9808fb054b0d tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb014a11-f5fb-424f-a384-b9fafb5e0844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:45:20 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-184544c7-338d-4c1c-ab12-9808fb054b0d tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90a4f87a-669e-4975-b356-00d66955690d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:45:20 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-184544c7-338d-4c1c-ab12-9808fb054b0d tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Volume 1659d890-c682-43b5-959d-f31a3b54e729: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1659d890-c682-43b5-959d-f31a3b54e729', 'volume_size': 2}
Jul 10 12:45:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-184544c7-338d-4c1c-ab12-9808fb054b0d tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:45:30 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:SELECT=53,cinder:UPDATE=55,cinder:DELETE=4,cinder:INSERT=13 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:45:30 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:UPDATE=57,cinder:SELECT=49,cinder:INSERT=13,cinder:DELETE=5 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:45:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-597d97a6-cf3c-4d9b-9f4b-cccd02d12b97 tempest-VolumesActionsTest-1987453551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.649s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:45:38 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-597d97a6-cf3c-4d9b-9f4b-cccd02d12b97 tempest-VolumesActionsTest-1987453551 None] Uploaded volume to glance image-id: 0f298f40-6613-4e43-8de1-0879c2c29aa4. {{(pid=87378) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jul 10 12:45:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-22369e21-26aa-4173-8a74-21b7e2a2e023 req-947e89d3-4bfb-42cb-ae36-c411eb2025e1 tempest-AttachVolumeTestJSON-147786180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 26.035s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:45:38 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cda3861-8e7a-416b-a895-15f607490dfd]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:45:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-22369e21-26aa-4173-8a74-21b7e2a2e023 req-947e89d3-4bfb-42cb-ae36-c411eb2025e1 tempest-AttachVolumeTestJSON-147786180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9b45f049-05c4-46a9-bfc1-dd15841f8e30 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:45:38 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-597d97a6-cf3c-4d9b-9f4b-cccd02d12b97 tempest-VolumesActionsTest-1987453551 None] Copy volume to image completed successfully.
Jul 10 12:45:39 devstack sudo[96382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9b45f049-05c4-46a9-bfc1-dd15841f8e30
Jul 10 12:45:39 devstack sudo[96382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:45:39 devstack sudo[96382]: pam_unix(sudo:session): session closed for user root
Jul 10 12:45:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-22369e21-26aa-4173-8a74-21b7e2a2e023 req-947e89d3-4bfb-42cb-ae36-c411eb2025e1 tempest-AttachVolumeTestJSON-147786180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9b45f049-05c4-46a9-bfc1-dd15841f8e30" returned: 0 in 0.874s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:45:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-22369e21-26aa-4173-8a74-21b7e2a2e023 req-947e89d3-4bfb-42cb-ae36-c411eb2025e1 tempest-AttachVolumeTestJSON-147786180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.897s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:45:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-184544c7-338d-4c1c-ab12-9808fb054b0d tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.341s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:45:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-184544c7-338d-4c1c-ab12-9808fb054b0d tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:45:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1193034381',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1659d890-c682-43b5-959d-f31a3b54e729,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3670ccc7421747c5b313630701ee4ef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:45:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:45:20Z,use_quota=True,user_id='6a429221d6b94eb789f3a42555d69f57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:45:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-184544c7-338d-4c1c-ab12-9808fb054b0d tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Creating volume 1659d890-c682-43b5-959d-f31a3b54e729 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:45:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-184544c7-338d-4c1c-ab12-9808fb054b0d tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:45:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-184544c7-338d-4c1c-ab12-9808fb054b0d tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:45:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-184544c7-338d-4c1c-ab12-9808fb054b0d tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:45:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-184544c7-338d-4c1c-ab12-9808fb054b0d tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:45:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-184544c7-338d-4c1c-ab12-9808fb054b0d tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:45:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-184544c7-338d-4c1c-ab12-9808fb054b0d tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:45:39 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-184544c7-338d-4c1c-ab12-9808fb054b0d tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:45:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-184544c7-338d-4c1c-ab12-9808fb054b0d tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1659d890-c682-43b5-959d-f31a3b54e729 2147483648 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:45:39 devstack sudo[96388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1659d890-c682-43b5-959d-f31a3b54e729 2147483648
Jul 10 12:45:39 devstack sudo[96388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:45:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-22369e21-26aa-4173-8a74-21b7e2a2e023 req-947e89d3-4bfb-42cb-ae36-c411eb2025e1 tempest-AttachVolumeTestJSON-147786180 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be', 'name': 'volume-9b45f049-05c4-46a9-bfc1-dd15841f8e30', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '08a52de6-9014-4444-a4ef-44ae4d5c8990', 'enforce_multipath': True} {{(pid=87378) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 10 12:45:39 devstack cinder-volume[87378]: INFO cinder.volume.manager [req-22369e21-26aa-4173-8a74-21b7e2a2e023 req-947e89d3-4bfb-42cb-ae36-c411eb2025e1 tempest-AttachVolumeTestJSON-147786180 None] attachment_update completed successfully.
Jul 10 12:45:40 devstack sudo[96388]: pam_unix(sudo:session): session closed for user root
Jul 10 12:45:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-184544c7-338d-4c1c-ab12-9808fb054b0d tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1659d890-c682-43b5-959d-f31a3b54e729 2147483648" returned: 0 in 1.162s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:45:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-184544c7-338d-4c1c-ab12-9808fb054b0d tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1659d890-c682-43b5-959d-f31a3b54e729 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:45:41 devstack sudo[96408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1659d890-c682-43b5-959d-f31a3b54e729
Jul 10 12:45:41 devstack sudo[96408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:45:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3e5341ff-0a2f-4392-a82e-1186feb7e75f tempest-VolumesActionsTest-1987453551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:45:41 devstack sudo[96408]: pam_unix(sudo:session): session closed for user root
Jul 10 12:45:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-184544c7-338d-4c1c-ab12-9808fb054b0d tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1659d890-c682-43b5-959d-f31a3b54e729" returned: 0 in 0.777s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:45:41 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-184544c7-338d-4c1c-ab12-9808fb054b0d tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] <== create_volume: return (1991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:45:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-184544c7-338d-4c1c-ab12-9808fb054b0d tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.997s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:45:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3e5341ff-0a2f-4392-a82e-1186feb7e75f tempest-VolumesActionsTest-1987453551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.686s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:45:41 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[708a74e9-d94c-4e2b-bc0e-4c7360909840]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:45:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3e5341ff-0a2f-4392-a82e-1186feb7e75f tempest-VolumesActionsTest-1987453551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1224ba53-385c-414b-9176-9508e8815da8 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:45:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-184544c7-338d-4c1c-ab12-9808fb054b0d tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90a4f87a-669e-4975-b356-00d66955690d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1659d890-c682-43b5-959d-f31a3b54e729', 'volume_size': 2}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:45:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-184544c7-338d-4c1c-ab12-9808fb054b0d tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5350842-293e-4b96-9d9c-3b9884e39afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:45:41 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-184544c7-338d-4c1c-ab12-9808fb054b0d tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Volume volume-1659d890-c682-43b5-959d-f31a3b54e729 (1659d890-c682-43b5-959d-f31a3b54e729): created successfully
Jul 10 12:45:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-184544c7-338d-4c1c-ab12-9808fb054b0d tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5350842-293e-4b96-9d9c-3b9884e39afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:45:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-184544c7-338d-4c1c-ab12-9808fb054b0d tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Flow 'volume_create_manager' (363022de-55ef-414c-8b6c-200b33f0beee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:45:41 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-184544c7-338d-4c1c-ab12-9808fb054b0d tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Created volume successfully.
Jul 10 12:45:41 devstack sudo[96411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1224ba53-385c-414b-9176-9508e8815da8
Jul 10 12:45:41 devstack sudo[96411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:45:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-b757bec9-0e86-4401-82d3-c6616252405b tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:45:42 devstack sudo[96411]: pam_unix(sudo:session): session closed for user root
Jul 10 12:45:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3e5341ff-0a2f-4392-a82e-1186feb7e75f tempest-VolumesActionsTest-1987453551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1224ba53-385c-414b-9176-9508e8815da8" returned: 0 in 0.963s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:45:42 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[4337556b-9ede-4600-a2ff-192582060648]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:45:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3e5341ff-0a2f-4392-a82e-1186feb7e75f tempest-VolumesActionsTest-1987453551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1224ba53-385c-414b-9176-9508e8815da8 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:45:42 devstack sudo[96416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1224ba53-385c-414b-9176-9508e8815da8
Jul 10 12:45:42 devstack sudo[96416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:45:43 devstack sudo[96416]: pam_unix(sudo:session): session closed for user root
Jul 10 12:45:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3e5341ff-0a2f-4392-a82e-1186feb7e75f tempest-VolumesActionsTest-1987453551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1224ba53-385c-414b-9176-9508e8815da8" returned: 0 in 0.832s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:45:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3e5341ff-0a2f-4392-a82e-1186feb7e75f tempest-VolumesActionsTest-1987453551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1224ba53-385c-414b-9176-9508e8815da8 /opt/stack/data/cinder/conversion/1224ba53-385c-414b-9176-9508e8815da8.temp_image.298b7da5-1756-49df-bef9-db8664cc5993_clo48wv.img {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:45:43 devstack sudo[96440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1224ba53-385c-414b-9176-9508e8815da8 /opt/stack/data/cinder/conversion/1224ba53-385c-414b-9176-9508e8815da8.temp_image.298b7da5-1756-49df-bef9-db8664cc5993_clo48wv.img
Jul 10 12:45:43 devstack sudo[96440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:45:48 devstack cinder-volume[87378]: INFO cinder.volume.manager [req-9a09ab3d-02f6-4b4f-8e1c-0718f03ae24d req-fcf1028d-1fb2-4ff8-85ec-5886ec816f07 tempest-AttachVolumeTestJSON-147786180 None] Terminate volume connection completed successfully.
Jul 10 12:45:48 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-9a09ab3d-02f6-4b4f-8e1c-0718f03ae24d req-fcf1028d-1fb2-4ff8-85ec-5886ec816f07 tempest-AttachVolumeTestJSON-147786180 None] Deleting attachment 651fbe08-15e0-4e83-a5c9-7b9f479d5fc6. {{(pid=87378) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 10 12:45:48 devstack sudo[96440]: pam_unix(sudo:session): session closed for user root
Jul 10 12:45:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3e5341ff-0a2f-4392-a82e-1186feb7e75f tempest-VolumesActionsTest-1987453551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1224ba53-385c-414b-9176-9508e8815da8 /opt/stack/data/cinder/conversion/1224ba53-385c-414b-9176-9508e8815da8.temp_image.298b7da5-1756-49df-bef9-db8664cc5993_clo48wv.img" returned: 0 in 4.765s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:45:48 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ebd8fd-85ef-429a-b229-5ac238a8647c]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:45:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3e5341ff-0a2f-4392-a82e-1186feb7e75f tempest-VolumesActionsTest-1987453551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1224ba53-385c-414b-9176-9508e8815da8 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:45:48 devstack sudo[96459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1224ba53-385c-414b-9176-9508e8815da8
Jul 10 12:45:48 devstack sudo[96459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:45:49 devstack sudo[96459]: pam_unix(sudo:session): session closed for user root
Jul 10 12:45:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3e5341ff-0a2f-4392-a82e-1186feb7e75f tempest-VolumesActionsTest-1987453551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1224ba53-385c-414b-9176-9508e8815da8" returned: 0 in 0.946s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:45:49 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-3e5341ff-0a2f-4392-a82e-1186feb7e75f tempest-VolumesActionsTest-1987453551 None] Image conversion details: src /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1224ba53-385c-414b-9176-9508e8815da8, size 1024.00 MB, duration 4.77 sec, destination /opt/stack/data/cinder/conversion/1224ba53-385c-414b-9176-9508e8815da8.temp_image.298b7da5-1756-49df-bef9-db8664cc5993_clo48wv.img {{(pid=87378) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 10 12:45:49 devstack cinder-volume[87378]: INFO cinder.image.image_utils [None req-3e5341ff-0a2f-4392-a82e-1186feb7e75f tempest-VolumesActionsTest-1987453551 None] Converted 1024.00 MB image at 214.85 MB/s
Jul 10 12:45:49 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-3e5341ff-0a2f-4392-a82e-1186feb7e75f tempest-VolumesActionsTest-1987453551 None] 298b7da5-1756-49df-bef9-db8664cc5993 was raw, converting to qcow2 {{(pid=87378) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}}
Jul 10 12:45:49 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[418ae137-8ec6-4d04-b440-e29db8c8a201]: (4, 'raw') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:45:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3e5341ff-0a2f-4392-a82e-1186feb7e75f tempest-VolumesActionsTest-1987453551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/1224ba53-385c-414b-9176-9508e8815da8.temp_image.298b7da5-1756-49df-bef9-db8664cc5993_clo48wv.img {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:45:49 devstack sudo[96465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/1224ba53-385c-414b-9176-9508e8815da8.temp_image.298b7da5-1756-49df-bef9-db8664cc5993_clo48wv.img
Jul 10 12:45:49 devstack sudo[96465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:45:50 devstack sudo[96465]: pam_unix(sudo:session): session closed for user root
Jul 10 12:45:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3e5341ff-0a2f-4392-a82e-1186feb7e75f tempest-VolumesActionsTest-1987453551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/1224ba53-385c-414b-9176-9508e8815da8.temp_image.298b7da5-1756-49df-bef9-db8664cc5993_clo48wv.img" returned: 0 in 0.721s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:45:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3e5341ff-0a2f-4392-a82e-1186feb7e75f tempest-VolumesActionsTest-1987453551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1224ba53-385c-414b-9176-9508e8815da8.temp_image.298b7da5-1756-49df-bef9-db8664cc5993_clo48wv.img {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:45:50 devstack sudo[96469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1224ba53-385c-414b-9176-9508e8815da8.temp_image.298b7da5-1756-49df-bef9-db8664cc5993_clo48wv.img
Jul 10 12:45:50 devstack sudo[96469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:45:50 devstack cinder-volume[87378]: INFO cinder.volume.manager [req-8e6a0e98-360a-4189-be08-d303163d57fd req-083da1a9-9dad-4f4c-bab1-642294bab52c tempest-AttachVolumeTestJSON-147786180 None] Terminate volume connection completed successfully.
Jul 10 12:45:50 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-8e6a0e98-360a-4189-be08-d303163d57fd req-083da1a9-9dad-4f4c-bab1-642294bab52c tempest-AttachVolumeTestJSON-147786180 None] Deleting attachment 08a52de6-9014-4444-a4ef-44ae4d5c8990. {{(pid=87378) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 10 12:45:50 devstack sudo[96469]: pam_unix(sudo:session): session closed for user root
Jul 10 12:45:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3e5341ff-0a2f-4392-a82e-1186feb7e75f tempest-VolumesActionsTest-1987453551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1224ba53-385c-414b-9176-9508e8815da8.temp_image.298b7da5-1756-49df-bef9-db8664cc5993_clo48wv.img" returned: 1 in 0.791s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:45:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3e5341ff-0a2f-4392-a82e-1186feb7e75f tempest-VolumesActionsTest-1987453551 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1224ba53-385c-414b-9176-9508e8815da8.temp_image.298b7da5-1756-49df-bef9-db8664cc5993_clo48wv.img' failed. Not Retrying. {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 10 12:45:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3e5341ff-0a2f-4392-a82e-1186feb7e75f tempest-VolumesActionsTest-1987453551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/1224ba53-385c-414b-9176-9508e8815da8.temp_image.298b7da5-1756-49df-bef9-db8664cc5993_clo48wv.img /opt/stack/data/cinder/conversion/vol_upload_phn2wyy1 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:45:50 devstack sudo[96488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/1224ba53-385c-414b-9176-9508e8815da8.temp_image.298b7da5-1756-49df-bef9-db8664cc5993_clo48wv.img /opt/stack/data/cinder/conversion/vol_upload_phn2wyy1
Jul 10 12:45:50 devstack sudo[96488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:45:51 devstack sudo[96488]: pam_unix(sudo:session): session closed for user root
Jul 10 12:45:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3e5341ff-0a2f-4392-a82e-1186feb7e75f tempest-VolumesActionsTest-1987453551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/1224ba53-385c-414b-9176-9508e8815da8.temp_image.298b7da5-1756-49df-bef9-db8664cc5993_clo48wv.img /opt/stack/data/cinder/conversion/vol_upload_phn2wyy1" returned: 0 in 0.701s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:45:51 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-3e5341ff-0a2f-4392-a82e-1186feb7e75f tempest-VolumesActionsTest-1987453551 None] Image conversion details: src /opt/stack/data/cinder/conversion/1224ba53-385c-414b-9176-9508e8815da8.temp_image.298b7da5-1756-49df-bef9-db8664cc5993_clo48wv.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_phn2wyy1 {{(pid=87378) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 10 12:45:51 devstack cinder-volume[87378]: INFO cinder.image.image_utils [None req-3e5341ff-0a2f-4392-a82e-1186feb7e75f tempest-VolumesActionsTest-1987453551 None] Converted 1024.00 MB image at 1024.00 MB/s
Jul 10 12:45:51 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[89425bea-7284-4d55-8372-fe9f5f97ce12]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:45:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3e5341ff-0a2f-4392-a82e-1186feb7e75f tempest-VolumesActionsTest-1987453551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_phn2wyy1 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:45:51 devstack sudo[96493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_phn2wyy1
Jul 10 12:45:51 devstack sudo[96493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:45:52 devstack sudo[96493]: pam_unix(sudo:session): session closed for user root
Jul 10 12:45:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3e5341ff-0a2f-4392-a82e-1186feb7e75f tempest-VolumesActionsTest-1987453551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_phn2wyy1" returned: 0 in 0.763s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:45:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3e5341ff-0a2f-4392-a82e-1186feb7e75f tempest-VolumesActionsTest-1987453551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.898s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:45:53 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3e5341ff-0a2f-4392-a82e-1186feb7e75f tempest-VolumesActionsTest-1987453551 None] Uploaded volume to glance image-id: 298b7da5-1756-49df-bef9-db8664cc5993. {{(pid=87378) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jul 10 12:45:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-b757bec9-0e86-4401-82d3-c6616252405b tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.337s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:45:53 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-b757bec9-0e86-4401-82d3-c6616252405b tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Creating offline snapshot 5b5a88f1-7c3e-4b7d-a401-fb22d6c5c18a of volume 1659d890-c682-43b5-959d-f31a3b54e729 {{(pid=87378) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 10 12:45:53 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-3e5341ff-0a2f-4392-a82e-1186feb7e75f tempest-VolumesActionsTest-1987453551 None] Copy volume to image completed successfully.
Jul 10 12:45:53 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[7682e26e-3ed3-44cf-b467-7acc51dcbc53]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:45:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b757bec9-0e86-4401-82d3-c6616252405b tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1659d890-c682-43b5-959d-f31a3b54e729 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:45:53 devstack sudo[96498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1659d890-c682-43b5-959d-f31a3b54e729
Jul 10 12:45:53 devstack sudo[96498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:45:54 devstack sudo[96498]: pam_unix(sudo:session): session closed for user root
Jul 10 12:45:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b757bec9-0e86-4401-82d3-c6616252405b tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1659d890-c682-43b5-959d-f31a3b54e729" returned: 0 in 0.818s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:45:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b757bec9-0e86-4401-82d3-c6616252405b tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1659d890-c682-43b5-959d-f31a3b54e729,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1659d890-c682-43b5-959d-f31a3b54e729.5b5a88f1-7c3e-4b7d-a401-fb22d6c5c18a 2G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:45:54 devstack sudo[96510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1659d890-c682-43b5-959d-f31a3b54e729,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1659d890-c682-43b5-959d-f31a3b54e729.5b5a88f1-7c3e-4b7d-a401-fb22d6c5c18a 2G
Jul 10 12:45:54 devstack sudo[96510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:45:54 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-264e4112-ad4c-469b-bb18-6c939fe3a18a tempest-AttachVolumeNegativeTest-2056769334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:45:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-264e4112-ad4c-469b-bb18-6c939fe3a18a tempest-AttachVolumeNegativeTest-2056769334 None] Flow 'volume_create_manager' (416ad75c-234c-467f-83ce-3ac11287852e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:45:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-264e4112-ad4c-469b-bb18-6c939fe3a18a tempest-AttachVolumeNegativeTest-2056769334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab6868a2-4328-4434-b8c4-1ff0397649df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:45:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-264e4112-ad4c-469b-bb18-6c939fe3a18a tempest-AttachVolumeNegativeTest-2056769334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab6868a2-4328-4434-b8c4-1ff0397649df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:45:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-780550859',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4468ec21-f794-4002-9fa6-12b1269a41fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a63dc9ad7bb64e71947d627c39ccb30a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:45:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:45:55Z,use_quota=True,user_id='4e2b69d2fc924858bd316c21d4da30cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:45:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-264e4112-ad4c-469b-bb18-6c939fe3a18a tempest-AttachVolumeNegativeTest-2056769334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca1877d9-bcc4-4141-880f-09ada6b7da08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:45:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-264e4112-ad4c-469b-bb18-6c939fe3a18a tempest-AttachVolumeNegativeTest-2056769334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca1877d9-bcc4-4141-880f-09ada6b7da08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:45:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-264e4112-ad4c-469b-bb18-6c939fe3a18a tempest-AttachVolumeNegativeTest-2056769334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfb7cbab-51d1-494f-973b-7350139b4b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:45:55 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-264e4112-ad4c-469b-bb18-6c939fe3a18a tempest-AttachVolumeNegativeTest-2056769334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfb7cbab-51d1-494f-973b-7350139b4b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4468ec21-f794-4002-9fa6-12b1269a41fd', 'volume_name': 'volume-4468ec21-f794-4002-9fa6-12b1269a41fd', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:45:55 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-264e4112-ad4c-469b-bb18-6c939fe3a18a tempest-AttachVolumeNegativeTest-2056769334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b1bfa7e-9796-4a75-9d1d-d94c57ff0917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:45:55 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-264e4112-ad4c-469b-bb18-6c939fe3a18a tempest-AttachVolumeNegativeTest-2056769334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b1bfa7e-9796-4a75-9d1d-d94c57ff0917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:45:55 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-264e4112-ad4c-469b-bb18-6c939fe3a18a tempest-AttachVolumeNegativeTest-2056769334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f969327b-932e-4080-a436-d907572973e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:45:55 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-264e4112-ad4c-469b-bb18-6c939fe3a18a tempest-AttachVolumeNegativeTest-2056769334 None] Volume 4468ec21-f794-4002-9fa6-12b1269a41fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4468ec21-f794-4002-9fa6-12b1269a41fd', 'volume_size': 1}
Jul 10 12:45:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-264e4112-ad4c-469b-bb18-6c939fe3a18a tempest-AttachVolumeNegativeTest-2056769334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:45:55 devstack sudo[96510]: pam_unix(sudo:session): session closed for user root
Jul 10 12:45:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b757bec9-0e86-4401-82d3-c6616252405b tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1659d890-c682-43b5-959d-f31a3b54e729,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1659d890-c682-43b5-959d-f31a3b54e729.5b5a88f1-7c3e-4b7d-a401-fb22d6c5c18a 2G" returned: 0 in 1.174s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:45:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b757bec9-0e86-4401-82d3-c6616252405b tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1659d890-c682-43b5-959d-f31a3b54e729 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1659d890-c682-43b5-959d-f31a3b54e729.5b5a88f1-7c3e-4b7d-a401-fb22d6c5c18a {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:45:55 devstack sudo[96534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1659d890-c682-43b5-959d-f31a3b54e729 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1659d890-c682-43b5-959d-f31a3b54e729.5b5a88f1-7c3e-4b7d-a401-fb22d6c5c18a
Jul 10 12:45:55 devstack sudo[96534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:45:55 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-030736bf-c58a-4462-9d91-193450f9cbb2 tempest-VolumesActionsTest-1987453551 None] Acquiring lock "cinder-1224ba53-385c-414b-9176-9508e8815da8-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:45:55 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-030736bf-c58a-4462-9d91-193450f9cbb2 tempest-VolumesActionsTest-1987453551 None] Lock "cinder-1224ba53-385c-414b-9176-9508e8815da8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:45:55 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-030736bf-c58a-4462-9d91-193450f9cbb2 tempest-VolumesActionsTest-1987453551 None] Acquiring lock "cinder-quobyte-1224ba53-385c-414b-9176-9508e8815da8" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:45:55 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-030736bf-c58a-4462-9d91-193450f9cbb2 tempest-VolumesActionsTest-1987453551 None] Lock "cinder-quobyte-1224ba53-385c-414b-9176-9508e8815da8" acquired by "delete_volume" :: waited 0.017s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:45:55 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fccedce-828a-4004-9fff-d52a6852388a]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:45:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-030736bf-c58a-4462-9d91-193450f9cbb2 tempest-VolumesActionsTest-1987453551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1224ba53-385c-414b-9176-9508e8815da8 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:45:56 devstack sudo[96536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1224ba53-385c-414b-9176-9508e8815da8
Jul 10 12:45:56 devstack sudo[96536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:45:56 devstack sudo[96534]: pam_unix(sudo:session): session closed for user root
Jul 10 12:45:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b757bec9-0e86-4401-82d3-c6616252405b tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1659d890-c682-43b5-959d-f31a3b54e729 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1659d890-c682-43b5-959d-f31a3b54e729.5b5a88f1-7c3e-4b7d-a401-fb22d6c5c18a" returned: 0 in 0.834s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:45:56 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-b757bec9-0e86-4401-82d3-c6616252405b tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1659d890-c682-43b5-959d-f31a3b54e729.5b5a88f1-7c3e-4b7d-a401-fb22d6c5c18a is being set with open permissions: ugo+rw
Jul 10 12:45:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b757bec9-0e86-4401-82d3-c6616252405b tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1659d890-c682-43b5-959d-f31a3b54e729.5b5a88f1-7c3e-4b7d-a401-fb22d6c5c18a {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:45:56 devstack sudo[96544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1659d890-c682-43b5-959d-f31a3b54e729.5b5a88f1-7c3e-4b7d-a401-fb22d6c5c18a
Jul 10 12:45:56 devstack sudo[96544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:45:56 devstack sudo[96536]: pam_unix(sudo:session): session closed for user root
Jul 10 12:45:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-030736bf-c58a-4462-9d91-193450f9cbb2 tempest-VolumesActionsTest-1987453551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1224ba53-385c-414b-9176-9508e8815da8" returned: 0 in 0.908s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:45:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-030736bf-c58a-4462-9d91-193450f9cbb2 tempest-VolumesActionsTest-1987453551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1224ba53-385c-414b-9176-9508e8815da8 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:45:56 devstack sudo[96549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1224ba53-385c-414b-9176-9508e8815da8
Jul 10 12:45:56 devstack sudo[96549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:45:57 devstack sudo[96544]: pam_unix(sudo:session): session closed for user root
Jul 10 12:45:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b757bec9-0e86-4401-82d3-c6616252405b tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1659d890-c682-43b5-959d-f31a3b54e729.5b5a88f1-7c3e-4b7d-a401-fb22d6c5c18a" returned: 0 in 0.712s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:45:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b757bec9-0e86-4401-82d3-c6616252405b tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1659d890-c682-43b5-959d-f31a3b54e729.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:45:57 devstack sudo[96552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1659d890-c682-43b5-959d-f31a3b54e729.info
Jul 10 12:45:57 devstack sudo[96552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:45:57 devstack sudo[96549]: pam_unix(sudo:session): session closed for user root
Jul 10 12:45:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-030736bf-c58a-4462-9d91-193450f9cbb2 tempest-VolumesActionsTest-1987453551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1224ba53-385c-414b-9176-9508e8815da8" returned: 0 in 0.725s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:45:57 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-030736bf-c58a-4462-9d91-193450f9cbb2 tempest-VolumesActionsTest-1987453551 None] Lock "cinder-quobyte-1224ba53-385c-414b-9176-9508e8815da8" released by "delete_volume" :: held 1.675s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:45:57 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-030736bf-c58a-4462-9d91-193450f9cbb2 tempest-VolumesActionsTest-1987453551 None] Created reservations ['8cbcbedb-7b02-4f58-981e-bf20c4b1d0cd', '0db55450-dbe2-4d1d-a862-dd4e63bc302f', 'c44b067a-c65a-4455-9e22-aeb4b5649cb2', 'd2790726-fc98-4950-abd5-12db273f2972'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:45:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-030736bf-c58a-4462-9d91-193450f9cbb2 tempest-VolumesActionsTest-1987453551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:45:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-030736bf-c58a-4462-9d91-193450f9cbb2 tempest-VolumesActionsTest-1987453551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:45:57 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-030736bf-c58a-4462-9d91-193450f9cbb2 tempest-VolumesActionsTest-1987453551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:45:57 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-030736bf-c58a-4462-9d91-193450f9cbb2 tempest-VolumesActionsTest-1987453551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:45:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-030736bf-c58a-4462-9d91-193450f9cbb2 tempest-VolumesActionsTest-1987453551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:45:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-030736bf-c58a-4462-9d91-193450f9cbb2 tempest-VolumesActionsTest-1987453551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:45:57 devstack sudo[96555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:45:57 devstack sudo[96555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:45:57 devstack sudo[96552]: pam_unix(sudo:session): session closed for user root
Jul 10 12:45:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b757bec9-0e86-4401-82d3-c6616252405b tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1659d890-c682-43b5-959d-f31a3b54e729.info" returned: 0 in 0.666s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:45:57 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-b757bec9-0e86-4401-82d3-c6616252405b tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1659d890-c682-43b5-959d-f31a3b54e729.info is being set with open permissions: ugo+rw
Jul 10 12:45:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b757bec9-0e86-4401-82d3-c6616252405b tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1659d890-c682-43b5-959d-f31a3b54e729.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:45:58 devstack sudo[96558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1659d890-c682-43b5-959d-f31a3b54e729.info
Jul 10 12:45:58 devstack sudo[96558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:45:58 devstack sudo[96555]: pam_unix(sudo:session): session closed for user root
Jul 10 12:45:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-030736bf-c58a-4462-9d91-193450f9cbb2 tempest-VolumesActionsTest-1987453551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.701s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:45:58 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-030736bf-c58a-4462-9d91-193450f9cbb2 tempest-VolumesActionsTest-1987453551 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:45:58 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-030736bf-c58a-4462-9d91-193450f9cbb2 tempest-VolumesActionsTest-1987453551 None] Deleted volume successfully.
Jul 10 12:45:58 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-030736bf-c58a-4462-9d91-193450f9cbb2 tempest-VolumesActionsTest-1987453551 None] Lock "cinder-1224ba53-385c-414b-9176-9508e8815da8-delete_volume" released by "delete_volume" :: held 2.642s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:45:58 devstack sudo[96558]: pam_unix(sudo:session): session closed for user root
Jul 10 12:45:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b757bec9-0e86-4401-82d3-c6616252405b tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1659d890-c682-43b5-959d-f31a3b54e729.info" returned: 0 in 0.819s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:45:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-b757bec9-0e86-4401-82d3-c6616252405b tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.123s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:45:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-264e4112-ad4c-469b-bb18-6c939fe3a18a tempest-AttachVolumeNegativeTest-2056769334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.795s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:45:58 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-264e4112-ad4c-469b-bb18-6c939fe3a18a tempest-AttachVolumeNegativeTest-2056769334 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:45:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-780550859',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4468ec21-f794-4002-9fa6-12b1269a41fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a63dc9ad7bb64e71947d627c39ccb30a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:45:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:45:55Z,use_quota=True,user_id='4e2b69d2fc924858bd316c21d4da30cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:45:58 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-264e4112-ad4c-469b-bb18-6c939fe3a18a tempest-AttachVolumeNegativeTest-2056769334 None] Creating volume 4468ec21-f794-4002-9fa6-12b1269a41fd {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:45:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-264e4112-ad4c-469b-bb18-6c939fe3a18a tempest-AttachVolumeNegativeTest-2056769334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:45:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-264e4112-ad4c-469b-bb18-6c939fe3a18a tempest-AttachVolumeNegativeTest-2056769334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:45:58 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-264e4112-ad4c-469b-bb18-6c939fe3a18a tempest-AttachVolumeNegativeTest-2056769334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:45:58 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-264e4112-ad4c-469b-bb18-6c939fe3a18a tempest-AttachVolumeNegativeTest-2056769334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:45:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-264e4112-ad4c-469b-bb18-6c939fe3a18a tempest-AttachVolumeNegativeTest-2056769334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:45:58 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-264e4112-ad4c-469b-bb18-6c939fe3a18a tempest-AttachVolumeNegativeTest-2056769334 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:45:58 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-264e4112-ad4c-469b-bb18-6c939fe3a18a tempest-AttachVolumeNegativeTest-2056769334 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:45:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-264e4112-ad4c-469b-bb18-6c939fe3a18a tempest-AttachVolumeNegativeTest-2056769334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4468ec21-f794-4002-9fa6-12b1269a41fd 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:45:58 devstack sudo[96563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4468ec21-f794-4002-9fa6-12b1269a41fd 1073741824
Jul 10 12:45:58 devstack sudo[96563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:45:58 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-b757bec9-0e86-4401-82d3-c6616252405b tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Create snapshot completed successfully
Jul 10 12:45:59 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-26072bf6-1b8b-4cdf-b95d-8f561b0f01b5 tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Acquiring lock "cinder-5b5a88f1-7c3e-4b7d-a401-fb22d6c5c18a-delete_snapshot" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:45:59 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-26072bf6-1b8b-4cdf-b95d-8f561b0f01b5 tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Lock "cinder-5b5a88f1-7c3e-4b7d-a401-fb22d6c5c18a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:45:59 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-26072bf6-1b8b-4cdf-b95d-8f561b0f01b5 tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Acquiring lock "cinder-quobyte-1659d890-c682-43b5-959d-f31a3b54e729" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:45:59 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-26072bf6-1b8b-4cdf-b95d-8f561b0f01b5 tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Lock "cinder-quobyte-1659d890-c682-43b5-959d-f31a3b54e729" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:45:59 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-26072bf6-1b8b-4cdf-b95d-8f561b0f01b5 tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Acquiring lock "cinder-quobyte-5b5a88f1-7c3e-4b7d-a401-fb22d6c5c18a" by "_delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:45:59 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-26072bf6-1b8b-4cdf-b95d-8f561b0f01b5 tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Lock "cinder-quobyte-5b5a88f1-7c3e-4b7d-a401-fb22d6c5c18a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:45:59 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-26072bf6-1b8b-4cdf-b95d-8f561b0f01b5 tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Deleting offline snapshot 5b5a88f1-7c3e-4b7d-a401-fb22d6c5c18a of volume 1659d890-c682-43b5-959d-f31a3b54e729 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 10 12:45:59 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-26072bf6-1b8b-4cdf-b95d-8f561b0f01b5 tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] snapshot_file for this snap is: volume-1659d890-c682-43b5-959d-f31a3b54e729.5b5a88f1-7c3e-4b7d-a401-fb22d6c5c18a {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 10 12:45:59 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[364ba6aa-b40c-466a-93f2-574d13d47bac]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:45:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-26072bf6-1b8b-4cdf-b95d-8f561b0f01b5 tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1659d890-c682-43b5-959d-f31a3b54e729.5b5a88f1-7c3e-4b7d-a401-fb22d6c5c18a {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:45:59 devstack sudo[96567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1659d890-c682-43b5-959d-f31a3b54e729.5b5a88f1-7c3e-4b7d-a401-fb22d6c5c18a
Jul 10 12:45:59 devstack sudo[96567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:45:59 devstack sudo[96563]: pam_unix(sudo:session): session closed for user root
Jul 10 12:45:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-264e4112-ad4c-469b-bb18-6c939fe3a18a tempest-AttachVolumeNegativeTest-2056769334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4468ec21-f794-4002-9fa6-12b1269a41fd 1073741824" returned: 0 in 1.068s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:45:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-264e4112-ad4c-469b-bb18-6c939fe3a18a tempest-AttachVolumeNegativeTest-2056769334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4468ec21-f794-4002-9fa6-12b1269a41fd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:45:59 devstack sudo[96574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4468ec21-f794-4002-9fa6-12b1269a41fd
Jul 10 12:45:59 devstack sudo[96574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:00 devstack sudo[96567]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-26072bf6-1b8b-4cdf-b95d-8f561b0f01b5 tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1659d890-c682-43b5-959d-f31a3b54e729.5b5a88f1-7c3e-4b7d-a401-fb22d6c5c18a" returned: 0 in 0.877s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:00 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-26072bf6-1b8b-4cdf-b95d-8f561b0f01b5 tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1659d890-c682-43b5-959d-f31a3b54e729(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:46:00 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b640457-2af2-4d21-b950-87d894c38713]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:46:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-26072bf6-1b8b-4cdf-b95d-8f561b0f01b5 tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1659d890-c682-43b5-959d-f31a3b54e729 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:00 devstack sudo[96579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1659d890-c682-43b5-959d-f31a3b54e729
Jul 10 12:46:00 devstack sudo[96579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:00 devstack sudo[96574]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-264e4112-ad4c-469b-bb18-6c939fe3a18a tempest-AttachVolumeNegativeTest-2056769334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4468ec21-f794-4002-9fa6-12b1269a41fd" returned: 0 in 0.861s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:00 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-264e4112-ad4c-469b-bb18-6c939fe3a18a tempest-AttachVolumeNegativeTest-2056769334 None] <== create_volume: return (1983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:46:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-264e4112-ad4c-469b-bb18-6c939fe3a18a tempest-AttachVolumeNegativeTest-2056769334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.985s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:46:00 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-264e4112-ad4c-469b-bb18-6c939fe3a18a tempest-AttachVolumeNegativeTest-2056769334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f969327b-932e-4080-a436-d907572973e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4468ec21-f794-4002-9fa6-12b1269a41fd', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:46:00 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-264e4112-ad4c-469b-bb18-6c939fe3a18a tempest-AttachVolumeNegativeTest-2056769334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55263276-7e38-4da7-bec0-7790d55b5bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:46:00 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-264e4112-ad4c-469b-bb18-6c939fe3a18a tempest-AttachVolumeNegativeTest-2056769334 None] Volume volume-4468ec21-f794-4002-9fa6-12b1269a41fd (4468ec21-f794-4002-9fa6-12b1269a41fd): created successfully
Jul 10 12:46:00 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-264e4112-ad4c-469b-bb18-6c939fe3a18a tempest-AttachVolumeNegativeTest-2056769334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55263276-7e38-4da7-bec0-7790d55b5bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:46:00 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-264e4112-ad4c-469b-bb18-6c939fe3a18a tempest-AttachVolumeNegativeTest-2056769334 None] Flow 'volume_create_manager' (416ad75c-234c-467f-83ce-3ac11287852e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:46:00 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-264e4112-ad4c-469b-bb18-6c939fe3a18a tempest-AttachVolumeNegativeTest-2056769334 None] Created volume successfully.
Jul 10 12:46:01 devstack sudo[96579]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-26072bf6-1b8b-4cdf-b95d-8f561b0f01b5 tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1659d890-c682-43b5-959d-f31a3b54e729" returned: 0 in 1.023s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-26072bf6-1b8b-4cdf-b95d-8f561b0f01b5 tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1659d890-c682-43b5-959d-f31a3b54e729.5b5a88f1-7c3e-4b7d-a401-fb22d6c5c18a {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:01 devstack sudo[96588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1659d890-c682-43b5-959d-f31a3b54e729.5b5a88f1-7c3e-4b7d-a401-fb22d6c5c18a
Jul 10 12:46:01 devstack sudo[96588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:01 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1f1fc924-42fd-4aa5-9d5f-606b072fe8af tempest-AttachVolumeTestJSON-147786180 None] Acquiring lock "cinder-9b45f049-05c4-46a9-bfc1-dd15841f8e30-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:46:01 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1f1fc924-42fd-4aa5-9d5f-606b072fe8af tempest-AttachVolumeTestJSON-147786180 None] Lock "cinder-9b45f049-05c4-46a9-bfc1-dd15841f8e30-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:46:01 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1f1fc924-42fd-4aa5-9d5f-606b072fe8af tempest-AttachVolumeTestJSON-147786180 None] Acquiring lock "cinder-quobyte-9b45f049-05c4-46a9-bfc1-dd15841f8e30" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:46:01 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1f1fc924-42fd-4aa5-9d5f-606b072fe8af tempest-AttachVolumeTestJSON-147786180 None] Lock "cinder-quobyte-9b45f049-05c4-46a9-bfc1-dd15841f8e30" acquired by "delete_volume" :: waited 0.018s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:46:01 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48c3b4a-f37e-47d1-a963-24d50ac9e75e]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:46:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1f1fc924-42fd-4aa5-9d5f-606b072fe8af tempest-AttachVolumeTestJSON-147786180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9b45f049-05c4-46a9-bfc1-dd15841f8e30 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:02 devstack sudo[96590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9b45f049-05c4-46a9-bfc1-dd15841f8e30
Jul 10 12:46:02 devstack sudo[96590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:02 devstack sudo[96588]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-26072bf6-1b8b-4cdf-b95d-8f561b0f01b5 tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1659d890-c682-43b5-959d-f31a3b54e729.5b5a88f1-7c3e-4b7d-a401-fb22d6c5c18a" returned: 0 in 0.904s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-26072bf6-1b8b-4cdf-b95d-8f561b0f01b5 tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1659d890-c682-43b5-959d-f31a3b54e729.5b5a88f1-7c3e-4b7d-a401-fb22d6c5c18a {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:02 devstack sudo[96597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1659d890-c682-43b5-959d-f31a3b54e729.5b5a88f1-7c3e-4b7d-a401-fb22d6c5c18a
Jul 10 12:46:02 devstack sudo[96597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:02 devstack sudo[96590]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1f1fc924-42fd-4aa5-9d5f-606b072fe8af tempest-AttachVolumeTestJSON-147786180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9b45f049-05c4-46a9-bfc1-dd15841f8e30" returned: 0 in 0.958s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1f1fc924-42fd-4aa5-9d5f-606b072fe8af tempest-AttachVolumeTestJSON-147786180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9b45f049-05c4-46a9-bfc1-dd15841f8e30 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:02 devstack sudo[96602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9b45f049-05c4-46a9-bfc1-dd15841f8e30
Jul 10 12:46:02 devstack sudo[96602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:03 devstack sudo[96597]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-26072bf6-1b8b-4cdf-b95d-8f561b0f01b5 tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1659d890-c682-43b5-959d-f31a3b54e729.5b5a88f1-7c3e-4b7d-a401-fb22d6c5c18a" returned: 0 in 0.769s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:03 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-26072bf6-1b8b-4cdf-b95d-8f561b0f01b5 tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Lock "cinder-quobyte-5b5a88f1-7c3e-4b7d-a401-fb22d6c5c18a" released by "_delete_snapshot" :: held 3.726s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:46:03 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-26072bf6-1b8b-4cdf-b95d-8f561b0f01b5 tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Lock "cinder-quobyte-1659d890-c682-43b5-959d-f31a3b54e729" released by "delete_snapshot" :: held 3.754s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:46:03 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-26072bf6-1b8b-4cdf-b95d-8f561b0f01b5 tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Created reservations ['68bb83a4-c67c-4c07-88d2-41b714f61ae5', '5928b4bd-6aa4-43a0-84b0-b748faa6618c', 'a208a511-50a3-4f9b-b4d2-79e7ca26fe42', '0c3c4fac-02d5-49e5-8d5f-90813f4d3dd8'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:46:03 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-26072bf6-1b8b-4cdf-b95d-8f561b0f01b5 tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Delete snapshot completed successfully.
Jul 10 12:46:03 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-26072bf6-1b8b-4cdf-b95d-8f561b0f01b5 tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Lock "cinder-5b5a88f1-7c3e-4b7d-a401-fb22d6c5c18a-delete_snapshot" released by "delete_snapshot" :: held 3.954s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:46:03 devstack sudo[96602]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1f1fc924-42fd-4aa5-9d5f-606b072fe8af tempest-AttachVolumeTestJSON-147786180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9b45f049-05c4-46a9-bfc1-dd15841f8e30" returned: 0 in 0.784s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:03 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1f1fc924-42fd-4aa5-9d5f-606b072fe8af tempest-AttachVolumeTestJSON-147786180 None] Lock "cinder-quobyte-9b45f049-05c4-46a9-bfc1-dd15841f8e30" released by "delete_volume" :: held 1.811s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:46:03 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fe005c5e-2f3f-4d6c-9db7-fbbb9de905e2 tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Acquiring lock "cinder-1659d890-c682-43b5-959d-f31a3b54e729-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:46:03 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-1f1fc924-42fd-4aa5-9d5f-606b072fe8af tempest-AttachVolumeTestJSON-147786180 None] Created reservations ['cbfdfa94-8b93-423f-bd94-86c75dee9af3', '7c5fed1f-601d-4ac2-9eeb-9a82acb63e6e', '044f317a-5ee0-46e3-badb-89700e8e7e9d', '677409c0-7235-486d-94dc-6e61907bb7cc'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:46:03 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fe005c5e-2f3f-4d6c-9db7-fbbb9de905e2 tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Lock "cinder-1659d890-c682-43b5-959d-f31a3b54e729-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:46:03 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fe005c5e-2f3f-4d6c-9db7-fbbb9de905e2 tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Acquiring lock "cinder-quobyte-1659d890-c682-43b5-959d-f31a3b54e729" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:46:03 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fe005c5e-2f3f-4d6c-9db7-fbbb9de905e2 tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Lock "cinder-quobyte-1659d890-c682-43b5-959d-f31a3b54e729" acquired by "delete_volume" :: waited 0.019s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:46:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1f1fc924-42fd-4aa5-9d5f-606b072fe8af tempest-AttachVolumeTestJSON-147786180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:46:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1f1fc924-42fd-4aa5-9d5f-606b072fe8af tempest-AttachVolumeTestJSON-147786180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:46:03 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-1f1fc924-42fd-4aa5-9d5f-606b072fe8af tempest-AttachVolumeTestJSON-147786180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:46:03 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-1f1fc924-42fd-4aa5-9d5f-606b072fe8af tempest-AttachVolumeTestJSON-147786180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:46:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1f1fc924-42fd-4aa5-9d5f-606b072fe8af tempest-AttachVolumeTestJSON-147786180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:46:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1f1fc924-42fd-4aa5-9d5f-606b072fe8af tempest-AttachVolumeTestJSON-147786180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:03 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a58f0be-2e06-419c-bece-74cc40fa62da]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:46:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fe005c5e-2f3f-4d6c-9db7-fbbb9de905e2 tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1659d890-c682-43b5-959d-f31a3b54e729 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:03 devstack sudo[96606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:46:03 devstack sudo[96606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:04 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3303cc1d-4690-4760-8e86-8943c55d2cc2 tempest-AttachVolumeTestJSON-147786180 None] Acquiring lock "cinder-bc90a237-5ec8-4ba3-a6ae-8eec705926f8-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:46:04 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3303cc1d-4690-4760-8e86-8943c55d2cc2 tempest-AttachVolumeTestJSON-147786180 None] Lock "cinder-bc90a237-5ec8-4ba3-a6ae-8eec705926f8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:46:04 devstack sudo[96607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1659d890-c682-43b5-959d-f31a3b54e729
Jul 10 12:46:04 devstack sudo[96607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:04 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3303cc1d-4690-4760-8e86-8943c55d2cc2 tempest-AttachVolumeTestJSON-147786180 None] Acquiring lock "cinder-quobyte-bc90a237-5ec8-4ba3-a6ae-8eec705926f8" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:46:04 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3303cc1d-4690-4760-8e86-8943c55d2cc2 tempest-AttachVolumeTestJSON-147786180 None] Lock "cinder-quobyte-bc90a237-5ec8-4ba3-a6ae-8eec705926f8" acquired by "delete_volume" :: waited 0.023s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:46:04 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa67d24-f242-4a69-8937-a2677a6a7890]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:46:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3303cc1d-4690-4760-8e86-8943c55d2cc2 tempest-AttachVolumeTestJSON-147786180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-bc90a237-5ec8-4ba3-a6ae-8eec705926f8 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:04 devstack sudo[96615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-bc90a237-5ec8-4ba3-a6ae-8eec705926f8
Jul 10 12:46:04 devstack sudo[96615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-c3248018-e0be-4a9c-b6c5-e0a5c4a2b025 req-42ef0a22-a329-40c6-9e28-9b396a2dbeba tempest-AttachVolumeNegativeTest-2056769334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:46:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-c3248018-e0be-4a9c-b6c5-e0a5c4a2b025 req-42ef0a22-a329-40c6-9e28-9b396a2dbeba tempest-AttachVolumeNegativeTest-2056769334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:46:04 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8acd32f-7145-41d3-a646-7e66cffab08d]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:46:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-c3248018-e0be-4a9c-b6c5-e0a5c4a2b025 req-42ef0a22-a329-40c6-9e28-9b396a2dbeba tempest-AttachVolumeNegativeTest-2056769334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4468ec21-f794-4002-9fa6-12b1269a41fd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:04 devstack sudo[96621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4468ec21-f794-4002-9fa6-12b1269a41fd
Jul 10 12:46:04 devstack sudo[96621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:04 devstack sudo[96606]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1f1fc924-42fd-4aa5-9d5f-606b072fe8af tempest-AttachVolumeTestJSON-147786180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.942s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:04 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-1f1fc924-42fd-4aa5-9d5f-606b072fe8af tempest-AttachVolumeTestJSON-147786180 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:46:04 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-1f1fc924-42fd-4aa5-9d5f-606b072fe8af tempest-AttachVolumeTestJSON-147786180 None] Deleted volume successfully.
Jul 10 12:46:04 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1f1fc924-42fd-4aa5-9d5f-606b072fe8af tempest-AttachVolumeTestJSON-147786180 None] Lock "cinder-9b45f049-05c4-46a9-bfc1-dd15841f8e30-delete_volume" released by "delete_volume" :: held 3.109s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:46:05 devstack sudo[96607]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fe005c5e-2f3f-4d6c-9db7-fbbb9de905e2 tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1659d890-c682-43b5-959d-f31a3b54e729" returned: 0 in 1.155s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fe005c5e-2f3f-4d6c-9db7-fbbb9de905e2 tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1659d890-c682-43b5-959d-f31a3b54e729 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:05 devstack sudo[96626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1659d890-c682-43b5-959d-f31a3b54e729
Jul 10 12:46:05 devstack sudo[96626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:05 devstack sudo[96615]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3303cc1d-4690-4760-8e86-8943c55d2cc2 tempest-AttachVolumeTestJSON-147786180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-bc90a237-5ec8-4ba3-a6ae-8eec705926f8" returned: 0 in 1.255s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3303cc1d-4690-4760-8e86-8943c55d2cc2 tempest-AttachVolumeTestJSON-147786180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-bc90a237-5ec8-4ba3-a6ae-8eec705926f8 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:05 devstack sudo[96632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-bc90a237-5ec8-4ba3-a6ae-8eec705926f8
Jul 10 12:46:05 devstack sudo[96632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:05 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-add84597-2d03-40cf-a34a-42f462b61ea1 tempest-VolumesCloneTest-225611865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:46:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-add84597-2d03-40cf-a34a-42f462b61ea1 tempest-VolumesCloneTest-225611865 None] Flow 'volume_create_manager' (de497146-e8bf-4ffe-8d22-a7208b768316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:46:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-add84597-2d03-40cf-a34a-42f462b61ea1 tempest-VolumesCloneTest-225611865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aa8739c-61e9-412d-b140-d25a34cc0e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:46:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-add84597-2d03-40cf-a34a-42f462b61ea1 tempest-VolumesCloneTest-225611865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aa8739c-61e9-412d-b140-d25a34cc0e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-68682155',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d10716c-e12c-4cc6-936d-452e775e9d11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24b98000d01c4c1494e1971dd467b043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:46:05Z,use_quota=True,user_id='34381f7ad3b043a4bb10396c738c8022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:46:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-add84597-2d03-40cf-a34a-42f462b61ea1 tempest-VolumesCloneTest-225611865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02314060-65e3-4c24-885f-2fd54e121cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:46:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-add84597-2d03-40cf-a34a-42f462b61ea1 tempest-VolumesCloneTest-225611865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02314060-65e3-4c24-885f-2fd54e121cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:46:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-add84597-2d03-40cf-a34a-42f462b61ea1 tempest-VolumesCloneTest-225611865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50e5df3f-0bfe-4daf-8655-9fe3d01a548f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:46:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-add84597-2d03-40cf-a34a-42f462b61ea1 tempest-VolumesCloneTest-225611865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50e5df3f-0bfe-4daf-8655-9fe3d01a548f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d10716c-e12c-4cc6-936d-452e775e9d11', 'volume_name': 'volume-0d10716c-e12c-4cc6-936d-452e775e9d11', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:46:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-add84597-2d03-40cf-a34a-42f462b61ea1 tempest-VolumesCloneTest-225611865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0218cb9-af5d-4a60-a7b3-e901fe5e8e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:46:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-add84597-2d03-40cf-a34a-42f462b61ea1 tempest-VolumesCloneTest-225611865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0218cb9-af5d-4a60-a7b3-e901fe5e8e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:46:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-add84597-2d03-40cf-a34a-42f462b61ea1 tempest-VolumesCloneTest-225611865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15bb6750-e9e5-4f77-b5b6-d463addb6d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:46:05 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-add84597-2d03-40cf-a34a-42f462b61ea1 tempest-VolumesCloneTest-225611865 None] Volume 0d10716c-e12c-4cc6-936d-452e775e9d11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d10716c-e12c-4cc6-936d-452e775e9d11', 'volume_size': 1}
Jul 10 12:46:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-add84597-2d03-40cf-a34a-42f462b61ea1 tempest-VolumesCloneTest-225611865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:46:05 devstack sudo[96621]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-c3248018-e0be-4a9c-b6c5-e0a5c4a2b025 req-42ef0a22-a329-40c6-9e28-9b396a2dbeba tempest-AttachVolumeNegativeTest-2056769334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4468ec21-f794-4002-9fa6-12b1269a41fd" returned: 0 in 1.107s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-c3248018-e0be-4a9c-b6c5-e0a5c4a2b025 req-42ef0a22-a329-40c6-9e28-9b396a2dbeba tempest-AttachVolumeNegativeTest-2056769334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.141s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:46:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-add84597-2d03-40cf-a34a-42f462b61ea1 tempest-VolumesCloneTest-225611865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.077s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:46:05 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-add84597-2d03-40cf-a34a-42f462b61ea1 tempest-VolumesCloneTest-225611865 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-68682155',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d10716c-e12c-4cc6-936d-452e775e9d11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24b98000d01c4c1494e1971dd467b043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:46:05Z,use_quota=True,user_id='34381f7ad3b043a4bb10396c738c8022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:46:05 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-add84597-2d03-40cf-a34a-42f462b61ea1 tempest-VolumesCloneTest-225611865 None] Creating volume 0d10716c-e12c-4cc6-936d-452e775e9d11 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:46:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-add84597-2d03-40cf-a34a-42f462b61ea1 tempest-VolumesCloneTest-225611865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:46:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-add84597-2d03-40cf-a34a-42f462b61ea1 tempest-VolumesCloneTest-225611865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:46:05 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-add84597-2d03-40cf-a34a-42f462b61ea1 tempest-VolumesCloneTest-225611865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:46:05 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-add84597-2d03-40cf-a34a-42f462b61ea1 tempest-VolumesCloneTest-225611865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:46:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-add84597-2d03-40cf-a34a-42f462b61ea1 tempest-VolumesCloneTest-225611865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:46:05 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-add84597-2d03-40cf-a34a-42f462b61ea1 tempest-VolumesCloneTest-225611865 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:46:05 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-add84597-2d03-40cf-a34a-42f462b61ea1 tempest-VolumesCloneTest-225611865 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:46:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-add84597-2d03-40cf-a34a-42f462b61ea1 tempest-VolumesCloneTest-225611865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:05 devstack sudo[96636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11 1073741824
Jul 10 12:46:05 devstack sudo[96636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-c3248018-e0be-4a9c-b6c5-e0a5c4a2b025 req-42ef0a22-a329-40c6-9e28-9b396a2dbeba tempest-AttachVolumeNegativeTest-2056769334 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be', 'name': 'volume-4468ec21-f794-4002-9fa6-12b1269a41fd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1d6935ed-c6d7-44e4-a9b1-a13db45e0d40', 'enforce_multipath': True} {{(pid=87378) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 10 12:46:05 devstack cinder-volume[87378]: INFO cinder.volume.manager [req-c3248018-e0be-4a9c-b6c5-e0a5c4a2b025 req-42ef0a22-a329-40c6-9e28-9b396a2dbeba tempest-AttachVolumeNegativeTest-2056769334 None] attachment_update completed successfully.
Jul 10 12:46:05 devstack sudo[96626]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fe005c5e-2f3f-4d6c-9db7-fbbb9de905e2 tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1659d890-c682-43b5-959d-f31a3b54e729" returned: 0 in 0.889s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:05 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fe005c5e-2f3f-4d6c-9db7-fbbb9de905e2 tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Lock "cinder-quobyte-1659d890-c682-43b5-959d-f31a3b54e729" released by "delete_volume" :: held 2.129s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:46:06 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-fe005c5e-2f3f-4d6c-9db7-fbbb9de905e2 tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Created reservations ['3d0ba8b2-4e88-45d9-853d-0e41718e8eb7', '95812632-1003-45d3-8203-ed62c87739f9', '94631949-85be-4f59-a9c5-4b5edefe91f3', '8f629b9f-dafc-4703-84fc-a35d30d4d7e9'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:46:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-fe005c5e-2f3f-4d6c-9db7-fbbb9de905e2 tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:46:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-fe005c5e-2f3f-4d6c-9db7-fbbb9de905e2 tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:46:06 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-fe005c5e-2f3f-4d6c-9db7-fbbb9de905e2 tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:46:06 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-fe005c5e-2f3f-4d6c-9db7-fbbb9de905e2 tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:46:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-fe005c5e-2f3f-4d6c-9db7-fbbb9de905e2 tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:46:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fe005c5e-2f3f-4d6c-9db7-fbbb9de905e2 tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:06 devstack sudo[96639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:46:06 devstack sudo[96639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:06 devstack sudo[96632]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3303cc1d-4690-4760-8e86-8943c55d2cc2 tempest-AttachVolumeTestJSON-147786180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-bc90a237-5ec8-4ba3-a6ae-8eec705926f8" returned: 0 in 0.790s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:06 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3303cc1d-4690-4760-8e86-8943c55d2cc2 tempest-AttachVolumeTestJSON-147786180 None] Lock "cinder-quobyte-bc90a237-5ec8-4ba3-a6ae-8eec705926f8" released by "delete_volume" :: held 2.127s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:46:06 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-3303cc1d-4690-4760-8e86-8943c55d2cc2 tempest-AttachVolumeTestJSON-147786180 None] Created reservations ['9e5fe56b-d747-483b-8217-64fb6d1c1250', '6501cbc1-5e96-40b4-8667-05af0fe81678', 'c815b3e1-819f-4b77-9c17-461c03789dab', '5f1c525f-4a5f-4298-acc4-724d947b8ad6'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:46:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3303cc1d-4690-4760-8e86-8943c55d2cc2 tempest-AttachVolumeTestJSON-147786180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:46:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3303cc1d-4690-4760-8e86-8943c55d2cc2 tempest-AttachVolumeTestJSON-147786180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:46:06 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3303cc1d-4690-4760-8e86-8943c55d2cc2 tempest-AttachVolumeTestJSON-147786180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:46:06 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3303cc1d-4690-4760-8e86-8943c55d2cc2 tempest-AttachVolumeTestJSON-147786180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:46:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3303cc1d-4690-4760-8e86-8943c55d2cc2 tempest-AttachVolumeTestJSON-147786180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:46:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3303cc1d-4690-4760-8e86-8943c55d2cc2 tempest-AttachVolumeTestJSON-147786180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:06 devstack sudo[96712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:46:06 devstack sudo[96712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:06 devstack sudo[96636]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-add84597-2d03-40cf-a34a-42f462b61ea1 tempest-VolumesCloneTest-225611865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11 1073741824" returned: 0 in 1.061s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-add84597-2d03-40cf-a34a-42f462b61ea1 tempest-VolumesCloneTest-225611865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:06 devstack sudo[96715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11
Jul 10 12:46:06 devstack sudo[96715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:07 devstack sudo[96639]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fe005c5e-2f3f-4d6c-9db7-fbbb9de905e2 tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.966s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:07 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-fe005c5e-2f3f-4d6c-9db7-fbbb9de905e2 tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:46:07 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-fe005c5e-2f3f-4d6c-9db7-fbbb9de905e2 tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Deleted volume successfully.
Jul 10 12:46:07 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fe005c5e-2f3f-4d6c-9db7-fbbb9de905e2 tempest-VolumesSnapshotNegativeTestJSON-1402712808 None] Lock "cinder-1659d890-c682-43b5-959d-f31a3b54e729-delete_volume" released by "delete_volume" :: held 3.353s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:46:07 devstack sudo[96712]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3303cc1d-4690-4760-8e86-8943c55d2cc2 tempest-AttachVolumeTestJSON-147786180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.843s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:07 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-3303cc1d-4690-4760-8e86-8943c55d2cc2 tempest-AttachVolumeTestJSON-147786180 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:46:07 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-3303cc1d-4690-4760-8e86-8943c55d2cc2 tempest-AttachVolumeTestJSON-147786180 None] Deleted volume successfully.
Jul 10 12:46:07 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3303cc1d-4690-4760-8e86-8943c55d2cc2 tempest-AttachVolumeTestJSON-147786180 None] Lock "cinder-bc90a237-5ec8-4ba3-a6ae-8eec705926f8-delete_volume" released by "delete_volume" :: held 3.293s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:46:07 devstack sudo[96715]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-add84597-2d03-40cf-a34a-42f462b61ea1 tempest-VolumesCloneTest-225611865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11" returned: 0 in 0.870s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:07 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-add84597-2d03-40cf-a34a-42f462b61ea1 tempest-VolumesCloneTest-225611865 None] <== create_volume: return (1990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:46:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-add84597-2d03-40cf-a34a-42f462b61ea1 tempest-VolumesCloneTest-225611865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.993s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:46:07 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-aa111b17-b5e2-4599-bd9b-a6420b93c363 tempest-AttachVolumeTestJSON-147786180 None] Acquiring lock "cinder-05610419-79c8-4382-9398-7b2a419247fe-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:46:07 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-add84597-2d03-40cf-a34a-42f462b61ea1 tempest-VolumesCloneTest-225611865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15bb6750-e9e5-4f77-b5b6-d463addb6d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d10716c-e12c-4cc6-936d-452e775e9d11', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:46:07 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-add84597-2d03-40cf-a34a-42f462b61ea1 tempest-VolumesCloneTest-225611865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c07d7862-37ab-49f3-b15e-50ce5c4eff42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:46:07 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-aa111b17-b5e2-4599-bd9b-a6420b93c363 tempest-AttachVolumeTestJSON-147786180 None] Lock "cinder-05610419-79c8-4382-9398-7b2a419247fe-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:46:07 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-add84597-2d03-40cf-a34a-42f462b61ea1 tempest-VolumesCloneTest-225611865 None] Volume volume-0d10716c-e12c-4cc6-936d-452e775e9d11 (0d10716c-e12c-4cc6-936d-452e775e9d11): created successfully
Jul 10 12:46:07 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-add84597-2d03-40cf-a34a-42f462b61ea1 tempest-VolumesCloneTest-225611865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c07d7862-37ab-49f3-b15e-50ce5c4eff42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:46:07 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-add84597-2d03-40cf-a34a-42f462b61ea1 tempest-VolumesCloneTest-225611865 None] Flow 'volume_create_manager' (de497146-e8bf-4ffe-8d22-a7208b768316) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:46:07 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-add84597-2d03-40cf-a34a-42f462b61ea1 tempest-VolumesCloneTest-225611865 None] Created volume successfully.
Jul 10 12:46:07 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-aa111b17-b5e2-4599-bd9b-a6420b93c363 tempest-AttachVolumeTestJSON-147786180 None] Acquiring lock "cinder-quobyte-05610419-79c8-4382-9398-7b2a419247fe" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:46:07 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-aa111b17-b5e2-4599-bd9b-a6420b93c363 tempest-AttachVolumeTestJSON-147786180 None] Lock "cinder-quobyte-05610419-79c8-4382-9398-7b2a419247fe" acquired by "delete_volume" :: waited 0.016s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:46:07 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5559f6-7b0d-44aa-ad25-000d1a3792e2]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:46:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-aa111b17-b5e2-4599-bd9b-a6420b93c363 tempest-AttachVolumeTestJSON-147786180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-05610419-79c8-4382-9398-7b2a419247fe {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:08 devstack sudo[97035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-05610419-79c8-4382-9398-7b2a419247fe
Jul 10 12:46:08 devstack sudo[97035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:08 devstack sudo[97035]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-aa111b17-b5e2-4599-bd9b-a6420b93c363 tempest-AttachVolumeTestJSON-147786180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-05610419-79c8-4382-9398-7b2a419247fe" returned: 0 in 0.807s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-aa111b17-b5e2-4599-bd9b-a6420b93c363 tempest-AttachVolumeTestJSON-147786180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-05610419-79c8-4382-9398-7b2a419247fe {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:08 devstack sudo[97040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-05610419-79c8-4382-9398-7b2a419247fe
Jul 10 12:46:08 devstack sudo[97040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:09 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:46:09 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Flow 'volume_create_manager' (f8c018d4-5ddc-4f6c-8b33-a79cc2373051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:46:09 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1b6454c-54a0-4d05-9f68-babec826674f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:46:09 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1b6454c-54a0-4d05-9f68-babec826674f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1105337602',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2c865bc-078c-435b-8ec7-09aced0b9f85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24b98000d01c4c1494e1971dd467b043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:46:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=0d10716c-e12c-4cc6-936d-452e775e9d11,status='creating',terminated_at=None,updated_at=2026-07-10T10:46:09Z,use_quota=True,user_id='34381f7ad3b043a4bb10396c738c8022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:46:09 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b0e54f9-9f01-4473-87fb-f264d7c4b32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:46:09 devstack sudo[97040]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:09 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b0e54f9-9f01-4473-87fb-f264d7c4b32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:46:09 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdef1fb2-c52d-421c-812c-c259dc875915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:46:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-aa111b17-b5e2-4599-bd9b-a6420b93c363 tempest-AttachVolumeTestJSON-147786180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-05610419-79c8-4382-9398-7b2a419247fe" returned: 0 in 0.745s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:09 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-aa111b17-b5e2-4599-bd9b-a6420b93c363 tempest-AttachVolumeTestJSON-147786180 None] Lock "cinder-quobyte-05610419-79c8-4382-9398-7b2a419247fe" released by "delete_volume" :: held 1.616s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:46:09 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdef1fb2-c52d-421c-812c-c259dc875915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'a2c865bc-078c-435b-8ec7-09aced0b9f85', 'volume_name': 'volume-a2c865bc-078c-435b-8ec7-09aced0b9f85', 'volume_size': 2, 'source_volid': '0d10716c-e12c-4cc6-936d-452e775e9d11', 'source_volstatus': 'available'}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:46:09 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8f954f7-9f8d-49ec-a3d6-30e03bc6d780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:46:09 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8f954f7-9f8d-49ec-a3d6-30e03bc6d780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:46:09 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08d2cf17-6523-4983-bf7d-0bbeb9ea1e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:46:09 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Volume a2c865bc-078c-435b-8ec7-09aced0b9f85: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-a2c865bc-078c-435b-8ec7-09aced0b9f85', 'volume_size': 2, 'source_volid': '0d10716c-e12c-4cc6-936d-452e775e9d11', 'source_volstatus': 'available'}
Jul 10 12:46:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:46:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:46:09 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Cloning volume 0d10716c-e12c-4cc6-936d-452e775e9d11 to volume a2c865bc-078c-435b-8ec7-09aced0b9f85
Jul 10 12:46:09 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Creating offline snapshot bd9fd2f8-1d39-43ce-b8ee-4f4b89d12013 of volume 0d10716c-e12c-4cc6-936d-452e775e9d11 {{(pid=87378) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 10 12:46:09 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-aa111b17-b5e2-4599-bd9b-a6420b93c363 tempest-AttachVolumeTestJSON-147786180 None] Created reservations ['169871c6-aa1a-45ed-92ac-7feef782ec35', '0d8c94b3-7d71-4020-bf73-681f6b11b52b', '5aae842a-b185-43fa-b436-b7789a183550', '90eb1f24-7380-40fe-b6a8-f5c0e05ef8ae'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:46:09 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe20050-f267-47c7-b4a1-9ef086484300]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:46:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-aa111b17-b5e2-4599-bd9b-a6420b93c363 tempest-AttachVolumeTestJSON-147786180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:46:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-aa111b17-b5e2-4599-bd9b-a6420b93c363 tempest-AttachVolumeTestJSON-147786180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:46:09 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-aa111b17-b5e2-4599-bd9b-a6420b93c363 tempest-AttachVolumeTestJSON-147786180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:46:09 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-aa111b17-b5e2-4599-bd9b-a6420b93c363 tempest-AttachVolumeTestJSON-147786180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:46:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-aa111b17-b5e2-4599-bd9b-a6420b93c363 tempest-AttachVolumeTestJSON-147786180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:46:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-aa111b17-b5e2-4599-bd9b-a6420b93c363 tempest-AttachVolumeTestJSON-147786180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:09 devstack sudo[97044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11
Jul 10 12:46:09 devstack sudo[97044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:09 devstack sudo[97045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:46:09 devstack sudo[97045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:10 devstack sudo[97045]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-aa111b17-b5e2-4599-bd9b-a6420b93c363 tempest-AttachVolumeTestJSON-147786180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.713s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:10 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-aa111b17-b5e2-4599-bd9b-a6420b93c363 tempest-AttachVolumeTestJSON-147786180 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:46:10 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-aa111b17-b5e2-4599-bd9b-a6420b93c363 tempest-AttachVolumeTestJSON-147786180 None] Deleted volume successfully.
Jul 10 12:46:10 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-aa111b17-b5e2-4599-bd9b-a6420b93c363 tempest-AttachVolumeTestJSON-147786180 None] Lock "cinder-05610419-79c8-4382-9398-7b2a419247fe-delete_volume" released by "delete_volume" :: held 2.689s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:46:10 devstack sudo[97044]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11" returned: 0 in 1.208s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11.bd9fd2f8-1d39-43ce-b8ee-4f4b89d12013 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:10 devstack sudo[97052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11.bd9fd2f8-1d39-43ce-b8ee-4f4b89d12013 1G
Jul 10 12:46:10 devstack sudo[97052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:11 devstack sudo[97052]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11.bd9fd2f8-1d39-43ce-b8ee-4f4b89d12013 1G" returned: 0 in 1.086s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d10716c-e12c-4cc6-936d-452e775e9d11 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11.bd9fd2f8-1d39-43ce-b8ee-4f4b89d12013 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:11 devstack sudo[97059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d10716c-e12c-4cc6-936d-452e775e9d11 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11.bd9fd2f8-1d39-43ce-b8ee-4f4b89d12013
Jul 10 12:46:11 devstack sudo[97059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:12 devstack sudo[97059]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d10716c-e12c-4cc6-936d-452e775e9d11 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11.bd9fd2f8-1d39-43ce-b8ee-4f4b89d12013" returned: 0 in 0.867s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:12 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11.bd9fd2f8-1d39-43ce-b8ee-4f4b89d12013 is being set with open permissions: ugo+rw
Jul 10 12:46:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11.bd9fd2f8-1d39-43ce-b8ee-4f4b89d12013 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:12 devstack sudo[97064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11.bd9fd2f8-1d39-43ce-b8ee-4f4b89d12013
Jul 10 12:46:12 devstack sudo[97064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:12 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:46:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:46:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:46:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:46:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:46:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:46:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:13 devstack sudo[97093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:46:13 devstack sudo[97093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:13 devstack cinder-volume[87378]: INFO cinder.volume.manager [req-33d69ca8-d254-47fe-a718-95775d1216b6 req-156011b0-ce1d-4ec6-8ee2-846ee9680b4a tempest-AttachVolumeNegativeTest-2056769334 None] Terminate volume connection completed successfully.
Jul 10 12:46:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-33d69ca8-d254-47fe-a718-95775d1216b6 req-156011b0-ce1d-4ec6-8ee2-846ee9680b4a tempest-AttachVolumeNegativeTest-2056769334 None] Deleting attachment 1d6935ed-c6d7-44e4-a9b1-a13db45e0d40. {{(pid=87378) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 10 12:46:13 devstack sudo[97093]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.827s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:13 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:46:13 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager._thread_info {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:46:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread count: 28 {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 10 12:46:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread info: [<_MainThread(MainThread, started 128233544536192)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128233445424704)>, <Thread(Thread-3 (stat_writer), started daemon 128233435118528)>, <Thread(Rabbit-heartbeat, started daemon 128233435718016)>, <Thread(Thread-5 (_runner), started daemon 128233432624448)>, <Thread(Thread-7 (_runner), started daemon 128233432674688)>, <Thread(fd_logger, started daemon 128233428569472)>, <Thread(privsep_reader, started daemon 128233429417088)>, <Thread(tpool_thread_0, started daemon 128233421182656)>, <Thread(tpool_thread_1, started daemon 128233412789952)>, <Thread(tpool_thread_2, started daemon 128233404397248)>, <Thread(tpool_thread_3, started daemon 128233396004544)>, <Thread(tpool_thread_4, started daemon 128233387611840)>, <Thread(tpool_thread_5, started daemon 128233379219136)>, <Thread(tpool_thread_6, started daemon 128233370826432)>, <Thread(tpool_thread_7, started daemon 128233362433728)>, <Thread(tpool_thread_8, started daemon 128233354041024)>, <Thread(tpool_thread_9, started daemon 128233345631936)>, <Thread(tpool_thread_10, started daemon 128233337222848)>, <Thread(tpool_thread_11, started daemon 128233328813760)>, <Thread(tpool_thread_12, started daemon 128233320404672)>, <Thread(tpool_thread_13, started daemon 128233311995584)>, <Thread(tpool_thread_14, started daemon 128233303586496)>, <Thread(tpool_thread_15, started daemon 128233295177408)>, <Thread(tpool_thread_16, started daemon 128233286768320)>, <Thread(tpool_thread_17, started daemon 128233278359232)>, <Thread(tpool_thread_18, started daemon 128233269950144)>, <Thread(tpool_thread_19, started daemon 128233261541056)>] {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 10 12:46:13 devstack sudo[97064]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11.bd9fd2f8-1d39-43ce-b8ee-4f4b89d12013" returned: 0 in 1.071s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:13 devstack sudo[97097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11.info
Jul 10 12:46:13 devstack sudo[97097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:14 devstack sudo[97097]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11.info" returned: 0 in 0.680s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:14 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11.info is being set with open permissions: ugo+rw
Jul 10 12:46:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:14 devstack sudo[97100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11.info
Jul 10 12:46:14 devstack sudo[97100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:15 devstack sudo[97100]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11.info" returned: 0 in 0.986s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:15 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Acquiring lock "cinder-quobyte-a2c865bc-078c-435b-8ec7-09aced0b9f85" by "_copy_volume_from_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:46:15 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Lock "cinder-quobyte-a2c865bc-078c-435b-8ec7-09aced0b9f85" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:46:15 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] snapshot: bd9fd2f8-1d39-43ce-b8ee-4f4b89d12013, volume: a2c865bc-078c-435b-8ec7-09aced0b9f85,  {{(pid=87378) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 10 12:46:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:46:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:46:15 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:46:15 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:46:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:46:15 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e04d0f2-bbbc-4f3a-9ec2-7affb455b255]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:46:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11.bd9fd2f8-1d39-43ce-b8ee-4f4b89d12013 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:15 devstack sudo[97104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11.bd9fd2f8-1d39-43ce-b8ee-4f4b89d12013
Jul 10 12:46:15 devstack sudo[97104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:16 devstack sudo[97104]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11.bd9fd2f8-1d39-43ce-b8ee-4f4b89d12013" returned: 0 in 0.963s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:16 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d10716c-e12c-4cc6-936d-452e775e9d11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:46:16 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] will copy from snapshot at /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11 {{(pid=87378) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 10 12:46:16 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Creating direct copy from snapshot {{(pid=87378) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 10 12:46:16 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d902cf39-b3ee-4df4-a215-eb4f5c486c2e]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:46:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:16 devstack sudo[97114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11
Jul 10 12:46:16 devstack sudo[97114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:17 devstack sudo[97114]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11" returned: 0 in 1.173s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:17 devstack cinder-volume[87378]: DEBUG cinder.utils [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Path /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a2c865bc-078c-435b-8ec7-09aced0b9f85 not found in is_blk_device check {{(pid=87378) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 10 12:46:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a2c865bc-078c-435b-8ec7-09aced0b9f85 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:17 devstack sudo[97134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a2c865bc-078c-435b-8ec7-09aced0b9f85
Jul 10 12:46:17 devstack sudo[97134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:19 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [req-5836c111-bc5f-4649-bd29-44c5561cd9c2 req-d2caf280-5871-451d-8563-a75d5298d3ab tempest-VolumesSnapshotsTestJSON-1436766851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:46:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-5836c111-bc5f-4649-bd29-44c5561cd9c2 req-d2caf280-5871-451d-8563-a75d5298d3ab tempest-VolumesSnapshotsTestJSON-1436766851 None] Flow 'volume_create_manager' (f0ab0e65-0463-4e22-922a-d84d2324a0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:46:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-5836c111-bc5f-4649-bd29-44c5561cd9c2 req-d2caf280-5871-451d-8563-a75d5298d3ab tempest-VolumesSnapshotsTestJSON-1436766851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d940bad-4da0-4473-932d-3fe2cc528b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:46:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-5836c111-bc5f-4649-bd29-44c5561cd9c2 req-d2caf280-5871-451d-8563-a75d5298d3ab tempest-VolumesSnapshotsTestJSON-1436766851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d940bad-4da0-4473-932d-3fe2cc528b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-987783702',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=742da4b4-58d8-4372-940e-f9ea10d9961c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cd0de563e274484a34a90edc3fd54b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:46:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:46:20Z,use_quota=True,user_id='bef060cac78d4b3ea843a6436cf9c684',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:46:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-5836c111-bc5f-4649-bd29-44c5561cd9c2 req-d2caf280-5871-451d-8563-a75d5298d3ab tempest-VolumesSnapshotsTestJSON-1436766851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6718114-f9bf-43ee-b36e-5f5d2ab739aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:46:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-5836c111-bc5f-4649-bd29-44c5561cd9c2 req-d2caf280-5871-451d-8563-a75d5298d3ab tempest-VolumesSnapshotsTestJSON-1436766851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6718114-f9bf-43ee-b36e-5f5d2ab739aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:46:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-5836c111-bc5f-4649-bd29-44c5561cd9c2 req-d2caf280-5871-451d-8563-a75d5298d3ab tempest-VolumesSnapshotsTestJSON-1436766851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23cf0053-d307-4756-8536-d1d70d20001e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:46:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-5836c111-bc5f-4649-bd29-44c5561cd9c2 req-d2caf280-5871-451d-8563-a75d5298d3ab tempest-VolumesSnapshotsTestJSON-1436766851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23cf0053-d307-4756-8536-d1d70d20001e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '742da4b4-58d8-4372-940e-f9ea10d9961c', 'volume_name': 'volume-742da4b4-58d8-4372-940e-f9ea10d9961c', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:46:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-5836c111-bc5f-4649-bd29-44c5561cd9c2 req-d2caf280-5871-451d-8563-a75d5298d3ab tempest-VolumesSnapshotsTestJSON-1436766851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6a1d64a-baa3-4dbf-a962-b8aaa6fd5d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:46:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-5836c111-bc5f-4649-bd29-44c5561cd9c2 req-d2caf280-5871-451d-8563-a75d5298d3ab tempest-VolumesSnapshotsTestJSON-1436766851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6a1d64a-baa3-4dbf-a962-b8aaa6fd5d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:46:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-5836c111-bc5f-4649-bd29-44c5561cd9c2 req-d2caf280-5871-451d-8563-a75d5298d3ab tempest-VolumesSnapshotsTestJSON-1436766851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d97272e-b745-4f96-b554-ededf80f28a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:46:19 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [req-5836c111-bc5f-4649-bd29-44c5561cd9c2 req-d2caf280-5871-451d-8563-a75d5298d3ab tempest-VolumesSnapshotsTestJSON-1436766851 None] Volume 742da4b4-58d8-4372-940e-f9ea10d9961c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-742da4b4-58d8-4372-940e-f9ea10d9961c', 'volume_size': 1}
Jul 10 12:46:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-5836c111-bc5f-4649-bd29-44c5561cd9c2 req-d2caf280-5871-451d-8563-a75d5298d3ab tempest-VolumesSnapshotsTestJSON-1436766851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:46:24 devstack sudo[97134]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a2c865bc-078c-435b-8ec7-09aced0b9f85" returned: 0 in 6.657s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:24 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f991fa93-01f8-42f4-afdd-b6b7c83060a7]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:46:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:24 devstack sudo[97190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11
Jul 10 12:46:24 devstack sudo[97190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:25 devstack sudo[97190]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11" returned: 0 in 1.109s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:25 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Image conversion details: src /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11, size 1024.00 MB, duration 6.66 sec, destination /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a2c865bc-078c-435b-8ec7-09aced0b9f85 {{(pid=87378) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 10 12:46:25 devstack cinder-volume[87378]: INFO cinder.image.image_utils [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Converted 1024.00 MB image at 153.80 MB/s
Jul 10 12:46:25 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a2c865bc-078c-435b-8ec7-09aced0b9f85 is being set with open permissions: ugo+rw
Jul 10 12:46:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a2c865bc-078c-435b-8ec7-09aced0b9f85 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:25 devstack sudo[97196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a2c865bc-078c-435b-8ec7-09aced0b9f85
Jul 10 12:46:25 devstack sudo[97196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:26 devstack sudo[97196]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a2c865bc-078c-435b-8ec7-09aced0b9f85" returned: 0 in 0.758s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:26 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Lock "cinder-quobyte-a2c865bc-078c-435b-8ec7-09aced0b9f85" released by "_copy_volume_from_snapshot" :: held 10.779s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:46:26 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Acquiring lock "cinder-quobyte-bd9fd2f8-1d39-43ce-b8ee-4f4b89d12013" by "_delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:46:26 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Lock "cinder-quobyte-bd9fd2f8-1d39-43ce-b8ee-4f4b89d12013" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:46:26 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Deleting offline snapshot bd9fd2f8-1d39-43ce-b8ee-4f4b89d12013 of volume 0d10716c-e12c-4cc6-936d-452e775e9d11 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 10 12:46:26 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] snapshot_file for this snap is: volume-0d10716c-e12c-4cc6-936d-452e775e9d11.bd9fd2f8-1d39-43ce-b8ee-4f4b89d12013 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 10 12:46:26 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f24785-9966-470a-bd7e-d5e27db11a72]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:46:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11.bd9fd2f8-1d39-43ce-b8ee-4f4b89d12013 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:26 devstack sudo[97199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11.bd9fd2f8-1d39-43ce-b8ee-4f4b89d12013
Jul 10 12:46:26 devstack sudo[97199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:27 devstack sudo[97199]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11.bd9fd2f8-1d39-43ce-b8ee-4f4b89d12013" returned: 0 in 0.873s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:27 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d10716c-e12c-4cc6-936d-452e775e9d11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:46:27 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84a5301-fd9e-45d8-a136-efcc86405b3a]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:46:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:27 devstack sudo[97204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11
Jul 10 12:46:27 devstack sudo[97204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:28 devstack sudo[97204]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11" returned: 0 in 0.910s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11.bd9fd2f8-1d39-43ce-b8ee-4f4b89d12013 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:28 devstack sudo[97209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11.bd9fd2f8-1d39-43ce-b8ee-4f4b89d12013
Jul 10 12:46:28 devstack sudo[97209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:29 devstack sudo[97209]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11.bd9fd2f8-1d39-43ce-b8ee-4f4b89d12013" returned: 0 in 0.819s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11.bd9fd2f8-1d39-43ce-b8ee-4f4b89d12013 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:29 devstack sudo[97216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11.bd9fd2f8-1d39-43ce-b8ee-4f4b89d12013
Jul 10 12:46:29 devstack sudo[97216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:29 devstack sudo[97216]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11.bd9fd2f8-1d39-43ce-b8ee-4f4b89d12013" returned: 0 in 0.679s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:29 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Lock "cinder-quobyte-bd9fd2f8-1d39-43ce-b8ee-4f4b89d12013" released by "_delete_snapshot" :: held 3.397s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:46:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.295s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:46:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-5836c111-bc5f-4649-bd29-44c5561cd9c2 req-d2caf280-5871-451d-8563-a75d5298d3ab tempest-VolumesSnapshotsTestJSON-1436766851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.824s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:46:29 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [req-5836c111-bc5f-4649-bd29-44c5561cd9c2 req-d2caf280-5871-451d-8563-a75d5298d3ab tempest-VolumesSnapshotsTestJSON-1436766851 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-987783702',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=742da4b4-58d8-4372-940e-f9ea10d9961c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cd0de563e274484a34a90edc3fd54b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:46:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:46:20Z,use_quota=True,user_id='bef060cac78d4b3ea843a6436cf9c684',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:46:29 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [req-5836c111-bc5f-4649-bd29-44c5561cd9c2 req-d2caf280-5871-451d-8563-a75d5298d3ab tempest-VolumesSnapshotsTestJSON-1436766851 None] Creating volume 742da4b4-58d8-4372-940e-f9ea10d9961c {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:46:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-5836c111-bc5f-4649-bd29-44c5561cd9c2 req-d2caf280-5871-451d-8563-a75d5298d3ab tempest-VolumesSnapshotsTestJSON-1436766851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:46:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-5836c111-bc5f-4649-bd29-44c5561cd9c2 req-d2caf280-5871-451d-8563-a75d5298d3ab tempest-VolumesSnapshotsTestJSON-1436766851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:46:29 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [req-5836c111-bc5f-4649-bd29-44c5561cd9c2 req-d2caf280-5871-451d-8563-a75d5298d3ab tempest-VolumesSnapshotsTestJSON-1436766851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:46:29 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [req-5836c111-bc5f-4649-bd29-44c5561cd9c2 req-d2caf280-5871-451d-8563-a75d5298d3ab tempest-VolumesSnapshotsTestJSON-1436766851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:46:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-5836c111-bc5f-4649-bd29-44c5561cd9c2 req-d2caf280-5871-451d-8563-a75d5298d3ab tempest-VolumesSnapshotsTestJSON-1436766851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:46:29 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [req-5836c111-bc5f-4649-bd29-44c5561cd9c2 req-d2caf280-5871-451d-8563-a75d5298d3ab tempest-VolumesSnapshotsTestJSON-1436766851 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:46:29 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [req-5836c111-bc5f-4649-bd29-44c5561cd9c2 req-d2caf280-5871-451d-8563-a75d5298d3ab tempest-VolumesSnapshotsTestJSON-1436766851 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:46:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-5836c111-bc5f-4649-bd29-44c5561cd9c2 req-d2caf280-5871-451d-8563-a75d5298d3ab tempest-VolumesSnapshotsTestJSON-1436766851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-742da4b4-58d8-4372-940e-f9ea10d9961c 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:29 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08d2cf17-6523-4983-bf7d-0bbeb9ea1e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2c865bc-078c-435b-8ec7-09aced0b9f85', 'volume_size': 2, 'source_volid': '0d10716c-e12c-4cc6-936d-452e775e9d11', 'source_volstatus': 'available'}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:46:29 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdfdbbaf-8421-4be7-b951-2fecfd7de16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:46:29 devstack sudo[97219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-742da4b4-58d8-4372-940e-f9ea10d9961c 1073741824
Jul 10 12:46:29 devstack sudo[97219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:29 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Volume volume-a2c865bc-078c-435b-8ec7-09aced0b9f85 (a2c865bc-078c-435b-8ec7-09aced0b9f85): created successfully
Jul 10 12:46:29 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdfdbbaf-8421-4be7-b951-2fecfd7de16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:46:29 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Flow 'volume_create_manager' (f8c018d4-5ddc-4f6c-8b33-a79cc2373051) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:46:29 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-10c07753-3ef0-4a8d-8335-4ee6b50cb140 tempest-VolumesCloneTest-225611865 None] Created volume successfully.
Jul 10 12:46:30 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-2be4d507-6320-4463-a05d-1e3209c59d22 tempest-VolumesCloneTest-225611865 None] Acquiring lock "cinder-a2c865bc-078c-435b-8ec7-09aced0b9f85-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:46:30 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-2be4d507-6320-4463-a05d-1e3209c59d22 tempest-VolumesCloneTest-225611865 None] Lock "cinder-a2c865bc-078c-435b-8ec7-09aced0b9f85-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:46:30 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:UPDATE=66,cinder:SELECT=64,cinder:DELETE=5,cinder:INSERT=12 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:46:30 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:SELECT=59,cinder:UPDATE=65,cinder:INSERT=19,cinder:DELETE=5 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:46:30 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-2be4d507-6320-4463-a05d-1e3209c59d22 tempest-VolumesCloneTest-225611865 None] Acquiring lock "cinder-quobyte-a2c865bc-078c-435b-8ec7-09aced0b9f85" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:46:30 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-2be4d507-6320-4463-a05d-1e3209c59d22 tempest-VolumesCloneTest-225611865 None] Lock "cinder-quobyte-a2c865bc-078c-435b-8ec7-09aced0b9f85" acquired by "delete_volume" :: waited 0.024s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:46:30 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8a2613-d34f-4a3f-bc0b-063de63d86ae]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:46:30 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2be4d507-6320-4463-a05d-1e3209c59d22 tempest-VolumesCloneTest-225611865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a2c865bc-078c-435b-8ec7-09aced0b9f85 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:30 devstack sudo[97219]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:30 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-5836c111-bc5f-4649-bd29-44c5561cd9c2 req-d2caf280-5871-451d-8563-a75d5298d3ab tempest-VolumesSnapshotsTestJSON-1436766851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-742da4b4-58d8-4372-940e-f9ea10d9961c 1073741824" returned: 0 in 1.147s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-5836c111-bc5f-4649-bd29-44c5561cd9c2 req-d2caf280-5871-451d-8563-a75d5298d3ab tempest-VolumesSnapshotsTestJSON-1436766851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-742da4b4-58d8-4372-940e-f9ea10d9961c {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:31 devstack sudo[97228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a2c865bc-078c-435b-8ec7-09aced0b9f85
Jul 10 12:46:31 devstack sudo[97228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:31 devstack sudo[97230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-742da4b4-58d8-4372-940e-f9ea10d9961c
Jul 10 12:46:31 devstack sudo[97230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:31 devstack sudo[97230]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-5836c111-bc5f-4649-bd29-44c5561cd9c2 req-d2caf280-5871-451d-8563-a75d5298d3ab tempest-VolumesSnapshotsTestJSON-1436766851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-742da4b4-58d8-4372-940e-f9ea10d9961c" returned: 0 in 0.798s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:31 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [req-5836c111-bc5f-4649-bd29-44c5561cd9c2 req-d2caf280-5871-451d-8563-a75d5298d3ab tempest-VolumesSnapshotsTestJSON-1436766851 None] <== create_volume: return (2003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:46:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-5836c111-bc5f-4649-bd29-44c5561cd9c2 req-d2caf280-5871-451d-8563-a75d5298d3ab tempest-VolumesSnapshotsTestJSON-1436766851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:46:31 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-5836c111-bc5f-4649-bd29-44c5561cd9c2 req-d2caf280-5871-451d-8563-a75d5298d3ab tempest-VolumesSnapshotsTestJSON-1436766851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d97272e-b745-4f96-b554-ededf80f28a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-742da4b4-58d8-4372-940e-f9ea10d9961c', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:46:31 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-5836c111-bc5f-4649-bd29-44c5561cd9c2 req-d2caf280-5871-451d-8563-a75d5298d3ab tempest-VolumesSnapshotsTestJSON-1436766851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (781bc55e-5415-468f-ba50-c92ceff4cba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:46:31 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [req-5836c111-bc5f-4649-bd29-44c5561cd9c2 req-d2caf280-5871-451d-8563-a75d5298d3ab tempest-VolumesSnapshotsTestJSON-1436766851 None] Volume volume-742da4b4-58d8-4372-940e-f9ea10d9961c (742da4b4-58d8-4372-940e-f9ea10d9961c): created successfully
Jul 10 12:46:31 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-5836c111-bc5f-4649-bd29-44c5561cd9c2 req-d2caf280-5871-451d-8563-a75d5298d3ab tempest-VolumesSnapshotsTestJSON-1436766851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (781bc55e-5415-468f-ba50-c92ceff4cba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:46:31 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-5836c111-bc5f-4649-bd29-44c5561cd9c2 req-d2caf280-5871-451d-8563-a75d5298d3ab tempest-VolumesSnapshotsTestJSON-1436766851 None] Flow 'volume_create_manager' (f0ab0e65-0463-4e22-922a-d84d2324a0c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:46:31 devstack cinder-volume[87378]: INFO cinder.volume.manager [req-5836c111-bc5f-4649-bd29-44c5561cd9c2 req-d2caf280-5871-451d-8563-a75d5298d3ab tempest-VolumesSnapshotsTestJSON-1436766851 None] Created volume successfully.
Jul 10 12:46:32 devstack sudo[97228]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2be4d507-6320-4463-a05d-1e3209c59d22 tempest-VolumesCloneTest-225611865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a2c865bc-078c-435b-8ec7-09aced0b9f85" returned: 0 in 1.195s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2be4d507-6320-4463-a05d-1e3209c59d22 tempest-VolumesCloneTest-225611865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a2c865bc-078c-435b-8ec7-09aced0b9f85 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:32 devstack sudo[97236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a2c865bc-078c-435b-8ec7-09aced0b9f85
Jul 10 12:46:32 devstack sudo[97236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:32 devstack sudo[97236]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2be4d507-6320-4463-a05d-1e3209c59d22 tempest-VolumesCloneTest-225611865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a2c865bc-078c-435b-8ec7-09aced0b9f85" returned: 0 in 0.694s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:32 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-2be4d507-6320-4463-a05d-1e3209c59d22 tempest-VolumesCloneTest-225611865 None] Lock "cinder-quobyte-a2c865bc-078c-435b-8ec7-09aced0b9f85" released by "delete_volume" :: held 1.940s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:46:32 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-2be4d507-6320-4463-a05d-1e3209c59d22 tempest-VolumesCloneTest-225611865 None] Created reservations ['e3b9575b-8307-495d-8e50-94c8fa9b36f6', '82a69909-a31d-4697-9770-bc695a9e8407', '0e479697-3a74-4d55-ac8f-5b604f88935e', 'fb630b26-57bb-4f06-8e43-2d421512f784'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:46:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2be4d507-6320-4463-a05d-1e3209c59d22 tempest-VolumesCloneTest-225611865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:46:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2be4d507-6320-4463-a05d-1e3209c59d22 tempest-VolumesCloneTest-225611865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:46:33 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-2be4d507-6320-4463-a05d-1e3209c59d22 tempest-VolumesCloneTest-225611865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:46:33 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-2be4d507-6320-4463-a05d-1e3209c59d22 tempest-VolumesCloneTest-225611865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:46:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2be4d507-6320-4463-a05d-1e3209c59d22 tempest-VolumesCloneTest-225611865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:46:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2be4d507-6320-4463-a05d-1e3209c59d22 tempest-VolumesCloneTest-225611865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:33 devstack sudo[97239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:46:33 devstack sudo[97239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-f0b10a8b-965f-4317-bb40-9ad58440c544 req-095934e0-3825-4fa6-a75d-bef3c75f1958 tempest-VolumesSnapshotsTestJSON-1436766851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:46:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-f0b10a8b-965f-4317-bb40-9ad58440c544 req-095934e0-3825-4fa6-a75d-bef3c75f1958 tempest-VolumesSnapshotsTestJSON-1436766851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:46:33 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [req-f0b10a8b-965f-4317-bb40-9ad58440c544 req-095934e0-3825-4fa6-a75d-bef3c75f1958 tempest-VolumesSnapshotsTestJSON-1436766851 None] Creating offline snapshot 0db4816b-41da-47e5-af85-75665d1cc0bc of volume 742da4b4-58d8-4372-940e-f9ea10d9961c {{(pid=87378) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 10 12:46:33 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-a00a8396-0611-4c37-8b10-5e197b601d6f tempest-VolumesCloneTest-225611865 None] Acquiring lock "cinder-0d10716c-e12c-4cc6-936d-452e775e9d11-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:46:33 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a97e3c-9679-4ea6-bbca-7b7d040fa693]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:46:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-f0b10a8b-965f-4317-bb40-9ad58440c544 req-095934e0-3825-4fa6-a75d-bef3c75f1958 tempest-VolumesSnapshotsTestJSON-1436766851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-742da4b4-58d8-4372-940e-f9ea10d9961c {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:33 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-a00a8396-0611-4c37-8b10-5e197b601d6f tempest-VolumesCloneTest-225611865 None] Lock "cinder-0d10716c-e12c-4cc6-936d-452e775e9d11-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:46:33 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-a00a8396-0611-4c37-8b10-5e197b601d6f tempest-VolumesCloneTest-225611865 None] Acquiring lock "cinder-quobyte-0d10716c-e12c-4cc6-936d-452e775e9d11" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:46:33 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-a00a8396-0611-4c37-8b10-5e197b601d6f tempest-VolumesCloneTest-225611865 None] Lock "cinder-quobyte-0d10716c-e12c-4cc6-936d-452e775e9d11" acquired by "delete_volume" :: waited 0.028s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:46:33 devstack sudo[97241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-742da4b4-58d8-4372-940e-f9ea10d9961c
Jul 10 12:46:33 devstack sudo[97241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:33 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22e1c9f-fbc4-4e75-8b67-7cd664f622c1]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:46:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a00a8396-0611-4c37-8b10-5e197b601d6f tempest-VolumesCloneTest-225611865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:33 devstack sudo[97243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11
Jul 10 12:46:33 devstack sudo[97243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:34 devstack sudo[97239]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2be4d507-6320-4463-a05d-1e3209c59d22 tempest-VolumesCloneTest-225611865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.998s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:34 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-2be4d507-6320-4463-a05d-1e3209c59d22 tempest-VolumesCloneTest-225611865 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:46:34 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-2be4d507-6320-4463-a05d-1e3209c59d22 tempest-VolumesCloneTest-225611865 None] Deleted volume successfully.
Jul 10 12:46:34 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-2be4d507-6320-4463-a05d-1e3209c59d22 tempest-VolumesCloneTest-225611865 None] Lock "cinder-a2c865bc-078c-435b-8ec7-09aced0b9f85-delete_volume" released by "delete_volume" :: held 3.338s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:46:34 devstack sudo[97241]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-f0b10a8b-965f-4317-bb40-9ad58440c544 req-095934e0-3825-4fa6-a75d-bef3c75f1958 tempest-VolumesSnapshotsTestJSON-1436766851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-742da4b4-58d8-4372-940e-f9ea10d9961c" returned: 0 in 1.351s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-f0b10a8b-965f-4317-bb40-9ad58440c544 req-095934e0-3825-4fa6-a75d-bef3c75f1958 tempest-VolumesSnapshotsTestJSON-1436766851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-742da4b4-58d8-4372-940e-f9ea10d9961c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-742da4b4-58d8-4372-940e-f9ea10d9961c.0db4816b-41da-47e5-af85-75665d1cc0bc 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:34 devstack sudo[97259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-742da4b4-58d8-4372-940e-f9ea10d9961c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-742da4b4-58d8-4372-940e-f9ea10d9961c.0db4816b-41da-47e5-af85-75665d1cc0bc 1G
Jul 10 12:46:34 devstack sudo[97259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:34 devstack sudo[97243]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a00a8396-0611-4c37-8b10-5e197b601d6f tempest-VolumesCloneTest-225611865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11" returned: 0 in 1.261s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a00a8396-0611-4c37-8b10-5e197b601d6f tempest-VolumesCloneTest-225611865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:34 devstack sudo[97261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11
Jul 10 12:46:34 devstack sudo[97261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:35 devstack sudo[97259]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-f0b10a8b-965f-4317-bb40-9ad58440c544 req-095934e0-3825-4fa6-a75d-bef3c75f1958 tempest-VolumesSnapshotsTestJSON-1436766851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-742da4b4-58d8-4372-940e-f9ea10d9961c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-742da4b4-58d8-4372-940e-f9ea10d9961c.0db4816b-41da-47e5-af85-75665d1cc0bc 1G" returned: 0 in 1.120s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-f0b10a8b-965f-4317-bb40-9ad58440c544 req-095934e0-3825-4fa6-a75d-bef3c75f1958 tempest-VolumesSnapshotsTestJSON-1436766851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-742da4b4-58d8-4372-940e-f9ea10d9961c -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-742da4b4-58d8-4372-940e-f9ea10d9961c.0db4816b-41da-47e5-af85-75665d1cc0bc {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:35 devstack sudo[97268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-742da4b4-58d8-4372-940e-f9ea10d9961c -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-742da4b4-58d8-4372-940e-f9ea10d9961c.0db4816b-41da-47e5-af85-75665d1cc0bc
Jul 10 12:46:35 devstack sudo[97268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:35 devstack sudo[97261]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a00a8396-0611-4c37-8b10-5e197b601d6f tempest-VolumesCloneTest-225611865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0d10716c-e12c-4cc6-936d-452e775e9d11" returned: 0 in 0.975s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:35 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-a00a8396-0611-4c37-8b10-5e197b601d6f tempest-VolumesCloneTest-225611865 None] Lock "cinder-quobyte-0d10716c-e12c-4cc6-936d-452e775e9d11" released by "delete_volume" :: held 2.350s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:46:35 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-a00a8396-0611-4c37-8b10-5e197b601d6f tempest-VolumesCloneTest-225611865 None] Created reservations ['3345c392-efe1-403a-ab37-939ad442b06f', 'b13bff08-3527-45a3-85be-c02712067b8d', '91aff882-a3a5-4f40-a403-bc0f83dd32a8', '52fbceb1-d3b0-452a-8661-70a52a98ad69'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:46:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a00a8396-0611-4c37-8b10-5e197b601d6f tempest-VolumesCloneTest-225611865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:46:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a00a8396-0611-4c37-8b10-5e197b601d6f tempest-VolumesCloneTest-225611865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:46:35 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-a00a8396-0611-4c37-8b10-5e197b601d6f tempest-VolumesCloneTest-225611865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:46:35 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-a00a8396-0611-4c37-8b10-5e197b601d6f tempest-VolumesCloneTest-225611865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:46:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a00a8396-0611-4c37-8b10-5e197b601d6f tempest-VolumesCloneTest-225611865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:46:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a00a8396-0611-4c37-8b10-5e197b601d6f tempest-VolumesCloneTest-225611865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:36 devstack sudo[97270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:46:36 devstack sudo[97270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:36 devstack sudo[97268]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-f0b10a8b-965f-4317-bb40-9ad58440c544 req-095934e0-3825-4fa6-a75d-bef3c75f1958 tempest-VolumesSnapshotsTestJSON-1436766851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-742da4b4-58d8-4372-940e-f9ea10d9961c -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-742da4b4-58d8-4372-940e-f9ea10d9961c.0db4816b-41da-47e5-af85-75665d1cc0bc" returned: 0 in 1.056s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:36 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [req-f0b10a8b-965f-4317-bb40-9ad58440c544 req-095934e0-3825-4fa6-a75d-bef3c75f1958 tempest-VolumesSnapshotsTestJSON-1436766851 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-742da4b4-58d8-4372-940e-f9ea10d9961c.0db4816b-41da-47e5-af85-75665d1cc0bc is being set with open permissions: ugo+rw
Jul 10 12:46:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-f0b10a8b-965f-4317-bb40-9ad58440c544 req-095934e0-3825-4fa6-a75d-bef3c75f1958 tempest-VolumesSnapshotsTestJSON-1436766851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-742da4b4-58d8-4372-940e-f9ea10d9961c.0db4816b-41da-47e5-af85-75665d1cc0bc {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:36 devstack sudo[97275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-742da4b4-58d8-4372-940e-f9ea10d9961c.0db4816b-41da-47e5-af85-75665d1cc0bc
Jul 10 12:46:36 devstack sudo[97275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:37 devstack sudo[97270]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a00a8396-0611-4c37-8b10-5e197b601d6f tempest-VolumesCloneTest-225611865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 1.170s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:37 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-a00a8396-0611-4c37-8b10-5e197b601d6f tempest-VolumesCloneTest-225611865 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:46:37 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-a00a8396-0611-4c37-8b10-5e197b601d6f tempest-VolumesCloneTest-225611865 None] Deleted volume successfully.
Jul 10 12:46:37 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-a00a8396-0611-4c37-8b10-5e197b601d6f tempest-VolumesCloneTest-225611865 None] Lock "cinder-0d10716c-e12c-4cc6-936d-452e775e9d11-delete_volume" released by "delete_volume" :: held 3.966s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:46:37 devstack sudo[97275]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-f0b10a8b-965f-4317-bb40-9ad58440c544 req-095934e0-3825-4fa6-a75d-bef3c75f1958 tempest-VolumesSnapshotsTestJSON-1436766851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-742da4b4-58d8-4372-940e-f9ea10d9961c.0db4816b-41da-47e5-af85-75665d1cc0bc" returned: 0 in 1.052s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-f0b10a8b-965f-4317-bb40-9ad58440c544 req-095934e0-3825-4fa6-a75d-bef3c75f1958 tempest-VolumesSnapshotsTestJSON-1436766851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-742da4b4-58d8-4372-940e-f9ea10d9961c.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:37 devstack sudo[97293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-742da4b4-58d8-4372-940e-f9ea10d9961c.info
Jul 10 12:46:37 devstack sudo[97293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:38 devstack sudo[97293]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-f0b10a8b-965f-4317-bb40-9ad58440c544 req-095934e0-3825-4fa6-a75d-bef3c75f1958 tempest-VolumesSnapshotsTestJSON-1436766851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-742da4b4-58d8-4372-940e-f9ea10d9961c.info" returned: 0 in 1.020s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:38 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [req-f0b10a8b-965f-4317-bb40-9ad58440c544 req-095934e0-3825-4fa6-a75d-bef3c75f1958 tempest-VolumesSnapshotsTestJSON-1436766851 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-742da4b4-58d8-4372-940e-f9ea10d9961c.info is being set with open permissions: ugo+rw
Jul 10 12:46:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-f0b10a8b-965f-4317-bb40-9ad58440c544 req-095934e0-3825-4fa6-a75d-bef3c75f1958 tempest-VolumesSnapshotsTestJSON-1436766851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-742da4b4-58d8-4372-940e-f9ea10d9961c.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:38 devstack sudo[97300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-742da4b4-58d8-4372-940e-f9ea10d9961c.info
Jul 10 12:46:38 devstack sudo[97300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:39 devstack sudo[97300]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-f0b10a8b-965f-4317-bb40-9ad58440c544 req-095934e0-3825-4fa6-a75d-bef3c75f1958 tempest-VolumesSnapshotsTestJSON-1436766851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-742da4b4-58d8-4372-940e-f9ea10d9961c.info" returned: 0 in 0.812s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-f0b10a8b-965f-4317-bb40-9ad58440c544 req-095934e0-3825-4fa6-a75d-bef3c75f1958 tempest-VolumesSnapshotsTestJSON-1436766851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.623s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:46:39 devstack cinder-volume[87378]: INFO cinder.volume.manager [req-f0b10a8b-965f-4317-bb40-9ad58440c544 req-095934e0-3825-4fa6-a75d-bef3c75f1958 tempest-VolumesSnapshotsTestJSON-1436766851 None] Create snapshot completed successfully
Jul 10 12:46:40 devstack cinder-volume[87378]: DEBUG cinder.coordination [req-f31a85fd-00fe-4ad3-b909-f25a40d3d2dc req-6f5fc8b8-cf41-4885-9a84-3ea4989d2d41 tempest-VolumesSnapshotsTestJSON-1436766851 None] Acquiring lock "cinder-0db4816b-41da-47e5-af85-75665d1cc0bc-delete_snapshot" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:46:40 devstack cinder-volume[87378]: DEBUG cinder.coordination [req-f31a85fd-00fe-4ad3-b909-f25a40d3d2dc req-6f5fc8b8-cf41-4885-9a84-3ea4989d2d41 tempest-VolumesSnapshotsTestJSON-1436766851 None] Lock "cinder-0db4816b-41da-47e5-af85-75665d1cc0bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:46:40 devstack cinder-volume[87378]: DEBUG cinder.coordination [req-f31a85fd-00fe-4ad3-b909-f25a40d3d2dc req-6f5fc8b8-cf41-4885-9a84-3ea4989d2d41 tempest-VolumesSnapshotsTestJSON-1436766851 None] Acquiring lock "cinder-quobyte-742da4b4-58d8-4372-940e-f9ea10d9961c" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:46:40 devstack cinder-volume[87378]: DEBUG cinder.coordination [req-f31a85fd-00fe-4ad3-b909-f25a40d3d2dc req-6f5fc8b8-cf41-4885-9a84-3ea4989d2d41 tempest-VolumesSnapshotsTestJSON-1436766851 None] Lock "cinder-quobyte-742da4b4-58d8-4372-940e-f9ea10d9961c" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:46:40 devstack cinder-volume[87378]: DEBUG cinder.coordination [req-f31a85fd-00fe-4ad3-b909-f25a40d3d2dc req-6f5fc8b8-cf41-4885-9a84-3ea4989d2d41 tempest-VolumesSnapshotsTestJSON-1436766851 None] Acquiring lock "cinder-quobyte-0db4816b-41da-47e5-af85-75665d1cc0bc" by "_delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:46:40 devstack cinder-volume[87378]: DEBUG cinder.coordination [req-f31a85fd-00fe-4ad3-b909-f25a40d3d2dc req-6f5fc8b8-cf41-4885-9a84-3ea4989d2d41 tempest-VolumesSnapshotsTestJSON-1436766851 None] Lock "cinder-quobyte-0db4816b-41da-47e5-af85-75665d1cc0bc" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:46:40 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [req-f31a85fd-00fe-4ad3-b909-f25a40d3d2dc req-6f5fc8b8-cf41-4885-9a84-3ea4989d2d41 tempest-VolumesSnapshotsTestJSON-1436766851 None] Deleting offline snapshot 0db4816b-41da-47e5-af85-75665d1cc0bc of volume 742da4b4-58d8-4372-940e-f9ea10d9961c {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 10 12:46:40 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [req-f31a85fd-00fe-4ad3-b909-f25a40d3d2dc req-6f5fc8b8-cf41-4885-9a84-3ea4989d2d41 tempest-VolumesSnapshotsTestJSON-1436766851 None] snapshot_file for this snap is: volume-742da4b4-58d8-4372-940e-f9ea10d9961c.0db4816b-41da-47e5-af85-75665d1cc0bc {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 10 12:46:40 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a4b2f4-85ea-4ff1-9636-e70b24caab19]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:46:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-f31a85fd-00fe-4ad3-b909-f25a40d3d2dc req-6f5fc8b8-cf41-4885-9a84-3ea4989d2d41 tempest-VolumesSnapshotsTestJSON-1436766851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-742da4b4-58d8-4372-940e-f9ea10d9961c.0db4816b-41da-47e5-af85-75665d1cc0bc {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:40 devstack sudo[97303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-742da4b4-58d8-4372-940e-f9ea10d9961c.0db4816b-41da-47e5-af85-75665d1cc0bc
Jul 10 12:46:40 devstack sudo[97303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:41 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fb4e621-9cf5-4e53-ad10-0ba94529344a tempest-VolumesSnapshotListTestJSON-2038328188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:46:41 devstack sudo[97303]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2fb4e621-9cf5-4e53-ad10-0ba94529344a tempest-VolumesSnapshotListTestJSON-2038328188 None] Flow 'volume_create_manager' (368ebbea-2951-4c70-8aa8-ac2ab9ccb402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:46:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2fb4e621-9cf5-4e53-ad10-0ba94529344a tempest-VolumesSnapshotListTestJSON-2038328188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91759465-ad5d-4db8-9655-c5a68a2dc4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:46:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-f31a85fd-00fe-4ad3-b909-f25a40d3d2dc req-6f5fc8b8-cf41-4885-9a84-3ea4989d2d41 tempest-VolumesSnapshotsTestJSON-1436766851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-742da4b4-58d8-4372-940e-f9ea10d9961c.0db4816b-41da-47e5-af85-75665d1cc0bc" returned: 0 in 1.031s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:41 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [req-f31a85fd-00fe-4ad3-b909-f25a40d3d2dc req-6f5fc8b8-cf41-4885-9a84-3ea4989d2d41 tempest-VolumesSnapshotsTestJSON-1436766851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-742da4b4-58d8-4372-940e-f9ea10d9961c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:46:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2fb4e621-9cf5-4e53-ad10-0ba94529344a tempest-VolumesSnapshotListTestJSON-2038328188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91759465-ad5d-4db8-9655-c5a68a2dc4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-45610647',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=439b54a3-8776-4fd8-a15f-f023a799caf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50820d0002e542ecaee8b0efd1919d81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:46:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:46:41Z,use_quota=True,user_id='6db17aebff0e4166ba6ee229a91b017e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:46:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2fb4e621-9cf5-4e53-ad10-0ba94529344a tempest-VolumesSnapshotListTestJSON-2038328188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3632eee3-923c-4a80-aa29-9ee877058a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:46:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2fb4e621-9cf5-4e53-ad10-0ba94529344a tempest-VolumesSnapshotListTestJSON-2038328188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3632eee3-923c-4a80-aa29-9ee877058a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:46:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2fb4e621-9cf5-4e53-ad10-0ba94529344a tempest-VolumesSnapshotListTestJSON-2038328188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adf8af5a-2cf0-43e7-8e92-22ce300a79ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:46:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2fb4e621-9cf5-4e53-ad10-0ba94529344a tempest-VolumesSnapshotListTestJSON-2038328188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adf8af5a-2cf0-43e7-8e92-22ce300a79ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '439b54a3-8776-4fd8-a15f-f023a799caf4', 'volume_name': 'volume-439b54a3-8776-4fd8-a15f-f023a799caf4', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:46:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2fb4e621-9cf5-4e53-ad10-0ba94529344a tempest-VolumesSnapshotListTestJSON-2038328188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a6c47dd-d132-476c-8d5a-a3e706c94e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:46:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2fb4e621-9cf5-4e53-ad10-0ba94529344a tempest-VolumesSnapshotListTestJSON-2038328188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a6c47dd-d132-476c-8d5a-a3e706c94e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:46:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2fb4e621-9cf5-4e53-ad10-0ba94529344a tempest-VolumesSnapshotListTestJSON-2038328188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b7f8954-876c-4921-a796-b251dd30012f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:46:41 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-2fb4e621-9cf5-4e53-ad10-0ba94529344a tempest-VolumesSnapshotListTestJSON-2038328188 None] Volume 439b54a3-8776-4fd8-a15f-f023a799caf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-439b54a3-8776-4fd8-a15f-f023a799caf4', 'volume_size': 1}
Jul 10 12:46:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2fb4e621-9cf5-4e53-ad10-0ba94529344a tempest-VolumesSnapshotListTestJSON-2038328188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:46:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2fb4e621-9cf5-4e53-ad10-0ba94529344a tempest-VolumesSnapshotListTestJSON-2038328188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:46:41 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-2fb4e621-9cf5-4e53-ad10-0ba94529344a tempest-VolumesSnapshotListTestJSON-2038328188 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-45610647',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=439b54a3-8776-4fd8-a15f-f023a799caf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50820d0002e542ecaee8b0efd1919d81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:46:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:46:41Z,use_quota=True,user_id='6db17aebff0e4166ba6ee229a91b017e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:46:41 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-2fb4e621-9cf5-4e53-ad10-0ba94529344a tempest-VolumesSnapshotListTestJSON-2038328188 None] Creating volume 439b54a3-8776-4fd8-a15f-f023a799caf4 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:46:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2fb4e621-9cf5-4e53-ad10-0ba94529344a tempest-VolumesSnapshotListTestJSON-2038328188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:46:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2fb4e621-9cf5-4e53-ad10-0ba94529344a tempest-VolumesSnapshotListTestJSON-2038328188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:46:41 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-2fb4e621-9cf5-4e53-ad10-0ba94529344a tempest-VolumesSnapshotListTestJSON-2038328188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:46:41 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-2fb4e621-9cf5-4e53-ad10-0ba94529344a tempest-VolumesSnapshotListTestJSON-2038328188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:46:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2fb4e621-9cf5-4e53-ad10-0ba94529344a tempest-VolumesSnapshotListTestJSON-2038328188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:46:41 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-2fb4e621-9cf5-4e53-ad10-0ba94529344a tempest-VolumesSnapshotListTestJSON-2038328188 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:46:41 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-2fb4e621-9cf5-4e53-ad10-0ba94529344a tempest-VolumesSnapshotListTestJSON-2038328188 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:46:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2fb4e621-9cf5-4e53-ad10-0ba94529344a tempest-VolumesSnapshotListTestJSON-2038328188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:41 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b61705-ec8b-400e-b2ba-9a51a4d8cc9e]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:46:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-f31a85fd-00fe-4ad3-b909-f25a40d3d2dc req-6f5fc8b8-cf41-4885-9a84-3ea4989d2d41 tempest-VolumesSnapshotsTestJSON-1436766851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-742da4b4-58d8-4372-940e-f9ea10d9961c {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:41 devstack sudo[97309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4 1073741824
Jul 10 12:46:41 devstack sudo[97309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:41 devstack sudo[97310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-742da4b4-58d8-4372-940e-f9ea10d9961c
Jul 10 12:46:41 devstack sudo[97310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:42 devstack sudo[97310]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-f31a85fd-00fe-4ad3-b909-f25a40d3d2dc req-6f5fc8b8-cf41-4885-9a84-3ea4989d2d41 tempest-VolumesSnapshotsTestJSON-1436766851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-742da4b4-58d8-4372-940e-f9ea10d9961c" returned: 0 in 1.074s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-f31a85fd-00fe-4ad3-b909-f25a40d3d2dc req-6f5fc8b8-cf41-4885-9a84-3ea4989d2d41 tempest-VolumesSnapshotsTestJSON-1436766851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-742da4b4-58d8-4372-940e-f9ea10d9961c.0db4816b-41da-47e5-af85-75665d1cc0bc {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:42 devstack sudo[97354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-742da4b4-58d8-4372-940e-f9ea10d9961c.0db4816b-41da-47e5-af85-75665d1cc0bc
Jul 10 12:46:42 devstack sudo[97354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:42 devstack sudo[97309]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2fb4e621-9cf5-4e53-ad10-0ba94529344a tempest-VolumesSnapshotListTestJSON-2038328188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4 1073741824" returned: 0 in 1.346s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2fb4e621-9cf5-4e53-ad10-0ba94529344a tempest-VolumesSnapshotListTestJSON-2038328188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:43 devstack sudo[97362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4
Jul 10 12:46:43 devstack sudo[97362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:43 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-acf83a2b-c087-426b-8c6d-d2527a7b1592 tempest-TestInstancesWithCinderVolumes-1856690417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:46:43 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-acf83a2b-c087-426b-8c6d-d2527a7b1592 tempest-TestInstancesWithCinderVolumes-1856690417 None] Flow 'volume_create_manager' (6b719d8d-1df4-414a-8915-18d065a29ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:46:43 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-acf83a2b-c087-426b-8c6d-d2527a7b1592 tempest-TestInstancesWithCinderVolumes-1856690417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (068fd0cb-04f3-46e6-801f-2b7e17f2fad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:46:43 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-acf83a2b-c087-426b-8c6d-d2527a7b1592 tempest-TestInstancesWithCinderVolumes-1856690417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (068fd0cb-04f3-46e6-801f-2b7e17f2fad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1932961912',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c741089-5750-4ff2-8fc1-c35c4c3f864c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9729aa3cc134c0c92a18a8304f91182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:46:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:46:43Z,use_quota=True,user_id='a8874fcca20a401ab71d0885cc4d3031',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a4e3d33-2329-4155-92ae-5d78094d0109),volume_type_id=7a4e3d33-2329-4155-92ae-5d78094d0109)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:46:43 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-acf83a2b-c087-426b-8c6d-d2527a7b1592 tempest-TestInstancesWithCinderVolumes-1856690417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (562777ab-77ae-4184-b5c8-d4df75b967e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:46:43 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-acf83a2b-c087-426b-8c6d-d2527a7b1592 tempest-TestInstancesWithCinderVolumes-1856690417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (562777ab-77ae-4184-b5c8-d4df75b967e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:46:43 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-acf83a2b-c087-426b-8c6d-d2527a7b1592 tempest-TestInstancesWithCinderVolumes-1856690417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b0a3399-81b9-4640-85a2-1d3d9bfdf9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:46:43 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-acf83a2b-c087-426b-8c6d-d2527a7b1592 tempest-TestInstancesWithCinderVolumes-1856690417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b0a3399-81b9-4640-85a2-1d3d9bfdf9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c741089-5750-4ff2-8fc1-c35c4c3f864c', 'volume_name': 'volume-8c741089-5750-4ff2-8fc1-c35c4c3f864c', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:46:43 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-acf83a2b-c087-426b-8c6d-d2527a7b1592 tempest-TestInstancesWithCinderVolumes-1856690417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d005c89-b8df-484e-b2ec-f65bf71afbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:46:43 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-acf83a2b-c087-426b-8c6d-d2527a7b1592 tempest-TestInstancesWithCinderVolumes-1856690417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d005c89-b8df-484e-b2ec-f65bf71afbe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:46:43 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-acf83a2b-c087-426b-8c6d-d2527a7b1592 tempest-TestInstancesWithCinderVolumes-1856690417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e34bf299-fb8a-47e6-a420-75627287763e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:46:43 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-acf83a2b-c087-426b-8c6d-d2527a7b1592 tempest-TestInstancesWithCinderVolumes-1856690417 None] Volume 8c741089-5750-4ff2-8fc1-c35c4c3f864c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c741089-5750-4ff2-8fc1-c35c4c3f864c', 'volume_size': 1}
Jul 10 12:46:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-acf83a2b-c087-426b-8c6d-d2527a7b1592 tempest-TestInstancesWithCinderVolumes-1856690417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:46:43 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-e416256e-1faa-4248-8736-68dade3a911f tempest-TestInstancesWithCinderVolumes-1856690417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:46:43 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e416256e-1faa-4248-8736-68dade3a911f tempest-TestInstancesWithCinderVolumes-1856690417 None] Flow 'volume_create_manager' (c6cced56-3c48-41e0-98a7-62ddc13b046c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:46:43 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e416256e-1faa-4248-8736-68dade3a911f tempest-TestInstancesWithCinderVolumes-1856690417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ce77d7b-81b5-4673-a5d6-5aaa45a3ec02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:46:43 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e416256e-1faa-4248-8736-68dade3a911f tempest-TestInstancesWithCinderVolumes-1856690417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ce77d7b-81b5-4673-a5d6-5aaa45a3ec02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-759569421',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f208719-4a9a-4626-b1dd-f867d44e13e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9729aa3cc134c0c92a18a8304f91182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:46:44Z,use_quota=True,user_id='a8874fcca20a401ab71d0885cc4d3031',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cd507720-660a-4a81-b995-7e490831eb34),volume_type_id=cd507720-660a-4a81-b995-7e490831eb34)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:46:43 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e416256e-1faa-4248-8736-68dade3a911f tempest-TestInstancesWithCinderVolumes-1856690417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46e2da42-593d-4b8d-867b-3a9fa82e3b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:46:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e416256e-1faa-4248-8736-68dade3a911f tempest-TestInstancesWithCinderVolumes-1856690417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46e2da42-593d-4b8d-867b-3a9fa82e3b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:46:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e416256e-1faa-4248-8736-68dade3a911f tempest-TestInstancesWithCinderVolumes-1856690417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9e8a713-910f-47a0-ab14-9e503e1441ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:46:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e416256e-1faa-4248-8736-68dade3a911f tempest-TestInstancesWithCinderVolumes-1856690417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9e8a713-910f-47a0-ab14-9e503e1441ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f208719-4a9a-4626-b1dd-f867d44e13e3', 'volume_name': 'volume-6f208719-4a9a-4626-b1dd-f867d44e13e3', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:46:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e416256e-1faa-4248-8736-68dade3a911f tempest-TestInstancesWithCinderVolumes-1856690417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fa12e6b-411a-457b-8c55-e2577acd1d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:46:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e416256e-1faa-4248-8736-68dade3a911f tempest-TestInstancesWithCinderVolumes-1856690417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fa12e6b-411a-457b-8c55-e2577acd1d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:46:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e416256e-1faa-4248-8736-68dade3a911f tempest-TestInstancesWithCinderVolumes-1856690417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f39da1a-9fa1-4539-b8aa-9547eb792f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:46:44 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-e416256e-1faa-4248-8736-68dade3a911f tempest-TestInstancesWithCinderVolumes-1856690417 None] Volume 6f208719-4a9a-4626-b1dd-f867d44e13e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f208719-4a9a-4626-b1dd-f867d44e13e3', 'volume_size': 1}
Jul 10 12:46:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e416256e-1faa-4248-8736-68dade3a911f tempest-TestInstancesWithCinderVolumes-1856690417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:46:44 devstack sudo[97354]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-f31a85fd-00fe-4ad3-b909-f25a40d3d2dc req-6f5fc8b8-cf41-4885-9a84-3ea4989d2d41 tempest-VolumesSnapshotsTestJSON-1436766851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-742da4b4-58d8-4372-940e-f9ea10d9961c.0db4816b-41da-47e5-af85-75665d1cc0bc" returned: 0 in 1.350s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-f31a85fd-00fe-4ad3-b909-f25a40d3d2dc req-6f5fc8b8-cf41-4885-9a84-3ea4989d2d41 tempest-VolumesSnapshotsTestJSON-1436766851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-742da4b4-58d8-4372-940e-f9ea10d9961c.0db4816b-41da-47e5-af85-75665d1cc0bc {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:44 devstack sudo[97362]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2fb4e621-9cf5-4e53-ad10-0ba94529344a tempest-VolumesSnapshotListTestJSON-2038328188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4" returned: 0 in 1.042s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:44 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-2fb4e621-9cf5-4e53-ad10-0ba94529344a tempest-VolumesSnapshotListTestJSON-2038328188 None] <== create_volume: return (2469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:46:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2fb4e621-9cf5-4e53-ad10-0ba94529344a tempest-VolumesSnapshotListTestJSON-2038328188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.472s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:46:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-acf83a2b-c087-426b-8c6d-d2527a7b1592 tempest-TestInstancesWithCinderVolumes-1856690417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.574s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:46:44 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-acf83a2b-c087-426b-8c6d-d2527a7b1592 tempest-TestInstancesWithCinderVolumes-1856690417 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1932961912',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c741089-5750-4ff2-8fc1-c35c4c3f864c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9729aa3cc134c0c92a18a8304f91182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:46:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:46:43Z,use_quota=True,user_id='a8874fcca20a401ab71d0885cc4d3031',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a4e3d33-2329-4155-92ae-5d78094d0109),volume_type_id=7a4e3d33-2329-4155-92ae-5d78094d0109)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:46:44 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-acf83a2b-c087-426b-8c6d-d2527a7b1592 tempest-TestInstancesWithCinderVolumes-1856690417 None] Creating volume 8c741089-5750-4ff2-8fc1-c35c4c3f864c {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:46:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-acf83a2b-c087-426b-8c6d-d2527a7b1592 tempest-TestInstancesWithCinderVolumes-1856690417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:46:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-acf83a2b-c087-426b-8c6d-d2527a7b1592 tempest-TestInstancesWithCinderVolumes-1856690417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:46:44 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-acf83a2b-c087-426b-8c6d-d2527a7b1592 tempest-TestInstancesWithCinderVolumes-1856690417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:46:44 devstack sudo[97388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-742da4b4-58d8-4372-940e-f9ea10d9961c.0db4816b-41da-47e5-af85-75665d1cc0bc
Jul 10 12:46:44 devstack sudo[97388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:44 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-acf83a2b-c087-426b-8c6d-d2527a7b1592 tempest-TestInstancesWithCinderVolumes-1856690417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:46:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-acf83a2b-c087-426b-8c6d-d2527a7b1592 tempest-TestInstancesWithCinderVolumes-1856690417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:46:44 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-acf83a2b-c087-426b-8c6d-d2527a7b1592 tempest-TestInstancesWithCinderVolumes-1856690417 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:46:44 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-acf83a2b-c087-426b-8c6d-d2527a7b1592 tempest-TestInstancesWithCinderVolumes-1856690417 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:46:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-acf83a2b-c087-426b-8c6d-d2527a7b1592 tempest-TestInstancesWithCinderVolumes-1856690417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8c741089-5750-4ff2-8fc1-c35c4c3f864c 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:44 devstack sudo[97396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8c741089-5750-4ff2-8fc1-c35c4c3f864c 1073741824
Jul 10 12:46:44 devstack sudo[97396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2fb4e621-9cf5-4e53-ad10-0ba94529344a tempest-VolumesSnapshotListTestJSON-2038328188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b7f8954-876c-4921-a796-b251dd30012f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-439b54a3-8776-4fd8-a15f-f023a799caf4', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:46:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2fb4e621-9cf5-4e53-ad10-0ba94529344a tempest-VolumesSnapshotListTestJSON-2038328188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b46559a-340b-495c-b44d-6e0c356ec24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:46:44 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-2fb4e621-9cf5-4e53-ad10-0ba94529344a tempest-VolumesSnapshotListTestJSON-2038328188 None] Volume volume-439b54a3-8776-4fd8-a15f-f023a799caf4 (439b54a3-8776-4fd8-a15f-f023a799caf4): created successfully
Jul 10 12:46:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2fb4e621-9cf5-4e53-ad10-0ba94529344a tempest-VolumesSnapshotListTestJSON-2038328188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b46559a-340b-495c-b44d-6e0c356ec24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:46:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2fb4e621-9cf5-4e53-ad10-0ba94529344a tempest-VolumesSnapshotListTestJSON-2038328188 None] Flow 'volume_create_manager' (368ebbea-2951-4c70-8aa8-ac2ab9ccb402) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:46:44 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-2fb4e621-9cf5-4e53-ad10-0ba94529344a tempest-VolumesSnapshotListTestJSON-2038328188 None] Created volume successfully.
Jul 10 12:46:45 devstack sudo[97388]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-f31a85fd-00fe-4ad3-b909-f25a40d3d2dc req-6f5fc8b8-cf41-4885-9a84-3ea4989d2d41 tempest-VolumesSnapshotsTestJSON-1436766851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-742da4b4-58d8-4372-940e-f9ea10d9961c.0db4816b-41da-47e5-af85-75665d1cc0bc" returned: 0 in 1.019s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:45 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:46:45 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] Flow 'volume_create_manager' (e590d894-382b-4120-9e15-0fe5da72a4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:46:45 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (135da2db-a33f-40e9-a09e-b7f340450b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:46:45 devstack cinder-volume[87378]: DEBUG cinder.coordination [req-f31a85fd-00fe-4ad3-b909-f25a40d3d2dc req-6f5fc8b8-cf41-4885-9a84-3ea4989d2d41 tempest-VolumesSnapshotsTestJSON-1436766851 None] Lock "cinder-quobyte-0db4816b-41da-47e5-af85-75665d1cc0bc" released by "_delete_snapshot" :: held 4.738s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:46:45 devstack cinder-volume[87378]: DEBUG cinder.coordination [req-f31a85fd-00fe-4ad3-b909-f25a40d3d2dc req-6f5fc8b8-cf41-4885-9a84-3ea4989d2d41 tempest-VolumesSnapshotsTestJSON-1436766851 None] Lock "cinder-quobyte-742da4b4-58d8-4372-940e-f9ea10d9961c" released by "delete_snapshot" :: held 4.777s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:46:45 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (135da2db-a33f-40e9-a09e-b7f340450b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-747099631',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22def002-3e0c-4802-903b-1ec123510c2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9729aa3cc134c0c92a18a8304f91182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:46:45Z,use_quota=True,user_id='a8874fcca20a401ab71d0885cc4d3031',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27a3ea79-dcc9-4608-b13c-d077c153dc13),volume_type_id=27a3ea79-dcc9-4608-b13c-d077c153dc13)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:46:45 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84f09558-cfc5-4fb2-a6c0-e0f44b8beba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:46:45 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84f09558-cfc5-4fb2-a6c0-e0f44b8beba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:46:45 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03b86f28-a6b2-4c81-a25c-deda7c565884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:46:45 devstack cinder-volume[87378]: DEBUG cinder.image.glance [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] Creating Keystone auth plugin from conf {{(pid=87378) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 10 12:46:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-41b4d942-73b6-4b05-9ff4-bf6327a08f4f tempest-VolumesSnapshotListTestJSON-2038328188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:46:45 devstack cinder-volume[87378]: DEBUG cinder.quota [req-f31a85fd-00fe-4ad3-b909-f25a40d3d2dc req-6f5fc8b8-cf41-4885-9a84-3ea4989d2d41 tempest-VolumesSnapshotsTestJSON-1436766851 None] Created reservations ['7049c2cf-3487-4d16-a7b0-6d91e155f5a9', '315d07c5-31b8-4f9f-a23a-1573e6f0e3d3', 'aa8f4f6f-4d7a-495d-a971-db6bc6075406', 'd4f257eb-9b7b-4c2d-b513-5ee09ced62ed'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:46:45 devstack sudo[97396]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-acf83a2b-c087-426b-8c6d-d2527a7b1592 tempest-TestInstancesWithCinderVolumes-1856690417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8c741089-5750-4ff2-8fc1-c35c4c3f864c 1073741824" returned: 0 in 1.382s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-acf83a2b-c087-426b-8c6d-d2527a7b1592 tempest-TestInstancesWithCinderVolumes-1856690417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8c741089-5750-4ff2-8fc1-c35c4c3f864c {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:45 devstack cinder-volume[87378]: INFO cinder.volume.manager [req-f31a85fd-00fe-4ad3-b909-f25a40d3d2dc req-6f5fc8b8-cf41-4885-9a84-3ea4989d2d41 tempest-VolumesSnapshotsTestJSON-1436766851 None] Delete snapshot completed successfully.
Jul 10 12:46:45 devstack sudo[97407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8c741089-5750-4ff2-8fc1-c35c4c3f864c
Jul 10 12:46:45 devstack sudo[97407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:45 devstack cinder-volume[87378]: DEBUG cinder.coordination [req-f31a85fd-00fe-4ad3-b909-f25a40d3d2dc req-6f5fc8b8-cf41-4885-9a84-3ea4989d2d41 tempest-VolumesSnapshotsTestJSON-1436766851 None] Lock "cinder-0db4816b-41da-47e5-af85-75665d1cc0bc-delete_snapshot" released by "delete_snapshot" :: held 5.194s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:46:45 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03b86f28-a6b2-4c81-a25c-deda7c565884) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '22def002-3e0c-4802-903b-1ec123510c2d', 'volume_name': 'volume-22def002-3e0c-4802-903b-1ec123510c2d', 'volume_size': 1, 'image_id': '0f360c23-5dc9-4a4b-acf6-fb66cb04bea9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0f360c23-5dc9-4a4b-acf6-fb66cb04bea9', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1918153463', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c9729aa3cc134c0c92a18a8304f91182', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0f360c23-5dc9-4a4b-acf6-fb66cb04bea9', 'created_at': datetime.datetime(2026, 7, 10, 10, 46, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 10, 46, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0f360c23-5dc9-4a4b-acf6-fb66cb04bea9/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74a0ab9d64b0>}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:46:45 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8879d937-6676-408a-8e2d-f7ec876549c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:46:45 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8879d937-6676-408a-8e2d-f7ec876549c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:46:45 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2107ef2e-4b28-48be-8f14-4d83e268c033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:46:45 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] Volume 22def002-3e0c-4802-903b-1ec123510c2d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-22def002-3e0c-4802-903b-1ec123510c2d', 'volume_size': 1, 'image_id': '0f360c23-5dc9-4a4b-acf6-fb66cb04bea9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0f360c23-5dc9-4a4b-acf6-fb66cb04bea9', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1918153463', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c9729aa3cc134c0c92a18a8304f91182', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0f360c23-5dc9-4a4b-acf6-fb66cb04bea9', 'created_at': datetime.datetime(2026, 7, 10, 10, 46, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 10, 46, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0f360c23-5dc9-4a4b-acf6-fb66cb04bea9/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74a0ab9d64b0>}
Jul 10 12:46:45 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] Trying to clone 22def002-3e0c-4802-903b-1ec123510c2d from image 0f360c23-5dc9-4a4b-acf6-fb66cb04bea9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0f360c23-5dc9-4a4b-acf6-fb66cb04bea9', 'metadata': {}}]). {{(pid=87378) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 10 12:46:46 devstack cinder-volume[87378]: DEBUG cinder.coordination [req-0a2d41b4-15b2-40c1-b615-8e8d586d0602 req-b1746f82-fe4a-4c49-92cf-1789262c84e8 tempest-VolumesSnapshotsTestJSON-1436766851 None] Acquiring lock "cinder-742da4b4-58d8-4372-940e-f9ea10d9961c-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:46:46 devstack cinder-volume[87378]: DEBUG cinder.coordination [req-0a2d41b4-15b2-40c1-b615-8e8d586d0602 req-b1746f82-fe4a-4c49-92cf-1789262c84e8 tempest-VolumesSnapshotsTestJSON-1436766851 None] Lock "cinder-742da4b4-58d8-4372-940e-f9ea10d9961c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:46:46 devstack cinder-volume[87378]: DEBUG cinder.coordination [req-0a2d41b4-15b2-40c1-b615-8e8d586d0602 req-b1746f82-fe4a-4c49-92cf-1789262c84e8 tempest-VolumesSnapshotsTestJSON-1436766851 None] Acquiring lock "cinder-quobyte-742da4b4-58d8-4372-940e-f9ea10d9961c" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:46:46 devstack cinder-volume[87378]: DEBUG cinder.coordination [req-0a2d41b4-15b2-40c1-b615-8e8d586d0602 req-b1746f82-fe4a-4c49-92cf-1789262c84e8 tempest-VolumesSnapshotsTestJSON-1436766851 None] Lock "cinder-quobyte-742da4b4-58d8-4372-940e-f9ea10d9961c" acquired by "delete_volume" :: waited 0.022s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:46:46 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[743fc451-1eef-4eb3-b672-ce54dc5d52b9]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:46:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-0a2d41b4-15b2-40c1-b615-8e8d586d0602 req-b1746f82-fe4a-4c49-92cf-1789262c84e8 tempest-VolumesSnapshotsTestJSON-1436766851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-742da4b4-58d8-4372-940e-f9ea10d9961c {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:46 devstack sudo[97409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-742da4b4-58d8-4372-940e-f9ea10d9961c
Jul 10 12:46:46 devstack sudo[97409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:46 devstack sudo[97407]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-acf83a2b-c087-426b-8c6d-d2527a7b1592 tempest-TestInstancesWithCinderVolumes-1856690417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8c741089-5750-4ff2-8fc1-c35c4c3f864c" returned: 0 in 1.049s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:46 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-acf83a2b-c087-426b-8c6d-d2527a7b1592 tempest-TestInstancesWithCinderVolumes-1856690417 None] <== create_volume: return (2514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:46:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-acf83a2b-c087-426b-8c6d-d2527a7b1592 tempest-TestInstancesWithCinderVolumes-1856690417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.518s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:46:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e416256e-1faa-4248-8736-68dade3a911f tempest-TestInstancesWithCinderVolumes-1856690417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.558s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:46:46 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-e416256e-1faa-4248-8736-68dade3a911f tempest-TestInstancesWithCinderVolumes-1856690417 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-759569421',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f208719-4a9a-4626-b1dd-f867d44e13e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9729aa3cc134c0c92a18a8304f91182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:46:44Z,use_quota=True,user_id='a8874fcca20a401ab71d0885cc4d3031',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cd507720-660a-4a81-b995-7e490831eb34),volume_type_id=cd507720-660a-4a81-b995-7e490831eb34)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:46:46 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-e416256e-1faa-4248-8736-68dade3a911f tempest-TestInstancesWithCinderVolumes-1856690417 None] Creating volume 6f208719-4a9a-4626-b1dd-f867d44e13e3 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:46:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e416256e-1faa-4248-8736-68dade3a911f tempest-TestInstancesWithCinderVolumes-1856690417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:46:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e416256e-1faa-4248-8736-68dade3a911f tempest-TestInstancesWithCinderVolumes-1856690417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:46:46 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-e416256e-1faa-4248-8736-68dade3a911f tempest-TestInstancesWithCinderVolumes-1856690417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:46:46 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-e416256e-1faa-4248-8736-68dade3a911f tempest-TestInstancesWithCinderVolumes-1856690417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:46:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e416256e-1faa-4248-8736-68dade3a911f tempest-TestInstancesWithCinderVolumes-1856690417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:46:46 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-e416256e-1faa-4248-8736-68dade3a911f tempest-TestInstancesWithCinderVolumes-1856690417 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:46:46 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-e416256e-1faa-4248-8736-68dade3a911f tempest-TestInstancesWithCinderVolumes-1856690417 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:46:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e416256e-1faa-4248-8736-68dade3a911f tempest-TestInstancesWithCinderVolumes-1856690417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6f208719-4a9a-4626-b1dd-f867d44e13e3 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:46 devstack sudo[97412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6f208719-4a9a-4626-b1dd-f867d44e13e3 1073741824
Jul 10 12:46:46 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-acf83a2b-c087-426b-8c6d-d2527a7b1592 tempest-TestInstancesWithCinderVolumes-1856690417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e34bf299-fb8a-47e6-a420-75627287763e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c741089-5750-4ff2-8fc1-c35c4c3f864c', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:46:46 devstack sudo[97412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:46 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-acf83a2b-c087-426b-8c6d-d2527a7b1592 tempest-TestInstancesWithCinderVolumes-1856690417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67c1aadb-8cb9-4b85-8972-ea6be5d3e96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:46:46 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-acf83a2b-c087-426b-8c6d-d2527a7b1592 tempest-TestInstancesWithCinderVolumes-1856690417 None] Volume volume-8c741089-5750-4ff2-8fc1-c35c4c3f864c (8c741089-5750-4ff2-8fc1-c35c4c3f864c): created successfully
Jul 10 12:46:46 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-acf83a2b-c087-426b-8c6d-d2527a7b1592 tempest-TestInstancesWithCinderVolumes-1856690417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67c1aadb-8cb9-4b85-8972-ea6be5d3e96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:46:46 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-acf83a2b-c087-426b-8c6d-d2527a7b1592 tempest-TestInstancesWithCinderVolumes-1856690417 None] Flow 'volume_create_manager' (6b719d8d-1df4-414a-8915-18d065a29ac9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:46:46 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-acf83a2b-c087-426b-8c6d-d2527a7b1592 tempest-TestInstancesWithCinderVolumes-1856690417 None] Created volume successfully.
Jul 10 12:46:47 devstack sudo[97409]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-0a2d41b4-15b2-40c1-b615-8e8d586d0602 req-b1746f82-fe4a-4c49-92cf-1789262c84e8 tempest-VolumesSnapshotsTestJSON-1436766851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-742da4b4-58d8-4372-940e-f9ea10d9961c" returned: 0 in 1.096s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-0a2d41b4-15b2-40c1-b615-8e8d586d0602 req-b1746f82-fe4a-4c49-92cf-1789262c84e8 tempest-VolumesSnapshotsTestJSON-1436766851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-742da4b4-58d8-4372-940e-f9ea10d9961c {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:47 devstack sudo[97418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-742da4b4-58d8-4372-940e-f9ea10d9961c
Jul 10 12:46:47 devstack sudo[97418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:47 devstack sudo[97412]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e416256e-1faa-4248-8736-68dade3a911f tempest-TestInstancesWithCinderVolumes-1856690417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6f208719-4a9a-4626-b1dd-f867d44e13e3 1073741824" returned: 0 in 1.379s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e416256e-1faa-4248-8736-68dade3a911f tempest-TestInstancesWithCinderVolumes-1856690417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6f208719-4a9a-4626-b1dd-f867d44e13e3 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:48 devstack sudo[97424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6f208719-4a9a-4626-b1dd-f867d44e13e3
Jul 10 12:46:48 devstack sudo[97424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:48 devstack sudo[97418]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-0a2d41b4-15b2-40c1-b615-8e8d586d0602 req-b1746f82-fe4a-4c49-92cf-1789262c84e8 tempest-VolumesSnapshotsTestJSON-1436766851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-742da4b4-58d8-4372-940e-f9ea10d9961c" returned: 0 in 1.057s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:48 devstack cinder-volume[87378]: DEBUG cinder.coordination [req-0a2d41b4-15b2-40c1-b615-8e8d586d0602 req-b1746f82-fe4a-4c49-92cf-1789262c84e8 tempest-VolumesSnapshotsTestJSON-1436766851 None] Lock "cinder-quobyte-742da4b4-58d8-4372-940e-f9ea10d9961c" released by "delete_volume" :: held 2.241s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:46:48 devstack cinder-volume[87378]: DEBUG cinder.quota [req-0a2d41b4-15b2-40c1-b615-8e8d586d0602 req-b1746f82-fe4a-4c49-92cf-1789262c84e8 tempest-VolumesSnapshotsTestJSON-1436766851 None] Created reservations ['20c889de-d175-4dda-a526-14ba3b04edab', '3de40300-7ae2-47c4-bbb2-09b629c5b909', '32ce39d9-a950-4940-9bd4-4d7755b38c6c', 'b1de7c02-dfa5-4d7f-a0bd-00c2613a14e7'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:46:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-0a2d41b4-15b2-40c1-b615-8e8d586d0602 req-b1746f82-fe4a-4c49-92cf-1789262c84e8 tempest-VolumesSnapshotsTestJSON-1436766851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:46:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-0a2d41b4-15b2-40c1-b615-8e8d586d0602 req-b1746f82-fe4a-4c49-92cf-1789262c84e8 tempest-VolumesSnapshotsTestJSON-1436766851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:46:48 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [req-0a2d41b4-15b2-40c1-b615-8e8d586d0602 req-b1746f82-fe4a-4c49-92cf-1789262c84e8 tempest-VolumesSnapshotsTestJSON-1436766851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:46:48 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [req-0a2d41b4-15b2-40c1-b615-8e8d586d0602 req-b1746f82-fe4a-4c49-92cf-1789262c84e8 tempest-VolumesSnapshotsTestJSON-1436766851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:46:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-0a2d41b4-15b2-40c1-b615-8e8d586d0602 req-b1746f82-fe4a-4c49-92cf-1789262c84e8 tempest-VolumesSnapshotsTestJSON-1436766851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:46:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-0a2d41b4-15b2-40c1-b615-8e8d586d0602 req-b1746f82-fe4a-4c49-92cf-1789262c84e8 tempest-VolumesSnapshotsTestJSON-1436766851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:48 devstack sudo[97427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:46:48 devstack sudo[97427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:49 devstack sudo[97424]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e416256e-1faa-4248-8736-68dade3a911f tempest-TestInstancesWithCinderVolumes-1856690417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6f208719-4a9a-4626-b1dd-f867d44e13e3" returned: 0 in 1.234s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:49 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-e416256e-1faa-4248-8736-68dade3a911f tempest-TestInstancesWithCinderVolumes-1856690417 None] <== create_volume: return (2694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:46:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e416256e-1faa-4248-8736-68dade3a911f tempest-TestInstancesWithCinderVolumes-1856690417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.698s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:46:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-41b4d942-73b6-4b05-9ff4-bf6327a08f4f tempest-VolumesSnapshotListTestJSON-2038328188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.980s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:46:49 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-41b4d942-73b6-4b05-9ff4-bf6327a08f4f tempest-VolumesSnapshotListTestJSON-2038328188 None] Creating offline snapshot 609b3cb9-21d6-4bba-8128-8dd89d0c6156 of volume 439b54a3-8776-4fd8-a15f-f023a799caf4 {{(pid=87378) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 10 12:46:49 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e416256e-1faa-4248-8736-68dade3a911f tempest-TestInstancesWithCinderVolumes-1856690417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f39da1a-9fa1-4539-b8aa-9547eb792f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f208719-4a9a-4626-b1dd-f867d44e13e3', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:46:49 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e416256e-1faa-4248-8736-68dade3a911f tempest-TestInstancesWithCinderVolumes-1856690417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac1a3bd4-9311-43f0-b069-02a126ef5a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:46:49 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[2038dc8c-6406-4692-869f-0d0377b9a06e]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:46:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-41b4d942-73b6-4b05-9ff4-bf6327a08f4f tempest-VolumesSnapshotListTestJSON-2038328188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:49 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-e416256e-1faa-4248-8736-68dade3a911f tempest-TestInstancesWithCinderVolumes-1856690417 None] Volume volume-6f208719-4a9a-4626-b1dd-f867d44e13e3 (6f208719-4a9a-4626-b1dd-f867d44e13e3): created successfully
Jul 10 12:46:49 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e416256e-1faa-4248-8736-68dade3a911f tempest-TestInstancesWithCinderVolumes-1856690417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac1a3bd4-9311-43f0-b069-02a126ef5a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:46:49 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e416256e-1faa-4248-8736-68dade3a911f tempest-TestInstancesWithCinderVolumes-1856690417 None] Flow 'volume_create_manager' (c6cced56-3c48-41e0-98a7-62ddc13b046c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:46:49 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-e416256e-1faa-4248-8736-68dade3a911f tempest-TestInstancesWithCinderVolumes-1856690417 None] Created volume successfully.
Jul 10 12:46:49 devstack sudo[97432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4
Jul 10 12:46:49 devstack sudo[97432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:49 devstack sudo[97427]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-0a2d41b4-15b2-40c1-b615-8e8d586d0602 req-b1746f82-fe4a-4c49-92cf-1789262c84e8 tempest-VolumesSnapshotsTestJSON-1436766851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 1.032s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:49 devstack cinder-volume[87378]: DEBUG cinder.manager [req-0a2d41b4-15b2-40c1-b615-8e8d586d0602 req-b1746f82-fe4a-4c49-92cf-1789262c84e8 tempest-VolumesSnapshotsTestJSON-1436766851 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:46:49 devstack cinder-volume[87378]: INFO cinder.volume.manager [req-0a2d41b4-15b2-40c1-b615-8e8d586d0602 req-b1746f82-fe4a-4c49-92cf-1789262c84e8 tempest-VolumesSnapshotsTestJSON-1436766851 None] Deleted volume successfully.
Jul 10 12:46:49 devstack cinder-volume[87378]: DEBUG cinder.coordination [req-0a2d41b4-15b2-40c1-b615-8e8d586d0602 req-b1746f82-fe4a-4c49-92cf-1789262c84e8 tempest-VolumesSnapshotsTestJSON-1436766851 None] Lock "cinder-742da4b4-58d8-4372-940e-f9ea10d9961c-delete_volume" released by "delete_volume" :: held 3.650s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:46:50 devstack sudo[97432]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-41b4d942-73b6-4b05-9ff4-bf6327a08f4f tempest-VolumesSnapshotListTestJSON-2038328188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4" returned: 0 in 1.157s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-41b4d942-73b6-4b05-9ff4-bf6327a08f4f tempest-VolumesSnapshotListTestJSON-2038328188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.609b3cb9-21d6-4bba-8128-8dd89d0c6156 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:50 devstack sudo[97440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.609b3cb9-21d6-4bba-8128-8dd89d0c6156 1G
Jul 10 12:46:50 devstack sudo[97440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:51 devstack sudo[97440]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-41b4d942-73b6-4b05-9ff4-bf6327a08f4f tempest-VolumesSnapshotListTestJSON-2038328188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.609b3cb9-21d6-4bba-8128-8dd89d0c6156 1G" returned: 0 in 1.081s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-41b4d942-73b6-4b05-9ff4-bf6327a08f4f tempest-VolumesSnapshotListTestJSON-2038328188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-439b54a3-8776-4fd8-a15f-f023a799caf4 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.609b3cb9-21d6-4bba-8128-8dd89d0c6156 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:51 devstack sudo[97446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-439b54a3-8776-4fd8-a15f-f023a799caf4 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.609b3cb9-21d6-4bba-8128-8dd89d0c6156
Jul 10 12:46:51 devstack sudo[97446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:51 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0f360c23-5dc9-4a4b-acf6-fb66cb04bea9_gcan14jndevstack@QuobyteHD, size 20.69 MB, duration 6.08 sec {{(pid=87378) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 10 12:46:51 devstack cinder-volume[87378]: INFO cinder.image.image_utils [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] Image download 20.69 MB at 3.40 MB/s
Jul 10 12:46:51 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b07490-6a57-4ff3-a95a-5ccdab29f6fb]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:46:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f360c23-5dc9-4a4b-acf6-fb66cb04bea9_gcan14jndevstack@QuobyteHD {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:52 devstack sudo[97448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f360c23-5dc9-4a4b-acf6-fb66cb04bea9_gcan14jndevstack@QuobyteHD
Jul 10 12:46:52 devstack sudo[97448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:52 devstack sudo[97446]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-41b4d942-73b6-4b05-9ff4-bf6327a08f4f tempest-VolumesSnapshotListTestJSON-2038328188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-439b54a3-8776-4fd8-a15f-f023a799caf4 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.609b3cb9-21d6-4bba-8128-8dd89d0c6156" returned: 0 in 1.055s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:52 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-41b4d942-73b6-4b05-9ff4-bf6327a08f4f tempest-VolumesSnapshotListTestJSON-2038328188 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.609b3cb9-21d6-4bba-8128-8dd89d0c6156 is being set with open permissions: ugo+rw
Jul 10 12:46:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-41b4d942-73b6-4b05-9ff4-bf6327a08f4f tempest-VolumesSnapshotListTestJSON-2038328188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.609b3cb9-21d6-4bba-8128-8dd89d0c6156 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:52 devstack sudo[97454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.609b3cb9-21d6-4bba-8128-8dd89d0c6156
Jul 10 12:46:52 devstack sudo[97454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:53 devstack sudo[97448]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f360c23-5dc9-4a4b-acf6-fb66cb04bea9_gcan14jndevstack@QuobyteHD" returned: 0 in 1.015s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:53 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] Temporary image 0f360c23-5dc9-4a4b-acf6-fb66cb04bea9 is fetched for user a8874fcca20a401ab71d0885cc4d3031. {{(pid=87378) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 10 12:46:53 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d57395-64db-455e-83b6-29658f0f3eff]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:46:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f360c23-5dc9-4a4b-acf6-fb66cb04bea9_gcan14jndevstack@QuobyteHD {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:53 devstack sudo[97459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f360c23-5dc9-4a4b-acf6-fb66cb04bea9_gcan14jndevstack@QuobyteHD
Jul 10 12:46:53 devstack sudo[97459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:53 devstack sudo[97454]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-41b4d942-73b6-4b05-9ff4-bf6327a08f4f tempest-VolumesSnapshotListTestJSON-2038328188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.609b3cb9-21d6-4bba-8128-8dd89d0c6156" returned: 0 in 0.896s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-41b4d942-73b6-4b05-9ff4-bf6327a08f4f tempest-VolumesSnapshotListTestJSON-2038328188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:53 devstack sudo[97462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.info
Jul 10 12:46:53 devstack sudo[97462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:54 devstack sudo[97459]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f360c23-5dc9-4a4b-acf6-fb66cb04bea9_gcan14jndevstack@QuobyteHD" returned: 0 in 0.960s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:46:54 devstack sudo[97462]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-41b4d942-73b6-4b05-9ff4-bf6327a08f4f tempest-VolumesSnapshotListTestJSON-2038328188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.info" returned: 0 in 0.877s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:54 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-41b4d942-73b6-4b05-9ff4-bf6327a08f4f tempest-VolumesSnapshotListTestJSON-2038328188 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.info is being set with open permissions: ugo+rw
Jul 10 12:46:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-41b4d942-73b6-4b05-9ff4-bf6327a08f4f tempest-VolumesSnapshotListTestJSON-2038328188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:54 devstack sudo[97469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.info
Jul 10 12:46:54 devstack sudo[97469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:55 devstack sudo[97469]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-41b4d942-73b6-4b05-9ff4-bf6327a08f4f tempest-VolumesSnapshotListTestJSON-2038328188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.info" returned: 0 in 0.708s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-41b4d942-73b6-4b05-9ff4-bf6327a08f4f tempest-VolumesSnapshotListTestJSON-2038328188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.932s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:46:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.161s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:46:55 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-747099631',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22def002-3e0c-4802-903b-1ec123510c2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9729aa3cc134c0c92a18a8304f91182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:46:45Z,use_quota=True,user_id='a8874fcca20a401ab71d0885cc4d3031',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27a3ea79-dcc9-4608-b13c-d077c153dc13),volume_type_id=27a3ea79-dcc9-4608-b13c-d077c153dc13)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:46:55 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] Creating volume 22def002-3e0c-4802-903b-1ec123510c2d {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:46:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:46:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:46:55 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:46:55 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:46:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:46:55 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:46:55 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:46:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22def002-3e0c-4802-903b-1ec123510c2d 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:55 devstack sudo[97472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22def002-3e0c-4802-903b-1ec123510c2d 1073741824
Jul 10 12:46:55 devstack sudo[97472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:55 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-41b4d942-73b6-4b05-9ff4-bf6327a08f4f tempest-VolumesSnapshotListTestJSON-2038328188 None] Create snapshot completed successfully
Jul 10 12:46:55 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-71cb6d67-32b1-40e4-ba52-d4fd3a37b6eb tempest-BackendsCapabilitiesAdminTestsJSON-814446142 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.750259399414, 'free_capacity_gb': 1775.750259399414, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87378) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 10 12:46:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5dd478b6-9a4e-4cac-8409-4395266ad4cb tempest-VolumesSnapshotListTestJSON-2038328188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:46:56 devstack sudo[97472]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22def002-3e0c-4802-903b-1ec123510c2d 1073741824" returned: 0 in 0.923s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22def002-3e0c-4802-903b-1ec123510c2d {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:56 devstack sudo[97478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22def002-3e0c-4802-903b-1ec123510c2d
Jul 10 12:46:56 devstack sudo[97478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-489b744e-0352-4c89-b89b-726c4dc577c1 tempest-BackendsCapabilitiesAdminTestsJSON-814446142 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.750259399414, 'free_capacity_gb': 1775.750259399414, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87378) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 10 12:46:56 devstack sudo[97478]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22def002-3e0c-4802-903b-1ec123510c2d" returned: 0 in 0.678s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:56 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] <== create_volume: return (1652ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:46:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:46:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5dd478b6-9a4e-4cac-8409-4395266ad4cb tempest-VolumesSnapshotListTestJSON-2038328188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.937s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:46:56 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-5dd478b6-9a4e-4cac-8409-4395266ad4cb tempest-VolumesSnapshotListTestJSON-2038328188 None] Creating offline snapshot 47150dee-eca7-4b4a-bae6-a169a668c681 of volume 439b54a3-8776-4fd8-a15f-f023a799caf4 {{(pid=87378) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 10 12:46:56 devstack cinder-volume[87378]: DEBUG cinder.volume.volume_utils [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] Attempting download of 0f360c23-5dc9-4a4b-acf6-fb66cb04bea9 ((None, [{'url': 'file:///opt/stack/data/glance/images/0f360c23-5dc9-4a4b-acf6-fb66cb04bea9', 'metadata': {}}])) to volume 22def002-3e0c-4802-903b-1ec123510c2d. {{(pid=87378) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 10 12:46:56 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bfed47f-688a-4c15-ac39-74cb3f4dd0df]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:46:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5dd478b6-9a4e-4cac-8409-4395266ad4cb tempest-VolumesSnapshotListTestJSON-2038328188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.609b3cb9-21d6-4bba-8128-8dd89d0c6156 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:57 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[11542dfc-8e61-42bb-9603-66a828b05f01]: (4, 'raw') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:46:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0f360c23-5dc9-4a4b-acf6-fb66cb04bea9_injnexx1 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:57 devstack sudo[97482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.609b3cb9-21d6-4bba-8128-8dd89d0c6156
Jul 10 12:46:57 devstack sudo[97482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:57 devstack sudo[97483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0f360c23-5dc9-4a4b-acf6-fb66cb04bea9_injnexx1
Jul 10 12:46:57 devstack sudo[97483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:58 devstack sudo[97482]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5dd478b6-9a4e-4cac-8409-4395266ad4cb tempest-VolumesSnapshotListTestJSON-2038328188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.609b3cb9-21d6-4bba-8128-8dd89d0c6156" returned: 0 in 1.032s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:58 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-5dd478b6-9a4e-4cac-8409-4395266ad4cb tempest-VolumesSnapshotListTestJSON-2038328188 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-439b54a3-8776-4fd8-a15f-f023a799caf4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:46:58 devstack sudo[97483]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5dd478b6-9a4e-4cac-8409-4395266ad4cb tempest-VolumesSnapshotListTestJSON-2038328188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.609b3cb9-21d6-4bba-8128-8dd89d0c6156,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.47150dee-eca7-4b4a-bae6-a169a668c681 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0f360c23-5dc9-4a4b-acf6-fb66cb04bea9_injnexx1" returned: 0 in 0.968s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0f360c23-5dc9-4a4b-acf6-fb66cb04bea9_injnexx1 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:58 devstack sudo[97514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.609b3cb9-21d6-4bba-8128-8dd89d0c6156,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.47150dee-eca7-4b4a-bae6-a169a668c681 1G
Jul 10 12:46:58 devstack sudo[97514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:58 devstack sudo[97515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0f360c23-5dc9-4a4b-acf6-fb66cb04bea9_injnexx1
Jul 10 12:46:58 devstack sudo[97515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:58 devstack sudo[97515]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0f360c23-5dc9-4a4b-acf6-fb66cb04bea9_injnexx1" returned: 1 in 0.865s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0f360c23-5dc9-4a4b-acf6-fb66cb04bea9_injnexx1' failed. Not Retrying. {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 10 12:46:58 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa97aaa-e447-4004-8457-dcf75e567fff]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:46:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f360c23-5dc9-4a4b-acf6-fb66cb04bea9_gcan14jndevstack@QuobyteHD {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:59 devstack sudo[97526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f360c23-5dc9-4a4b-acf6-fb66cb04bea9_gcan14jndevstack@QuobyteHD
Jul 10 12:46:59 devstack sudo[97526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:59 devstack sudo[97514]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5dd478b6-9a4e-4cac-8409-4395266ad4cb tempest-VolumesSnapshotListTestJSON-2038328188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.609b3cb9-21d6-4bba-8128-8dd89d0c6156,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.47150dee-eca7-4b4a-bae6-a169a668c681 1G" returned: 0 in 1.085s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5dd478b6-9a4e-4cac-8409-4395266ad4cb tempest-VolumesSnapshotListTestJSON-2038328188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-439b54a3-8776-4fd8-a15f-f023a799caf4.609b3cb9-21d6-4bba-8128-8dd89d0c6156 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.47150dee-eca7-4b4a-bae6-a169a668c681 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:59 devstack sudo[97530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-439b54a3-8776-4fd8-a15f-f023a799caf4.609b3cb9-21d6-4bba-8128-8dd89d0c6156 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.47150dee-eca7-4b4a-bae6-a169a668c681
Jul 10 12:46:59 devstack sudo[97530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:59 devstack sudo[97526]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0f360c23-5dc9-4a4b-acf6-fb66cb04bea9_gcan14jndevstack@QuobyteHD" returned: 0 in 0.903s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:59 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] 0f360c23-5dc9-4a4b-acf6-fb66cb04bea9 was qcow2, converting to raw {{(pid=87378) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 10 12:46:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0f360c23-5dc9-4a4b-acf6-fb66cb04bea9_gcan14jndevstack@QuobyteHD /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22def002-3e0c-4802-903b-1ec123510c2d {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:59 devstack sudo[97539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0f360c23-5dc9-4a4b-acf6-fb66cb04bea9_gcan14jndevstack@QuobyteHD /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22def002-3e0c-4802-903b-1ec123510c2d
Jul 10 12:46:59 devstack sudo[97539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:46:59 devstack sudo[97530]: pam_unix(sudo:session): session closed for user root
Jul 10 12:46:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5dd478b6-9a4e-4cac-8409-4395266ad4cb tempest-VolumesSnapshotListTestJSON-2038328188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-439b54a3-8776-4fd8-a15f-f023a799caf4.609b3cb9-21d6-4bba-8128-8dd89d0c6156 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.47150dee-eca7-4b4a-bae6-a169a668c681" returned: 0 in 0.775s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:46:59 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-5dd478b6-9a4e-4cac-8409-4395266ad4cb tempest-VolumesSnapshotListTestJSON-2038328188 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.47150dee-eca7-4b4a-bae6-a169a668c681 is being set with open permissions: ugo+rw
Jul 10 12:46:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5dd478b6-9a4e-4cac-8409-4395266ad4cb tempest-VolumesSnapshotListTestJSON-2038328188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.47150dee-eca7-4b4a-bae6-a169a668c681 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:46:59 devstack sudo[97541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.47150dee-eca7-4b4a-bae6-a169a668c681
Jul 10 12:46:59 devstack sudo[97541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:00 devstack sudo[97541]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5dd478b6-9a4e-4cac-8409-4395266ad4cb tempest-VolumesSnapshotListTestJSON-2038328188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.47150dee-eca7-4b4a-bae6-a169a668c681" returned: 0 in 0.728s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5dd478b6-9a4e-4cac-8409-4395266ad4cb tempest-VolumesSnapshotListTestJSON-2038328188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.760s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:47:00 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-5dd478b6-9a4e-4cac-8409-4395266ad4cb tempest-VolumesSnapshotListTestJSON-2038328188 None] Create snapshot completed successfully
Jul 10 12:47:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-9f7606c1-299e-4ac8-99d0-6d55c5ee23b4 tempest-VolumesSnapshotListTestJSON-2038328188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:47:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-9f7606c1-299e-4ac8-99d0-6d55c5ee23b4 tempest-VolumesSnapshotListTestJSON-2038328188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:47:01 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-9f7606c1-299e-4ac8-99d0-6d55c5ee23b4 tempest-VolumesSnapshotListTestJSON-2038328188 None] Creating offline snapshot 38cd18d2-1d24-4729-b99d-df49395b5b67 of volume 439b54a3-8776-4fd8-a15f-f023a799caf4 {{(pid=87378) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 10 12:47:01 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[18838a07-0fe2-4a0a-aabf-99684d374af0]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:47:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9f7606c1-299e-4ac8-99d0-6d55c5ee23b4 tempest-VolumesSnapshotListTestJSON-2038328188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.47150dee-eca7-4b4a-bae6-a169a668c681 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:01 devstack sudo[97557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.47150dee-eca7-4b4a-bae6-a169a668c681
Jul 10 12:47:01 devstack sudo[97557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:02 devstack sudo[97539]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0f360c23-5dc9-4a4b-acf6-fb66cb04bea9_gcan14jndevstack@QuobyteHD /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22def002-3e0c-4802-903b-1ec123510c2d" returned: 0 in 2.223s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:02 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0f360c23-5dc9-4a4b-acf6-fb66cb04bea9_gcan14jndevstack@QuobyteHD, size 112.00 MB, duration 2.23 sec, destination /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22def002-3e0c-4802-903b-1ec123510c2d {{(pid=87378) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 10 12:47:02 devstack cinder-volume[87378]: INFO cinder.image.image_utils [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] Converted 112.00 MB image at 50.31 MB/s
Jul 10 12:47:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22def002-3e0c-4802-903b-1ec123510c2d 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:02 devstack sudo[97559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22def002-3e0c-4802-903b-1ec123510c2d 1G
Jul 10 12:47:02 devstack sudo[97559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:02 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-d6ab7126-433b-44de-900f-b6d5fc09b7fd tempest-GroupsTest-760943615 None] Group tempest-Group1-917040671: creating
Jul 10 12:47:02 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-d6ab7126-433b-44de-900f-b6d5fc09b7fd tempest-GroupsTest-760943615 None] Group tempest-Group1-917040671: created successfully
Jul 10 12:47:02 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-d6ab7126-433b-44de-900f-b6d5fc09b7fd tempest-GroupsTest-760943615 None] Create group completed successfully.
Jul 10 12:47:02 devstack sudo[97557]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9f7606c1-299e-4ac8-99d0-6d55c5ee23b4 tempest-VolumesSnapshotListTestJSON-2038328188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.47150dee-eca7-4b4a-bae6-a169a668c681" returned: 0 in 0.894s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:02 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-9f7606c1-299e-4ac8-99d0-6d55c5ee23b4 tempest-VolumesSnapshotListTestJSON-2038328188 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-439b54a3-8776-4fd8-a15f-f023a799caf4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:47:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9f7606c1-299e-4ac8-99d0-6d55c5ee23b4 tempest-VolumesSnapshotListTestJSON-2038328188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.47150dee-eca7-4b4a-bae6-a169a668c681,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.38cd18d2-1d24-4729-b99d-df49395b5b67 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:02 devstack sudo[97564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.47150dee-eca7-4b4a-bae6-a169a668c681,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.38cd18d2-1d24-4729-b99d-df49395b5b67 1G
Jul 10 12:47:02 devstack sudo[97564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:02 devstack sudo[97559]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22def002-3e0c-4802-903b-1ec123510c2d 1G" returned: 0 in 0.774s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:02 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a9726a-38a6-4a64-bf4c-0d04cc3f2a94]: (4, 'raw') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:47:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22def002-3e0c-4802-903b-1ec123510c2d {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:02 devstack sudo[97569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22def002-3e0c-4802-903b-1ec123510c2d
Jul 10 12:47:02 devstack sudo[97569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:03 devstack sudo[97564]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9f7606c1-299e-4ac8-99d0-6d55c5ee23b4 tempest-VolumesSnapshotListTestJSON-2038328188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.47150dee-eca7-4b4a-bae6-a169a668c681,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.38cd18d2-1d24-4729-b99d-df49395b5b67 1G" returned: 0 in 0.884s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9f7606c1-299e-4ac8-99d0-6d55c5ee23b4 tempest-VolumesSnapshotListTestJSON-2038328188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-439b54a3-8776-4fd8-a15f-f023a799caf4.47150dee-eca7-4b4a-bae6-a169a668c681 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.38cd18d2-1d24-4729-b99d-df49395b5b67 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:03 devstack sudo[97574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-439b54a3-8776-4fd8-a15f-f023a799caf4.47150dee-eca7-4b4a-bae6-a169a668c681 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.38cd18d2-1d24-4729-b99d-df49395b5b67
Jul 10 12:47:03 devstack sudo[97574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:03 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-23a62f24-c0ed-44ba-b1d7-241439f7d80c tempest-GroupsTest-760943615 None] Group tempest-Group2-977510378: creating
Jul 10 12:47:03 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-23a62f24-c0ed-44ba-b1d7-241439f7d80c tempest-GroupsTest-760943615 None] Group tempest-Group2-977510378: created successfully
Jul 10 12:47:03 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-23a62f24-c0ed-44ba-b1d7-241439f7d80c tempest-GroupsTest-760943615 None] Create group completed successfully.
Jul 10 12:47:03 devstack sudo[97569]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22def002-3e0c-4802-903b-1ec123510c2d" returned: 0 in 0.847s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22def002-3e0c-4802-903b-1ec123510c2d {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:03 devstack sudo[97578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22def002-3e0c-4802-903b-1ec123510c2d
Jul 10 12:47:03 devstack sudo[97578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:04 devstack sudo[97574]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9f7606c1-299e-4ac8-99d0-6d55c5ee23b4 tempest-VolumesSnapshotListTestJSON-2038328188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-439b54a3-8776-4fd8-a15f-f023a799caf4.47150dee-eca7-4b4a-bae6-a169a668c681 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.38cd18d2-1d24-4729-b99d-df49395b5b67" returned: 0 in 0.745s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:04 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-9f7606c1-299e-4ac8-99d0-6d55c5ee23b4 tempest-VolumesSnapshotListTestJSON-2038328188 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.38cd18d2-1d24-4729-b99d-df49395b5b67 is being set with open permissions: ugo+rw
Jul 10 12:47:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9f7606c1-299e-4ac8-99d0-6d55c5ee23b4 tempest-VolumesSnapshotListTestJSON-2038328188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.38cd18d2-1d24-4729-b99d-df49395b5b67 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:04 devstack sudo[97583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.38cd18d2-1d24-4729-b99d-df49395b5b67
Jul 10 12:47:04 devstack sudo[97583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:04 devstack sudo[97578]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22def002-3e0c-4802-903b-1ec123510c2d" returned: 1 in 0.757s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22def002-3e0c-4802-903b-1ec123510c2d' failed. Not Retrying. {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 10 12:47:04 devstack cinder-volume[87378]: DEBUG cinder.volume.volume_utils [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] Downloaded image 0f360c23-5dc9-4a4b-acf6-fb66cb04bea9 ((None, [{'url': 'file:///opt/stack/data/glance/images/0f360c23-5dc9-4a4b-acf6-fb66cb04bea9', 'metadata': {}}])) to volume 22def002-3e0c-4802-903b-1ec123510c2d successfully. {{(pid=87378) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 10 12:47:04 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] Temporary image 0f360c23-5dc9-4a4b-acf6-fb66cb04bea9 for user a8874fcca20a401ab71d0885cc4d3031 is deleted. {{(pid=87378) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 10 12:47:04 devstack cinder-volume[87378]: DEBUG cinder.volume.volume_utils [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] Marking volume 22def002-3e0c-4802-903b-1ec123510c2d as bootable. {{(pid=87378) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 10 12:47:04 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] Copying metadata from image 0f360c23-5dc9-4a4b-acf6-fb66cb04bea9 to 22def002-3e0c-4802-903b-1ec123510c2d. {{(pid=87378) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 10 12:47:04 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] Creating volume glance metadata for volume 22def002-3e0c-4802-903b-1ec123510c2d backed by image 0f360c23-5dc9-4a4b-acf6-fb66cb04bea9 with: {'image_id': '0f360c23-5dc9-4a4b-acf6-fb66cb04bea9', 'image_name': 'tempest-scenario-img--1918153463', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87378) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 10 12:47:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2107ef2e-4b28-48be-8f14-4d83e268c033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22def002-3e0c-4802-903b-1ec123510c2d', 'volume_size': 1, 'image_id': '0f360c23-5dc9-4a4b-acf6-fb66cb04bea9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0f360c23-5dc9-4a4b-acf6-fb66cb04bea9', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1918153463', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c9729aa3cc134c0c92a18a8304f91182', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0f360c23-5dc9-4a4b-acf6-fb66cb04bea9', 'created_at': datetime.datetime(2026, 7, 10, 10, 46, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 10, 46, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0f360c23-5dc9-4a4b-acf6-fb66cb04bea9/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74a0ab9d64b0>}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:47:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a918229b-8dbf-468e-924e-2f6c354b3d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:47:04 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] Volume volume-22def002-3e0c-4802-903b-1ec123510c2d (22def002-3e0c-4802-903b-1ec123510c2d): created successfully
Jul 10 12:47:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a918229b-8dbf-468e-924e-2f6c354b3d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:47:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] Flow 'volume_create_manager' (e590d894-382b-4120-9e15-0fe5da72a4e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:47:04 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-5739a5fc-622a-44dd-83b3-de6c1f935bd3 tempest-TestInstancesWithCinderVolumes-1856690417 None] Created volume successfully.
Jul 10 12:47:04 devstack sudo[97583]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9f7606c1-299e-4ac8-99d0-6d55c5ee23b4 tempest-VolumesSnapshotListTestJSON-2038328188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.38cd18d2-1d24-4729-b99d-df49395b5b67" returned: 0 in 0.649s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-9f7606c1-299e-4ac8-99d0-6d55c5ee23b4 tempest-VolumesSnapshotListTestJSON-2038328188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.308s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:47:04 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-9f7606c1-299e-4ac8-99d0-6d55c5ee23b4 tempest-VolumesSnapshotListTestJSON-2038328188 None] Create snapshot completed successfully
Jul 10 12:47:05 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b1c3847-5ea7-4a34-96ad-11f05fd14dbc tempest-GroupsTest-760943615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:47:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2b1c3847-5ea7-4a34-96ad-11f05fd14dbc tempest-GroupsTest-760943615 None] Flow 'volume_create_manager' (fda90e3e-7a26-44c7-94ed-1b9d335f491c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:47:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2b1c3847-5ea7-4a34-96ad-11f05fd14dbc tempest-GroupsTest-760943615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c78bddda-9012-4ec2-94fc-e296348b9db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:47:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2b1c3847-5ea7-4a34-96ad-11f05fd14dbc tempest-GroupsTest-760943615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c78bddda-9012-4ec2-94fc-e296348b9db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1703549907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=38f1dc48-b4f5-4c99-8d4b-b6e5dc7ef357,host='devstack@QuobyteHD#QuobyteHD',id=9f11a067-ea17-4854-9747-7ea442695bf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71921b0a984d4845a29e411a5f396284',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:47:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:47:05Z,use_quota=True,user_id='ce050b5d439743c39a23e5d337fe8f02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2937a770-3aed-4289-ae7b-e2d0f51187f8),volume_type_id=2937a770-3aed-4289-ae7b-e2d0f51187f8)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:47:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2b1c3847-5ea7-4a34-96ad-11f05fd14dbc tempest-GroupsTest-760943615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbf21fcb-3e24-4534-a5d1-90b12409b437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:47:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2b1c3847-5ea7-4a34-96ad-11f05fd14dbc tempest-GroupsTest-760943615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbf21fcb-3e24-4534-a5d1-90b12409b437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:47:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2b1c3847-5ea7-4a34-96ad-11f05fd14dbc tempest-GroupsTest-760943615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c503ea93-6a97-4899-b9d2-ca126731e9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:47:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2b1c3847-5ea7-4a34-96ad-11f05fd14dbc tempest-GroupsTest-760943615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c503ea93-6a97-4899-b9d2-ca126731e9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f11a067-ea17-4854-9747-7ea442695bf5', 'volume_name': 'volume-9f11a067-ea17-4854-9747-7ea442695bf5', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:47:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2b1c3847-5ea7-4a34-96ad-11f05fd14dbc tempest-GroupsTest-760943615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4384ad93-1551-4a2f-9de9-4fac780e6402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:47:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2b1c3847-5ea7-4a34-96ad-11f05fd14dbc tempest-GroupsTest-760943615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4384ad93-1551-4a2f-9de9-4fac780e6402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:47:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2b1c3847-5ea7-4a34-96ad-11f05fd14dbc tempest-GroupsTest-760943615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e7f877b-c6ab-4e69-9170-a1e1d142eb72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:47:05 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-2b1c3847-5ea7-4a34-96ad-11f05fd14dbc tempest-GroupsTest-760943615 None] Volume 9f11a067-ea17-4854-9747-7ea442695bf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f11a067-ea17-4854-9747-7ea442695bf5', 'volume_size': 1}
Jul 10 12:47:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2b1c3847-5ea7-4a34-96ad-11f05fd14dbc tempest-GroupsTest-760943615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:47:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2b1c3847-5ea7-4a34-96ad-11f05fd14dbc tempest-GroupsTest-760943615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:47:05 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-2b1c3847-5ea7-4a34-96ad-11f05fd14dbc tempest-GroupsTest-760943615 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=38f1dc48-b4f5-4c99-8d4b-b6e5dc7ef357,created_at=2026-07-10T10:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1703549907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=38f1dc48-b4f5-4c99-8d4b-b6e5dc7ef357,host='devstack@QuobyteHD#QuobyteHD',id=9f11a067-ea17-4854-9747-7ea442695bf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71921b0a984d4845a29e411a5f396284',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:47:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:47:05Z,use_quota=True,user_id='ce050b5d439743c39a23e5d337fe8f02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2937a770-3aed-4289-ae7b-e2d0f51187f8),volume_type_id=2937a770-3aed-4289-ae7b-e2d0f51187f8)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:47:05 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-2b1c3847-5ea7-4a34-96ad-11f05fd14dbc tempest-GroupsTest-760943615 None] Creating volume 9f11a067-ea17-4854-9747-7ea442695bf5 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:47:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2b1c3847-5ea7-4a34-96ad-11f05fd14dbc tempest-GroupsTest-760943615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:47:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2b1c3847-5ea7-4a34-96ad-11f05fd14dbc tempest-GroupsTest-760943615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:47:05 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-2b1c3847-5ea7-4a34-96ad-11f05fd14dbc tempest-GroupsTest-760943615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:47:05 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-2b1c3847-5ea7-4a34-96ad-11f05fd14dbc tempest-GroupsTest-760943615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:47:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2b1c3847-5ea7-4a34-96ad-11f05fd14dbc tempest-GroupsTest-760943615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:47:05 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-2b1c3847-5ea7-4a34-96ad-11f05fd14dbc tempest-GroupsTest-760943615 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:47:05 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-2b1c3847-5ea7-4a34-96ad-11f05fd14dbc tempest-GroupsTest-760943615 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:47:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2b1c3847-5ea7-4a34-96ad-11f05fd14dbc tempest-GroupsTest-760943615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9f11a067-ea17-4854-9747-7ea442695bf5 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:05 devstack sudo[97589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9f11a067-ea17-4854-9747-7ea442695bf5 1073741824
Jul 10 12:47:05 devstack sudo[97589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:06 devstack sudo[97589]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2b1c3847-5ea7-4a34-96ad-11f05fd14dbc tempest-GroupsTest-760943615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9f11a067-ea17-4854-9747-7ea442695bf5 1073741824" returned: 0 in 1.304s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2b1c3847-5ea7-4a34-96ad-11f05fd14dbc tempest-GroupsTest-760943615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9f11a067-ea17-4854-9747-7ea442695bf5 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:06 devstack sudo[97597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9f11a067-ea17-4854-9747-7ea442695bf5
Jul 10 12:47:06 devstack sudo[97597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:06 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b4f279e6-46a7-42f4-bbc8-6ac838a2eabc tempest-VolumesSnapshotListTestJSON-2038328188 None] Acquiring lock "cinder-38cd18d2-1d24-4729-b99d-df49395b5b67-delete_snapshot" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:47:07 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b4f279e6-46a7-42f4-bbc8-6ac838a2eabc tempest-VolumesSnapshotListTestJSON-2038328188 None] Lock "cinder-38cd18d2-1d24-4729-b99d-df49395b5b67-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:47:07 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b4f279e6-46a7-42f4-bbc8-6ac838a2eabc tempest-VolumesSnapshotListTestJSON-2038328188 None] Acquiring lock "cinder-quobyte-439b54a3-8776-4fd8-a15f-f023a799caf4" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:47:07 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b4f279e6-46a7-42f4-bbc8-6ac838a2eabc tempest-VolumesSnapshotListTestJSON-2038328188 None] Lock "cinder-quobyte-439b54a3-8776-4fd8-a15f-f023a799caf4" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:47:07 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b4f279e6-46a7-42f4-bbc8-6ac838a2eabc tempest-VolumesSnapshotListTestJSON-2038328188 None] Acquiring lock "cinder-quobyte-38cd18d2-1d24-4729-b99d-df49395b5b67" by "_delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:47:07 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b4f279e6-46a7-42f4-bbc8-6ac838a2eabc tempest-VolumesSnapshotListTestJSON-2038328188 None] Lock "cinder-quobyte-38cd18d2-1d24-4729-b99d-df49395b5b67" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:47:07 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-b4f279e6-46a7-42f4-bbc8-6ac838a2eabc tempest-VolumesSnapshotListTestJSON-2038328188 None] Deleting offline snapshot 38cd18d2-1d24-4729-b99d-df49395b5b67 of volume 439b54a3-8776-4fd8-a15f-f023a799caf4 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 10 12:47:07 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-b4f279e6-46a7-42f4-bbc8-6ac838a2eabc tempest-VolumesSnapshotListTestJSON-2038328188 None] snapshot_file for this snap is: volume-439b54a3-8776-4fd8-a15f-f023a799caf4.38cd18d2-1d24-4729-b99d-df49395b5b67 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 10 12:47:07 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[09557d6f-48e5-43c5-b986-e018b15d59b3]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:47:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b4f279e6-46a7-42f4-bbc8-6ac838a2eabc tempest-VolumesSnapshotListTestJSON-2038328188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.38cd18d2-1d24-4729-b99d-df49395b5b67 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:07 devstack sudo[97599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.38cd18d2-1d24-4729-b99d-df49395b5b67
Jul 10 12:47:07 devstack sudo[97599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:07 devstack sudo[97597]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2b1c3847-5ea7-4a34-96ad-11f05fd14dbc tempest-GroupsTest-760943615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9f11a067-ea17-4854-9747-7ea442695bf5" returned: 0 in 0.769s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:07 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-2b1c3847-5ea7-4a34-96ad-11f05fd14dbc tempest-GroupsTest-760943615 None] <== create_volume: return (2156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:47:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2b1c3847-5ea7-4a34-96ad-11f05fd14dbc tempest-GroupsTest-760943615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.158s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:47:07 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2b1c3847-5ea7-4a34-96ad-11f05fd14dbc tempest-GroupsTest-760943615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e7f877b-c6ab-4e69-9170-a1e1d142eb72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f11a067-ea17-4854-9747-7ea442695bf5', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:47:07 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2b1c3847-5ea7-4a34-96ad-11f05fd14dbc tempest-GroupsTest-760943615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8763830-1eab-457f-bd9f-a70c2f554bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:47:07 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-2b1c3847-5ea7-4a34-96ad-11f05fd14dbc tempest-GroupsTest-760943615 None] Volume volume-9f11a067-ea17-4854-9747-7ea442695bf5 (9f11a067-ea17-4854-9747-7ea442695bf5): created successfully
Jul 10 12:47:07 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2b1c3847-5ea7-4a34-96ad-11f05fd14dbc tempest-GroupsTest-760943615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8763830-1eab-457f-bd9f-a70c2f554bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:47:07 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2b1c3847-5ea7-4a34-96ad-11f05fd14dbc tempest-GroupsTest-760943615 None] Flow 'volume_create_manager' (fda90e3e-7a26-44c7-94ed-1b9d335f491c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:47:07 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-2b1c3847-5ea7-4a34-96ad-11f05fd14dbc tempest-GroupsTest-760943615 None] Created volume successfully.
Jul 10 12:47:07 devstack sudo[97599]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b4f279e6-46a7-42f4-bbc8-6ac838a2eabc tempest-VolumesSnapshotListTestJSON-2038328188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.38cd18d2-1d24-4729-b99d-df49395b5b67" returned: 0 in 0.863s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:07 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-b4f279e6-46a7-42f4-bbc8-6ac838a2eabc tempest-VolumesSnapshotListTestJSON-2038328188 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-439b54a3-8776-4fd8-a15f-f023a799caf4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:47:07 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e27ee6-da8f-46ba-bee9-d2717e3520c9]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:47:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b4f279e6-46a7-42f4-bbc8-6ac838a2eabc tempest-VolumesSnapshotListTestJSON-2038328188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.47150dee-eca7-4b4a-bae6-a169a668c681 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:08 devstack sudo[97605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.47150dee-eca7-4b4a-bae6-a169a668c681
Jul 10 12:47:08 devstack sudo[97605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:08 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-30a38327-c739-4dfa-bbee-f0cd4d81ff30 tempest-GroupsTest-760943615 None] Acquiring lock "cinder-quobyte-9f11a067-ea17-4854-9747-7ea442695bf5" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:47:08 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-30a38327-c739-4dfa-bbee-f0cd4d81ff30 tempest-GroupsTest-760943615 None] Lock "cinder-quobyte-9f11a067-ea17-4854-9747-7ea442695bf5" acquired by "delete_volume" :: waited 0.018s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:47:08 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7547ad-45d7-4e21-8de9-930ff3756678]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:47:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-30a38327-c739-4dfa-bbee-f0cd4d81ff30 tempest-GroupsTest-760943615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9f11a067-ea17-4854-9747-7ea442695bf5 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:08 devstack sudo[97607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9f11a067-ea17-4854-9747-7ea442695bf5
Jul 10 12:47:08 devstack sudo[97607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:08 devstack sudo[97605]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b4f279e6-46a7-42f4-bbc8-6ac838a2eabc tempest-VolumesSnapshotListTestJSON-2038328188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.47150dee-eca7-4b4a-bae6-a169a668c681" returned: 0 in 0.809s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:08 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-b4f279e6-46a7-42f4-bbc8-6ac838a2eabc tempest-VolumesSnapshotListTestJSON-2038328188 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-439b54a3-8776-4fd8-a15f-f023a799caf4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:47:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b4f279e6-46a7-42f4-bbc8-6ac838a2eabc tempest-VolumesSnapshotListTestJSON-2038328188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.38cd18d2-1d24-4729-b99d-df49395b5b67 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:08 devstack sudo[97612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.38cd18d2-1d24-4729-b99d-df49395b5b67
Jul 10 12:47:08 devstack sudo[97612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:09 devstack sudo[97607]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-30a38327-c739-4dfa-bbee-f0cd4d81ff30 tempest-GroupsTest-760943615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9f11a067-ea17-4854-9747-7ea442695bf5" returned: 0 in 0.829s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-30a38327-c739-4dfa-bbee-f0cd4d81ff30 tempest-GroupsTest-760943615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9f11a067-ea17-4854-9747-7ea442695bf5 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:09 devstack sudo[97619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9f11a067-ea17-4854-9747-7ea442695bf5
Jul 10 12:47:09 devstack sudo[97619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:09 devstack sudo[97612]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b4f279e6-46a7-42f4-bbc8-6ac838a2eabc tempest-VolumesSnapshotListTestJSON-2038328188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.38cd18d2-1d24-4729-b99d-df49395b5b67" returned: 0 in 0.857s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b4f279e6-46a7-42f4-bbc8-6ac838a2eabc tempest-VolumesSnapshotListTestJSON-2038328188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.38cd18d2-1d24-4729-b99d-df49395b5b67 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:09 devstack sudo[97627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.38cd18d2-1d24-4729-b99d-df49395b5b67
Jul 10 12:47:09 devstack sudo[97627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:09 devstack sudo[97619]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-30a38327-c739-4dfa-bbee-f0cd4d81ff30 tempest-GroupsTest-760943615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9f11a067-ea17-4854-9747-7ea442695bf5" returned: 0 in 0.738s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:09 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-30a38327-c739-4dfa-bbee-f0cd4d81ff30 tempest-GroupsTest-760943615 None] Lock "cinder-quobyte-9f11a067-ea17-4854-9747-7ea442695bf5" released by "delete_volume" :: held 1.612s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:47:10 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-df7fe3ac-c5a4-433f-83dd-8cedbd9bd78f tempest-AttachVolumeNegativeTest-2056769334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:47:10 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-df7fe3ac-c5a4-433f-83dd-8cedbd9bd78f tempest-AttachVolumeNegativeTest-2056769334 None] Flow 'volume_create_manager' (c2a33e1c-8f73-41a4-806e-3c0aba5d59f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:47:10 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-df7fe3ac-c5a4-433f-83dd-8cedbd9bd78f tempest-AttachVolumeNegativeTest-2056769334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68876420-25bb-487b-bbab-01c31e4cc4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:47:10 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-df7fe3ac-c5a4-433f-83dd-8cedbd9bd78f tempest-AttachVolumeNegativeTest-2056769334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68876420-25bb-487b-bbab-01c31e4cc4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1216053547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ec00070-451a-491f-9031-07380d9e52ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a63dc9ad7bb64e71947d627c39ccb30a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:47:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:47:10Z,use_quota=True,user_id='4e2b69d2fc924858bd316c21d4da30cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:47:10 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-df7fe3ac-c5a4-433f-83dd-8cedbd9bd78f tempest-AttachVolumeNegativeTest-2056769334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d602112c-c188-4931-8c84-7fd181706b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:47:10 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-df7fe3ac-c5a4-433f-83dd-8cedbd9bd78f tempest-AttachVolumeNegativeTest-2056769334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d602112c-c188-4931-8c84-7fd181706b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:47:10 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-df7fe3ac-c5a4-433f-83dd-8cedbd9bd78f tempest-AttachVolumeNegativeTest-2056769334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca0bbdd0-754b-447e-9a8d-5ee759e9bcb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:47:10 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-df7fe3ac-c5a4-433f-83dd-8cedbd9bd78f tempest-AttachVolumeNegativeTest-2056769334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca0bbdd0-754b-447e-9a8d-5ee759e9bcb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ec00070-451a-491f-9031-07380d9e52ae', 'volume_name': 'volume-2ec00070-451a-491f-9031-07380d9e52ae', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:47:10 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-df7fe3ac-c5a4-433f-83dd-8cedbd9bd78f tempest-AttachVolumeNegativeTest-2056769334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (950c1bf1-54b5-4033-9950-a3e90166ae47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:47:10 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-df7fe3ac-c5a4-433f-83dd-8cedbd9bd78f tempest-AttachVolumeNegativeTest-2056769334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (950c1bf1-54b5-4033-9950-a3e90166ae47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:47:10 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-df7fe3ac-c5a4-433f-83dd-8cedbd9bd78f tempest-AttachVolumeNegativeTest-2056769334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d7c9823-3a7f-4818-95bd-8249127bbaf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:47:10 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-df7fe3ac-c5a4-433f-83dd-8cedbd9bd78f tempest-AttachVolumeNegativeTest-2056769334 None] Volume 2ec00070-451a-491f-9031-07380d9e52ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ec00070-451a-491f-9031-07380d9e52ae', 'volume_size': 1}
Jul 10 12:47:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-df7fe3ac-c5a4-433f-83dd-8cedbd9bd78f tempest-AttachVolumeNegativeTest-2056769334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:47:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-df7fe3ac-c5a4-433f-83dd-8cedbd9bd78f tempest-AttachVolumeNegativeTest-2056769334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:47:10 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-df7fe3ac-c5a4-433f-83dd-8cedbd9bd78f tempest-AttachVolumeNegativeTest-2056769334 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1216053547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ec00070-451a-491f-9031-07380d9e52ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a63dc9ad7bb64e71947d627c39ccb30a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:47:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:47:10Z,use_quota=True,user_id='4e2b69d2fc924858bd316c21d4da30cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:47:10 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-df7fe3ac-c5a4-433f-83dd-8cedbd9bd78f tempest-AttachVolumeNegativeTest-2056769334 None] Creating volume 2ec00070-451a-491f-9031-07380d9e52ae {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:47:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-df7fe3ac-c5a4-433f-83dd-8cedbd9bd78f tempest-AttachVolumeNegativeTest-2056769334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:47:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-df7fe3ac-c5a4-433f-83dd-8cedbd9bd78f tempest-AttachVolumeNegativeTest-2056769334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:47:10 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-df7fe3ac-c5a4-433f-83dd-8cedbd9bd78f tempest-AttachVolumeNegativeTest-2056769334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:47:10 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-df7fe3ac-c5a4-433f-83dd-8cedbd9bd78f tempest-AttachVolumeNegativeTest-2056769334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:47:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-df7fe3ac-c5a4-433f-83dd-8cedbd9bd78f tempest-AttachVolumeNegativeTest-2056769334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:47:10 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-df7fe3ac-c5a4-433f-83dd-8cedbd9bd78f tempest-AttachVolumeNegativeTest-2056769334 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:47:10 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-df7fe3ac-c5a4-433f-83dd-8cedbd9bd78f tempest-AttachVolumeNegativeTest-2056769334 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:47:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-df7fe3ac-c5a4-433f-83dd-8cedbd9bd78f tempest-AttachVolumeNegativeTest-2056769334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2ec00070-451a-491f-9031-07380d9e52ae 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:10 devstack sudo[97630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2ec00070-451a-491f-9031-07380d9e52ae 1073741824
Jul 10 12:47:10 devstack sudo[97630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:10 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-30a38327-c739-4dfa-bbee-f0cd4d81ff30 tempest-GroupsTest-760943615 None] Created reservations ['2a7afcab-9fcb-4a0d-a440-0545203974ec'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:47:10 devstack cinder-volume[87378]: WARNING cinder.quota [None req-30a38327-c739-4dfa-bbee-f0cd4d81ff30 tempest-GroupsTest-760943615 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1278735633 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1278735633, it is now deprecated. Please use the default quota class for default quota.
Jul 10 12:47:10 devstack cinder-volume[87378]: WARNING cinder.quota [None req-30a38327-c739-4dfa-bbee-f0cd4d81ff30 tempest-GroupsTest-760943615 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1278735633 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1278735633, it is now deprecated. Please use the default quota class for default quota.
Jul 10 12:47:10 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-30a38327-c739-4dfa-bbee-f0cd4d81ff30 tempest-GroupsTest-760943615 None] Created reservations ['d465bf72-b047-4126-918d-1908fe8aa87e', '6b234e51-31b3-4532-8034-92e20121eeb3', '8e0b3811-64fd-437c-896a-a526d2f4766c', '44907b33-c37d-4f0d-9e01-9daaccef6fd8'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:47:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-30a38327-c739-4dfa-bbee-f0cd4d81ff30 tempest-GroupsTest-760943615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:47:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-30a38327-c739-4dfa-bbee-f0cd4d81ff30 tempest-GroupsTest-760943615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:47:10 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-30a38327-c739-4dfa-bbee-f0cd4d81ff30 tempest-GroupsTest-760943615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:47:10 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-30a38327-c739-4dfa-bbee-f0cd4d81ff30 tempest-GroupsTest-760943615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:47:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-30a38327-c739-4dfa-bbee-f0cd4d81ff30 tempest-GroupsTest-760943615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:47:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-30a38327-c739-4dfa-bbee-f0cd4d81ff30 tempest-GroupsTest-760943615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:10 devstack sudo[97633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:47:10 devstack sudo[97633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:10 devstack sudo[97627]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b4f279e6-46a7-42f4-bbc8-6ac838a2eabc tempest-VolumesSnapshotListTestJSON-2038328188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.38cd18d2-1d24-4729-b99d-df49395b5b67" returned: 0 in 0.831s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:10 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b4f279e6-46a7-42f4-bbc8-6ac838a2eabc tempest-VolumesSnapshotListTestJSON-2038328188 None] Lock "cinder-quobyte-38cd18d2-1d24-4729-b99d-df49395b5b67" released by "_delete_snapshot" :: held 3.479s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:47:10 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b4f279e6-46a7-42f4-bbc8-6ac838a2eabc tempest-VolumesSnapshotListTestJSON-2038328188 None] Lock "cinder-quobyte-439b54a3-8776-4fd8-a15f-f023a799caf4" released by "delete_snapshot" :: held 3.505s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:47:10 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-b4f279e6-46a7-42f4-bbc8-6ac838a2eabc tempest-VolumesSnapshotListTestJSON-2038328188 None] Created reservations ['8c7e237c-2ba7-4c0e-86e9-9569c4be2302', '4d0dc75c-7f82-4a03-ab9c-79712a57f2e1', 'b8ead0d3-d37d-4fd7-b5bc-11774449d42e', '4c0cb505-4c7e-458c-8d6f-3515640cc301'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:47:10 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-b4f279e6-46a7-42f4-bbc8-6ac838a2eabc tempest-VolumesSnapshotListTestJSON-2038328188 None] Delete snapshot completed successfully.
Jul 10 12:47:10 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b4f279e6-46a7-42f4-bbc8-6ac838a2eabc tempest-VolumesSnapshotListTestJSON-2038328188 None] Lock "cinder-38cd18d2-1d24-4729-b99d-df49395b5b67-delete_snapshot" released by "delete_snapshot" :: held 3.670s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:47:10 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-02fa00ba-836a-4f81-ad16-33724c12da02 tempest-GroupsTest-760943615 None] Created reservations ['18a9426a-f81a-4189-b05f-fcfaca048cf7'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:47:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-02fa00ba-836a-4f81-ad16-33724c12da02 tempest-GroupsTest-760943615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:47:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-02fa00ba-836a-4f81-ad16-33724c12da02 tempest-GroupsTest-760943615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:47:11 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-02fa00ba-836a-4f81-ad16-33724c12da02 tempest-GroupsTest-760943615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:47:11 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-02fa00ba-836a-4f81-ad16-33724c12da02 tempest-GroupsTest-760943615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:47:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-02fa00ba-836a-4f81-ad16-33724c12da02 tempest-GroupsTest-760943615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:47:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-02fa00ba-836a-4f81-ad16-33724c12da02 tempest-GroupsTest-760943615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:11 devstack sudo[97639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:47:11 devstack sudo[97639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:11 devstack sudo[97630]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-df7fe3ac-c5a4-433f-83dd-8cedbd9bd78f tempest-AttachVolumeNegativeTest-2056769334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2ec00070-451a-491f-9031-07380d9e52ae 1073741824" returned: 0 in 0.995s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:11 devstack sudo[97633]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-30a38327-c739-4dfa-bbee-f0cd4d81ff30 tempest-GroupsTest-760943615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.773s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:11 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-30a38327-c739-4dfa-bbee-f0cd4d81ff30 tempest-GroupsTest-760943615 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:47:11 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-30a38327-c739-4dfa-bbee-f0cd4d81ff30 tempest-GroupsTest-760943615 None] Delete group completed successfully.
Jul 10 12:47:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-df7fe3ac-c5a4-433f-83dd-8cedbd9bd78f tempest-AttachVolumeNegativeTest-2056769334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2ec00070-451a-491f-9031-07380d9e52ae {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:11 devstack sudo[97642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2ec00070-451a-491f-9031-07380d9e52ae
Jul 10 12:47:11 devstack sudo[97642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:11 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-833a82e5-8cd4-41b3-9d10-4dd2d264d6de tempest-VolumesSnapshotListTestJSON-2038328188 None] Acquiring lock "cinder-47150dee-eca7-4b4a-bae6-a169a668c681-delete_snapshot" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:47:11 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-833a82e5-8cd4-41b3-9d10-4dd2d264d6de tempest-VolumesSnapshotListTestJSON-2038328188 None] Lock "cinder-47150dee-eca7-4b4a-bae6-a169a668c681-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:47:11 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-833a82e5-8cd4-41b3-9d10-4dd2d264d6de tempest-VolumesSnapshotListTestJSON-2038328188 None] Acquiring lock "cinder-quobyte-439b54a3-8776-4fd8-a15f-f023a799caf4" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:47:11 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-833a82e5-8cd4-41b3-9d10-4dd2d264d6de tempest-VolumesSnapshotListTestJSON-2038328188 None] Lock "cinder-quobyte-439b54a3-8776-4fd8-a15f-f023a799caf4" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:47:11 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-833a82e5-8cd4-41b3-9d10-4dd2d264d6de tempest-VolumesSnapshotListTestJSON-2038328188 None] Acquiring lock "cinder-quobyte-47150dee-eca7-4b4a-bae6-a169a668c681" by "_delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:47:11 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-833a82e5-8cd4-41b3-9d10-4dd2d264d6de tempest-VolumesSnapshotListTestJSON-2038328188 None] Lock "cinder-quobyte-47150dee-eca7-4b4a-bae6-a169a668c681" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:47:11 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-833a82e5-8cd4-41b3-9d10-4dd2d264d6de tempest-VolumesSnapshotListTestJSON-2038328188 None] Deleting offline snapshot 47150dee-eca7-4b4a-bae6-a169a668c681 of volume 439b54a3-8776-4fd8-a15f-f023a799caf4 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 10 12:47:11 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-833a82e5-8cd4-41b3-9d10-4dd2d264d6de tempest-VolumesSnapshotListTestJSON-2038328188 None] snapshot_file for this snap is: volume-439b54a3-8776-4fd8-a15f-f023a799caf4.47150dee-eca7-4b4a-bae6-a169a668c681 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 10 12:47:11 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa13d326-7378-4e13-abf1-eeb922c910f5]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:47:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-833a82e5-8cd4-41b3-9d10-4dd2d264d6de tempest-VolumesSnapshotListTestJSON-2038328188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.47150dee-eca7-4b4a-bae6-a169a668c681 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:11 devstack sudo[97644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.47150dee-eca7-4b4a-bae6-a169a668c681
Jul 10 12:47:11 devstack sudo[97644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:11 devstack sudo[97639]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-02fa00ba-836a-4f81-ad16-33724c12da02 tempest-GroupsTest-760943615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.925s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:11 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-02fa00ba-836a-4f81-ad16-33724c12da02 tempest-GroupsTest-760943615 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:47:11 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-02fa00ba-836a-4f81-ad16-33724c12da02 tempest-GroupsTest-760943615 None] Delete group completed successfully.
Jul 10 12:47:12 devstack sudo[97642]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-df7fe3ac-c5a4-433f-83dd-8cedbd9bd78f tempest-AttachVolumeNegativeTest-2056769334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2ec00070-451a-491f-9031-07380d9e52ae" returned: 0 in 0.881s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-df7fe3ac-c5a4-433f-83dd-8cedbd9bd78f tempest-AttachVolumeNegativeTest-2056769334 None] <== create_volume: return (1934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:47:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-df7fe3ac-c5a4-433f-83dd-8cedbd9bd78f tempest-AttachVolumeNegativeTest-2056769334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.937s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:47:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-df7fe3ac-c5a4-433f-83dd-8cedbd9bd78f tempest-AttachVolumeNegativeTest-2056769334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d7c9823-3a7f-4818-95bd-8249127bbaf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ec00070-451a-491f-9031-07380d9e52ae', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:47:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-df7fe3ac-c5a4-433f-83dd-8cedbd9bd78f tempest-AttachVolumeNegativeTest-2056769334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efe957ec-51a3-4df7-937d-f3824d773381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:47:12 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-df7fe3ac-c5a4-433f-83dd-8cedbd9bd78f tempest-AttachVolumeNegativeTest-2056769334 None] Volume volume-2ec00070-451a-491f-9031-07380d9e52ae (2ec00070-451a-491f-9031-07380d9e52ae): created successfully
Jul 10 12:47:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-df7fe3ac-c5a4-433f-83dd-8cedbd9bd78f tempest-AttachVolumeNegativeTest-2056769334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efe957ec-51a3-4df7-937d-f3824d773381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:47:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-df7fe3ac-c5a4-433f-83dd-8cedbd9bd78f tempest-AttachVolumeNegativeTest-2056769334 None] Flow 'volume_create_manager' (c2a33e1c-8f73-41a4-806e-3c0aba5d59f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:47:12 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-df7fe3ac-c5a4-433f-83dd-8cedbd9bd78f tempest-AttachVolumeNegativeTest-2056769334 None] Created volume successfully.
Jul 10 12:47:12 devstack sudo[97644]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-833a82e5-8cd4-41b3-9d10-4dd2d264d6de tempest-VolumesSnapshotListTestJSON-2038328188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.47150dee-eca7-4b4a-bae6-a169a668c681" returned: 0 in 0.931s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-833a82e5-8cd4-41b3-9d10-4dd2d264d6de tempest-VolumesSnapshotListTestJSON-2038328188 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-439b54a3-8776-4fd8-a15f-f023a799caf4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:47:12 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd12174-5a12-4577-916b-936d5e73fdd1]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:47:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-833a82e5-8cd4-41b3-9d10-4dd2d264d6de tempest-VolumesSnapshotListTestJSON-2038328188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.609b3cb9-21d6-4bba-8128-8dd89d0c6156 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:12 devstack sudo[97651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.609b3cb9-21d6-4bba-8128-8dd89d0c6156
Jul 10 12:47:12 devstack sudo[97651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:12 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-a5bf9dcf-b581-4106-baa4-46ea5a38cec6 tempest-GroupsTest-760943615 None] Group tempest-GroupsTest-Group-848792091: creating
Jul 10 12:47:12 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-a5bf9dcf-b581-4106-baa4-46ea5a38cec6 tempest-GroupsTest-760943615 None] Group tempest-GroupsTest-Group-848792091: created successfully
Jul 10 12:47:12 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-a5bf9dcf-b581-4106-baa4-46ea5a38cec6 tempest-GroupsTest-760943615 None] Create group completed successfully.
Jul 10 12:47:12 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:47:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:47:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:47:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:47:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:47:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:47:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:13 devstack sudo[97653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:47:13 devstack sudo[97653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-cafbf430-6ce9-48c6-b4a6-00260787f1b1 req-47fc3172-df5d-4fda-b56e-4288369491c8 tempest-TestInstancesWithCinderVolumes-1856690417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:47:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-cafbf430-6ce9-48c6-b4a6-00260787f1b1 req-47fc3172-df5d-4fda-b56e-4288369491c8 tempest-TestInstancesWithCinderVolumes-1856690417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:47:13 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d8b996-4a08-4adf-8335-507663cd54c7]: (4, 'raw') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:47:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-cafbf430-6ce9-48c6-b4a6-00260787f1b1 req-47fc3172-df5d-4fda-b56e-4288369491c8 tempest-TestInstancesWithCinderVolumes-1856690417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22def002-3e0c-4802-903b-1ec123510c2d {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:13 devstack sudo[97665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22def002-3e0c-4802-903b-1ec123510c2d
Jul 10 12:47:13 devstack sudo[97665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:13 devstack sudo[97651]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-833a82e5-8cd4-41b3-9d10-4dd2d264d6de tempest-VolumesSnapshotListTestJSON-2038328188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.609b3cb9-21d6-4bba-8128-8dd89d0c6156" returned: 0 in 1.268s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:13 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-833a82e5-8cd4-41b3-9d10-4dd2d264d6de tempest-VolumesSnapshotListTestJSON-2038328188 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-439b54a3-8776-4fd8-a15f-f023a799caf4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:47:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-833a82e5-8cd4-41b3-9d10-4dd2d264d6de tempest-VolumesSnapshotListTestJSON-2038328188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.47150dee-eca7-4b4a-bae6-a169a668c681 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:13 devstack sudo[97672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.47150dee-eca7-4b4a-bae6-a169a668c681
Jul 10 12:47:13 devstack sudo[97672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:13 devstack sudo[97653]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.894s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:13 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:47:13 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager._thread_info {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:47:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread count: 28 {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 10 12:47:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread info: [<_MainThread(MainThread, started 128233544536192)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128233445424704)>, <Thread(Thread-3 (stat_writer), started daemon 128233435118528)>, <Thread(Rabbit-heartbeat, started daemon 128233435718016)>, <Thread(Thread-5 (_runner), started daemon 128233432624448)>, <Thread(Thread-7 (_runner), started daemon 128233432674688)>, <Thread(fd_logger, started daemon 128233428569472)>, <Thread(privsep_reader, started daemon 128233429417088)>, <Thread(tpool_thread_0, started daemon 128233421182656)>, <Thread(tpool_thread_1, started daemon 128233412789952)>, <Thread(tpool_thread_2, started daemon 128233404397248)>, <Thread(tpool_thread_3, started daemon 128233396004544)>, <Thread(tpool_thread_4, started daemon 128233387611840)>, <Thread(tpool_thread_5, started daemon 128233379219136)>, <Thread(tpool_thread_6, started daemon 128233370826432)>, <Thread(tpool_thread_7, started daemon 128233362433728)>, <Thread(tpool_thread_8, started daemon 128233354041024)>, <Thread(tpool_thread_9, started daemon 128233345631936)>, <Thread(tpool_thread_10, started daemon 128233337222848)>, <Thread(tpool_thread_11, started daemon 128233328813760)>, <Thread(tpool_thread_12, started daemon 128233320404672)>, <Thread(tpool_thread_13, started daemon 128233311995584)>, <Thread(tpool_thread_14, started daemon 128233303586496)>, <Thread(tpool_thread_15, started daemon 128233295177408)>, <Thread(tpool_thread_16, started daemon 128233286768320)>, <Thread(tpool_thread_17, started daemon 128233278359232)>, <Thread(tpool_thread_18, started daemon 128233269950144)>, <Thread(tpool_thread_19, started daemon 128233261541056)>] {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 10 12:47:14 devstack sudo[97665]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-cafbf430-6ce9-48c6-b4a6-00260787f1b1 req-47fc3172-df5d-4fda-b56e-4288369491c8 tempest-TestInstancesWithCinderVolumes-1856690417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22def002-3e0c-4802-903b-1ec123510c2d" returned: 0 in 0.941s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-cafbf430-6ce9-48c6-b4a6-00260787f1b1 req-47fc3172-df5d-4fda-b56e-4288369491c8 tempest-TestInstancesWithCinderVolumes-1856690417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22def002-3e0c-4802-903b-1ec123510c2d {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:14 devstack sudo[97678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22def002-3e0c-4802-903b-1ec123510c2d
Jul 10 12:47:14 devstack sudo[97678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:14 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bec9f14-bd1b-4ebf-8f47-260e5381c2ed tempest-GroupsTest-760943615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:47:14 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9bec9f14-bd1b-4ebf-8f47-260e5381c2ed tempest-GroupsTest-760943615 None] Flow 'volume_create_manager' (9f2567e2-31b2-4712-96e6-b3e01dc41f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:47:14 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9bec9f14-bd1b-4ebf-8f47-260e5381c2ed tempest-GroupsTest-760943615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2502740-b7ed-4e5f-950e-780c8599612a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:47:14 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9bec9f14-bd1b-4ebf-8f47-260e5381c2ed tempest-GroupsTest-760943615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2502740-b7ed-4e5f-950e-780c8599612a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:47:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-984717666',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=803e4b01-bc34-4865-8147-d86f4bbb2f5e,host='devstack@QuobyteHD#QuobyteHD',id=ef8b4f13-4a6b-4559-b953-f768808504c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71921b0a984d4845a29e411a5f396284',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:47:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:47:15Z,use_quota=True,user_id='ce050b5d439743c39a23e5d337fe8f02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f76ccb2a-ed8f-41e2-85a5-0814c755ef24),volume_type_id=f76ccb2a-ed8f-41e2-85a5-0814c755ef24)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:47:14 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9bec9f14-bd1b-4ebf-8f47-260e5381c2ed tempest-GroupsTest-760943615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8f5e76d-5886-4c87-9c81-20ccf713e620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:47:14 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9bec9f14-bd1b-4ebf-8f47-260e5381c2ed tempest-GroupsTest-760943615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8f5e76d-5886-4c87-9c81-20ccf713e620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:47:14 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9bec9f14-bd1b-4ebf-8f47-260e5381c2ed tempest-GroupsTest-760943615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a7a2907-f7c6-4427-817d-485beffdf7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:47:14 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9bec9f14-bd1b-4ebf-8f47-260e5381c2ed tempest-GroupsTest-760943615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a7a2907-f7c6-4427-817d-485beffdf7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef8b4f13-4a6b-4559-b953-f768808504c3', 'volume_name': 'volume-ef8b4f13-4a6b-4559-b953-f768808504c3', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:47:14 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9bec9f14-bd1b-4ebf-8f47-260e5381c2ed tempest-GroupsTest-760943615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e2ca942-a6c5-4bc4-864a-5a678a324d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:47:14 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9bec9f14-bd1b-4ebf-8f47-260e5381c2ed tempest-GroupsTest-760943615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e2ca942-a6c5-4bc4-864a-5a678a324d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:47:14 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9bec9f14-bd1b-4ebf-8f47-260e5381c2ed tempest-GroupsTest-760943615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3108ef39-6ef2-43e7-a692-9e0e20130291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:47:14 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-9bec9f14-bd1b-4ebf-8f47-260e5381c2ed tempest-GroupsTest-760943615 None] Volume ef8b4f13-4a6b-4559-b953-f768808504c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef8b4f13-4a6b-4559-b953-f768808504c3', 'volume_size': 1}
Jul 10 12:47:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-9bec9f14-bd1b-4ebf-8f47-260e5381c2ed tempest-GroupsTest-760943615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:47:14 devstack sudo[97672]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-833a82e5-8cd4-41b3-9d10-4dd2d264d6de tempest-VolumesSnapshotListTestJSON-2038328188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.47150dee-eca7-4b4a-bae6-a169a668c681" returned: 0 in 1.134s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-833a82e5-8cd4-41b3-9d10-4dd2d264d6de tempest-VolumesSnapshotListTestJSON-2038328188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.47150dee-eca7-4b4a-bae6-a169a668c681 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:14 devstack sudo[97684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.47150dee-eca7-4b4a-bae6-a169a668c681
Jul 10 12:47:14 devstack sudo[97684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:15 devstack sudo[97678]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-cafbf430-6ce9-48c6-b4a6-00260787f1b1 req-47fc3172-df5d-4fda-b56e-4288369491c8 tempest-TestInstancesWithCinderVolumes-1856690417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22def002-3e0c-4802-903b-1ec123510c2d" returned: 1 in 0.879s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-cafbf430-6ce9-48c6-b4a6-00260787f1b1 req-47fc3172-df5d-4fda-b56e-4288369491c8 tempest-TestInstancesWithCinderVolumes-1856690417 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22def002-3e0c-4802-903b-1ec123510c2d' failed. Not Retrying. {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 10 12:47:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-cafbf430-6ce9-48c6-b4a6-00260787f1b1 req-47fc3172-df5d-4fda-b56e-4288369491c8 tempest-TestInstancesWithCinderVolumes-1856690417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.878s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:47:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-9bec9f14-bd1b-4ebf-8f47-260e5381c2ed tempest-GroupsTest-760943615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.515s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:47:15 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-9bec9f14-bd1b-4ebf-8f47-260e5381c2ed tempest-GroupsTest-760943615 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=803e4b01-bc34-4865-8147-d86f4bbb2f5e,created_at=2026-07-10T10:47:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-984717666',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=803e4b01-bc34-4865-8147-d86f4bbb2f5e,host='devstack@QuobyteHD#QuobyteHD',id=ef8b4f13-4a6b-4559-b953-f768808504c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71921b0a984d4845a29e411a5f396284',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:47:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:47:15Z,use_quota=True,user_id='ce050b5d439743c39a23e5d337fe8f02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f76ccb2a-ed8f-41e2-85a5-0814c755ef24),volume_type_id=f76ccb2a-ed8f-41e2-85a5-0814c755ef24)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:47:15 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-9bec9f14-bd1b-4ebf-8f47-260e5381c2ed tempest-GroupsTest-760943615 None] Creating volume ef8b4f13-4a6b-4559-b953-f768808504c3 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:47:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-9bec9f14-bd1b-4ebf-8f47-260e5381c2ed tempest-GroupsTest-760943615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:47:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-9bec9f14-bd1b-4ebf-8f47-260e5381c2ed tempest-GroupsTest-760943615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:47:15 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-9bec9f14-bd1b-4ebf-8f47-260e5381c2ed tempest-GroupsTest-760943615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:47:15 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-9bec9f14-bd1b-4ebf-8f47-260e5381c2ed tempest-GroupsTest-760943615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:47:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-9bec9f14-bd1b-4ebf-8f47-260e5381c2ed tempest-GroupsTest-760943615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:47:15 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-9bec9f14-bd1b-4ebf-8f47-260e5381c2ed tempest-GroupsTest-760943615 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:47:15 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-9bec9f14-bd1b-4ebf-8f47-260e5381c2ed tempest-GroupsTest-760943615 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:47:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9bec9f14-bd1b-4ebf-8f47-260e5381c2ed tempest-GroupsTest-760943615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ef8b4f13-4a6b-4559-b953-f768808504c3 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:15 devstack sudo[97689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ef8b4f13-4a6b-4559-b953-f768808504c3 1073741824
Jul 10 12:47:15 devstack sudo[97689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:15 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-cafbf430-6ce9-48c6-b4a6-00260787f1b1 req-47fc3172-df5d-4fda-b56e-4288369491c8 tempest-TestInstancesWithCinderVolumes-1856690417 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be', 'name': 'volume-22def002-3e0c-4802-903b-1ec123510c2d', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd286b276-e323-40e6-9322-047f8448514e', 'enforce_multipath': True} {{(pid=87378) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 10 12:47:15 devstack cinder-volume[87378]: INFO cinder.volume.manager [req-cafbf430-6ce9-48c6-b4a6-00260787f1b1 req-47fc3172-df5d-4fda-b56e-4288369491c8 tempest-TestInstancesWithCinderVolumes-1856690417 None] attachment_update completed successfully.
Jul 10 12:47:15 devstack sudo[97684]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-833a82e5-8cd4-41b3-9d10-4dd2d264d6de tempest-VolumesSnapshotListTestJSON-2038328188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.47150dee-eca7-4b4a-bae6-a169a668c681" returned: 0 in 0.723s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:15 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-833a82e5-8cd4-41b3-9d10-4dd2d264d6de tempest-VolumesSnapshotListTestJSON-2038328188 None] Lock "cinder-quobyte-47150dee-eca7-4b4a-bae6-a169a668c681" released by "_delete_snapshot" :: held 4.232s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:47:15 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-833a82e5-8cd4-41b3-9d10-4dd2d264d6de tempest-VolumesSnapshotListTestJSON-2038328188 None] Lock "cinder-quobyte-439b54a3-8776-4fd8-a15f-f023a799caf4" released by "delete_snapshot" :: held 4.257s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:47:15 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-833a82e5-8cd4-41b3-9d10-4dd2d264d6de tempest-VolumesSnapshotListTestJSON-2038328188 None] Created reservations ['ebc7aca5-4675-47bb-bcbc-ad391c0d5bd9', 'a13a81aa-03ad-4772-bb3c-0fcbf2514776', '70e1d976-9834-42c8-8ea4-eae443037900', 'aa57903f-78fa-479b-ad34-789fd1cd05bf'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:47:15 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-833a82e5-8cd4-41b3-9d10-4dd2d264d6de tempest-VolumesSnapshotListTestJSON-2038328188 None] Delete snapshot completed successfully.
Jul 10 12:47:15 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-833a82e5-8cd4-41b3-9d10-4dd2d264d6de tempest-VolumesSnapshotListTestJSON-2038328188 None] Lock "cinder-47150dee-eca7-4b4a-bae6-a169a668c681-delete_snapshot" released by "delete_snapshot" :: held 4.472s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:47:16 devstack sudo[97689]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9bec9f14-bd1b-4ebf-8f47-260e5381c2ed tempest-GroupsTest-760943615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ef8b4f13-4a6b-4559-b953-f768808504c3 1073741824" returned: 0 in 0.919s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9bec9f14-bd1b-4ebf-8f47-260e5381c2ed tempest-GroupsTest-760943615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ef8b4f13-4a6b-4559-b953-f768808504c3 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:16 devstack sudo[97696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ef8b4f13-4a6b-4559-b953-f768808504c3
Jul 10 12:47:16 devstack sudo[97696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-441f7450-b583-4862-8f1e-d9285fee18bb req-3f23d7e2-e847-4780-b7a9-d0231d92a3c7 tempest-AttachVolumeNegativeTest-2056769334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:47:16 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fa044332-33c5-4794-8de6-395f08be372b tempest-VolumesSnapshotListTestJSON-2038328188 None] Acquiring lock "cinder-609b3cb9-21d6-4bba-8128-8dd89d0c6156-delete_snapshot" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:47:16 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fa044332-33c5-4794-8de6-395f08be372b tempest-VolumesSnapshotListTestJSON-2038328188 None] Lock "cinder-609b3cb9-21d6-4bba-8128-8dd89d0c6156-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:47:16 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fa044332-33c5-4794-8de6-395f08be372b tempest-VolumesSnapshotListTestJSON-2038328188 None] Acquiring lock "cinder-quobyte-439b54a3-8776-4fd8-a15f-f023a799caf4" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:47:16 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fa044332-33c5-4794-8de6-395f08be372b tempest-VolumesSnapshotListTestJSON-2038328188 None] Lock "cinder-quobyte-439b54a3-8776-4fd8-a15f-f023a799caf4" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:47:16 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fa044332-33c5-4794-8de6-395f08be372b tempest-VolumesSnapshotListTestJSON-2038328188 None] Acquiring lock "cinder-quobyte-609b3cb9-21d6-4bba-8128-8dd89d0c6156" by "_delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:47:16 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fa044332-33c5-4794-8de6-395f08be372b tempest-VolumesSnapshotListTestJSON-2038328188 None] Lock "cinder-quobyte-609b3cb9-21d6-4bba-8128-8dd89d0c6156" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:47:16 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-fa044332-33c5-4794-8de6-395f08be372b tempest-VolumesSnapshotListTestJSON-2038328188 None] Deleting offline snapshot 609b3cb9-21d6-4bba-8128-8dd89d0c6156 of volume 439b54a3-8776-4fd8-a15f-f023a799caf4 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 10 12:47:16 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-fa044332-33c5-4794-8de6-395f08be372b tempest-VolumesSnapshotListTestJSON-2038328188 None] snapshot_file for this snap is: volume-439b54a3-8776-4fd8-a15f-f023a799caf4.609b3cb9-21d6-4bba-8128-8dd89d0c6156 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 10 12:47:16 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4b4236-7bec-4902-8035-ae194629d90d]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:47:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fa044332-33c5-4794-8de6-395f08be372b tempest-VolumesSnapshotListTestJSON-2038328188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.609b3cb9-21d6-4bba-8128-8dd89d0c6156 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:16 devstack sudo[97696]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9bec9f14-bd1b-4ebf-8f47-260e5381c2ed tempest-GroupsTest-760943615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ef8b4f13-4a6b-4559-b953-f768808504c3" returned: 0 in 0.703s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:16 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-9bec9f14-bd1b-4ebf-8f47-260e5381c2ed tempest-GroupsTest-760943615 None] <== create_volume: return (1666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:47:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-9bec9f14-bd1b-4ebf-8f47-260e5381c2ed tempest-GroupsTest-760943615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.669s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:47:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-441f7450-b583-4862-8f1e-d9285fee18bb req-3f23d7e2-e847-4780-b7a9-d0231d92a3c7 tempest-AttachVolumeNegativeTest-2056769334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.411s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:47:16 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9bec9f14-bd1b-4ebf-8f47-260e5381c2ed tempest-GroupsTest-760943615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3108ef39-6ef2-43e7-a692-9e0e20130291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef8b4f13-4a6b-4559-b953-f768808504c3', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:47:16 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9bec9f14-bd1b-4ebf-8f47-260e5381c2ed tempest-GroupsTest-760943615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17e339e7-5dea-4d6e-bc47-ed33681227d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:47:16 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c1fd70-ad90-45ca-b518-dacfc107d56e]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:47:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-441f7450-b583-4862-8f1e-d9285fee18bb req-3f23d7e2-e847-4780-b7a9-d0231d92a3c7 tempest-AttachVolumeNegativeTest-2056769334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2ec00070-451a-491f-9031-07380d9e52ae {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:16 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-9bec9f14-bd1b-4ebf-8f47-260e5381c2ed tempest-GroupsTest-760943615 None] Volume volume-ef8b4f13-4a6b-4559-b953-f768808504c3 (ef8b4f13-4a6b-4559-b953-f768808504c3): created successfully
Jul 10 12:47:16 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9bec9f14-bd1b-4ebf-8f47-260e5381c2ed tempest-GroupsTest-760943615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17e339e7-5dea-4d6e-bc47-ed33681227d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:47:16 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9bec9f14-bd1b-4ebf-8f47-260e5381c2ed tempest-GroupsTest-760943615 None] Flow 'volume_create_manager' (9f2567e2-31b2-4712-96e6-b3e01dc41f2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:47:16 devstack sudo[97707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.609b3cb9-21d6-4bba-8128-8dd89d0c6156
Jul 10 12:47:16 devstack sudo[97707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:16 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-9bec9f14-bd1b-4ebf-8f47-260e5381c2ed tempest-GroupsTest-760943615 None] Created volume successfully.
Jul 10 12:47:17 devstack sudo[97708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2ec00070-451a-491f-9031-07380d9e52ae
Jul 10 12:47:17 devstack sudo[97708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:17 devstack sudo[97707]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fa044332-33c5-4794-8de6-395f08be372b tempest-VolumesSnapshotListTestJSON-2038328188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.609b3cb9-21d6-4bba-8128-8dd89d0c6156" returned: 0 in 0.820s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:17 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-fa044332-33c5-4794-8de6-395f08be372b tempest-VolumesSnapshotListTestJSON-2038328188 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-439b54a3-8776-4fd8-a15f-f023a799caf4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:47:17 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc1866d-00f3-40c3-abd2-28f3f2066944]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:47:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fa044332-33c5-4794-8de6-395f08be372b tempest-VolumesSnapshotListTestJSON-2038328188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:17 devstack sudo[97708]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-441f7450-b583-4862-8f1e-d9285fee18bb req-3f23d7e2-e847-4780-b7a9-d0231d92a3c7 tempest-AttachVolumeNegativeTest-2056769334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2ec00070-451a-491f-9031-07380d9e52ae" returned: 0 in 0.903s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-441f7450-b583-4862-8f1e-d9285fee18bb req-3f23d7e2-e847-4780-b7a9-d0231d92a3c7 tempest-AttachVolumeNegativeTest-2056769334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.939s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:47:17 devstack sudo[97781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4
Jul 10 12:47:17 devstack sudo[97781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:17 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-441f7450-b583-4862-8f1e-d9285fee18bb req-3f23d7e2-e847-4780-b7a9-d0231d92a3c7 tempest-AttachVolumeNegativeTest-2056769334 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be', 'name': 'volume-2ec00070-451a-491f-9031-07380d9e52ae', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '72a282ea-deaf-499d-932a-b78729bd0553', 'enforce_multipath': True} {{(pid=87378) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 10 12:47:17 devstack cinder-volume[87378]: INFO cinder.volume.manager [req-441f7450-b583-4862-8f1e-d9285fee18bb req-3f23d7e2-e847-4780-b7a9-d0231d92a3c7 tempest-AttachVolumeNegativeTest-2056769334 None] attachment_update completed successfully.
Jul 10 12:47:18 devstack sudo[97781]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fa044332-33c5-4794-8de6-395f08be372b tempest-VolumesSnapshotListTestJSON-2038328188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4" returned: 0 in 0.855s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fa044332-33c5-4794-8de6-395f08be372b tempest-VolumesSnapshotListTestJSON-2038328188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.609b3cb9-21d6-4bba-8128-8dd89d0c6156 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:18 devstack sudo[98102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.609b3cb9-21d6-4bba-8128-8dd89d0c6156
Jul 10 12:47:18 devstack sudo[98102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:18 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb2c0fde-f5dd-4832-a38f-ba05a16ab1d7 tempest-GroupsTest-760943615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:47:18 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bb2c0fde-f5dd-4832-a38f-ba05a16ab1d7 tempest-GroupsTest-760943615 None] Flow 'volume_create_manager' (8130f043-4ab9-4e04-a3e1-def7cb3b5c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:47:18 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bb2c0fde-f5dd-4832-a38f-ba05a16ab1d7 tempest-GroupsTest-760943615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d080880-ec38-445e-8847-e214615ff238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:47:18 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bb2c0fde-f5dd-4832-a38f-ba05a16ab1d7 tempest-GroupsTest-760943615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d080880-ec38-445e-8847-e214615ff238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2065433213',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=803e4b01-bc34-4865-8147-d86f4bbb2f5e,host='devstack@QuobyteHD#QuobyteHD',id=c0a3a56b-2ed9-4b1a-a4be-db17198a4e59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71921b0a984d4845a29e411a5f396284',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:47:19Z,use_quota=True,user_id='ce050b5d439743c39a23e5d337fe8f02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f76ccb2a-ed8f-41e2-85a5-0814c755ef24),volume_type_id=f76ccb2a-ed8f-41e2-85a5-0814c755ef24)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:47:18 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bb2c0fde-f5dd-4832-a38f-ba05a16ab1d7 tempest-GroupsTest-760943615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d54ff35e-f378-4aff-b49e-d2ea3a1de58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:47:18 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bb2c0fde-f5dd-4832-a38f-ba05a16ab1d7 tempest-GroupsTest-760943615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d54ff35e-f378-4aff-b49e-d2ea3a1de58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:47:18 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bb2c0fde-f5dd-4832-a38f-ba05a16ab1d7 tempest-GroupsTest-760943615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5232916-5959-4935-bd1f-2f39ca909b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:47:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bb2c0fde-f5dd-4832-a38f-ba05a16ab1d7 tempest-GroupsTest-760943615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5232916-5959-4935-bd1f-2f39ca909b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0a3a56b-2ed9-4b1a-a4be-db17198a4e59', 'volume_name': 'volume-c0a3a56b-2ed9-4b1a-a4be-db17198a4e59', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:47:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bb2c0fde-f5dd-4832-a38f-ba05a16ab1d7 tempest-GroupsTest-760943615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1807eec-52a8-4a2c-bda2-00f6fd562d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:47:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bb2c0fde-f5dd-4832-a38f-ba05a16ab1d7 tempest-GroupsTest-760943615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1807eec-52a8-4a2c-bda2-00f6fd562d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:47:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bb2c0fde-f5dd-4832-a38f-ba05a16ab1d7 tempest-GroupsTest-760943615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5b4b540-b6b7-4368-8941-91dbba4ea46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:47:19 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-bb2c0fde-f5dd-4832-a38f-ba05a16ab1d7 tempest-GroupsTest-760943615 None] Volume c0a3a56b-2ed9-4b1a-a4be-db17198a4e59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0a3a56b-2ed9-4b1a-a4be-db17198a4e59', 'volume_size': 1}
Jul 10 12:47:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-bb2c0fde-f5dd-4832-a38f-ba05a16ab1d7 tempest-GroupsTest-760943615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:47:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-bb2c0fde-f5dd-4832-a38f-ba05a16ab1d7 tempest-GroupsTest-760943615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:47:19 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-bb2c0fde-f5dd-4832-a38f-ba05a16ab1d7 tempest-GroupsTest-760943615 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=803e4b01-bc34-4865-8147-d86f4bbb2f5e,created_at=2026-07-10T10:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2065433213',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=803e4b01-bc34-4865-8147-d86f4bbb2f5e,host='devstack@QuobyteHD#QuobyteHD',id=c0a3a56b-2ed9-4b1a-a4be-db17198a4e59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71921b0a984d4845a29e411a5f396284',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:47:19Z,use_quota=True,user_id='ce050b5d439743c39a23e5d337fe8f02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f76ccb2a-ed8f-41e2-85a5-0814c755ef24),volume_type_id=f76ccb2a-ed8f-41e2-85a5-0814c755ef24)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:47:19 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-bb2c0fde-f5dd-4832-a38f-ba05a16ab1d7 tempest-GroupsTest-760943615 None] Creating volume c0a3a56b-2ed9-4b1a-a4be-db17198a4e59 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:47:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-bb2c0fde-f5dd-4832-a38f-ba05a16ab1d7 tempest-GroupsTest-760943615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:47:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-bb2c0fde-f5dd-4832-a38f-ba05a16ab1d7 tempest-GroupsTest-760943615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:47:19 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-bb2c0fde-f5dd-4832-a38f-ba05a16ab1d7 tempest-GroupsTest-760943615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:47:19 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-bb2c0fde-f5dd-4832-a38f-ba05a16ab1d7 tempest-GroupsTest-760943615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:47:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-bb2c0fde-f5dd-4832-a38f-ba05a16ab1d7 tempest-GroupsTest-760943615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:47:19 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-bb2c0fde-f5dd-4832-a38f-ba05a16ab1d7 tempest-GroupsTest-760943615 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:47:19 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-bb2c0fde-f5dd-4832-a38f-ba05a16ab1d7 tempest-GroupsTest-760943615 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:47:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-bb2c0fde-f5dd-4832-a38f-ba05a16ab1d7 tempest-GroupsTest-760943615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-c0a3a56b-2ed9-4b1a-a4be-db17198a4e59 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:19 devstack sudo[98122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-c0a3a56b-2ed9-4b1a-a4be-db17198a4e59 1073741824
Jul 10 12:47:19 devstack sudo[98122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:19 devstack sudo[98102]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fa044332-33c5-4794-8de6-395f08be372b tempest-VolumesSnapshotListTestJSON-2038328188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.609b3cb9-21d6-4bba-8128-8dd89d0c6156" returned: 0 in 1.214s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fa044332-33c5-4794-8de6-395f08be372b tempest-VolumesSnapshotListTestJSON-2038328188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.609b3cb9-21d6-4bba-8128-8dd89d0c6156 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:19 devstack sudo[98160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.609b3cb9-21d6-4bba-8128-8dd89d0c6156
Jul 10 12:47:19 devstack sudo[98160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:20 devstack sudo[98122]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-bb2c0fde-f5dd-4832-a38f-ba05a16ab1d7 tempest-GroupsTest-760943615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-c0a3a56b-2ed9-4b1a-a4be-db17198a4e59 1073741824" returned: 0 in 1.130s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-bb2c0fde-f5dd-4832-a38f-ba05a16ab1d7 tempest-GroupsTest-760943615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-c0a3a56b-2ed9-4b1a-a4be-db17198a4e59 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:20 devstack sudo[98169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-c0a3a56b-2ed9-4b1a-a4be-db17198a4e59
Jul 10 12:47:20 devstack sudo[98169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:20 devstack sudo[98160]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fa044332-33c5-4794-8de6-395f08be372b tempest-VolumesSnapshotListTestJSON-2038328188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4.609b3cb9-21d6-4bba-8128-8dd89d0c6156" returned: 0 in 0.669s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:20 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fa044332-33c5-4794-8de6-395f08be372b tempest-VolumesSnapshotListTestJSON-2038328188 None] Lock "cinder-quobyte-609b3cb9-21d6-4bba-8128-8dd89d0c6156" released by "_delete_snapshot" :: held 3.700s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:47:20 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fa044332-33c5-4794-8de6-395f08be372b tempest-VolumesSnapshotListTestJSON-2038328188 None] Lock "cinder-quobyte-439b54a3-8776-4fd8-a15f-f023a799caf4" released by "delete_snapshot" :: held 3.724s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:47:20 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-fa044332-33c5-4794-8de6-395f08be372b tempest-VolumesSnapshotListTestJSON-2038328188 None] Created reservations ['4df87977-2388-41e9-9f76-51af912319d1', '50fe821e-f574-41c8-8700-5c296ee38bd8', '220f0d91-537b-4326-8e98-5cd57535361b', '2e797866-cbef-40fc-8038-0bc645a64117'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:47:20 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-fa044332-33c5-4794-8de6-395f08be372b tempest-VolumesSnapshotListTestJSON-2038328188 None] Delete snapshot completed successfully.
Jul 10 12:47:20 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fa044332-33c5-4794-8de6-395f08be372b tempest-VolumesSnapshotListTestJSON-2038328188 None] Lock "cinder-609b3cb9-21d6-4bba-8128-8dd89d0c6156-delete_snapshot" released by "delete_snapshot" :: held 3.934s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:47:21 devstack sudo[98169]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-bb2c0fde-f5dd-4832-a38f-ba05a16ab1d7 tempest-GroupsTest-760943615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-c0a3a56b-2ed9-4b1a-a4be-db17198a4e59" returned: 0 in 0.897s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:21 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-bb2c0fde-f5dd-4832-a38f-ba05a16ab1d7 tempest-GroupsTest-760943615 None] <== create_volume: return (2079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:47:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-bb2c0fde-f5dd-4832-a38f-ba05a16ab1d7 tempest-GroupsTest-760943615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.087s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:47:21 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-d3a786c4-819e-4b10-895b-52e5c15c42a5 tempest-VolumesSnapshotListTestJSON-2038328188 None] Acquiring lock "cinder-439b54a3-8776-4fd8-a15f-f023a799caf4-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:47:21 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bb2c0fde-f5dd-4832-a38f-ba05a16ab1d7 tempest-GroupsTest-760943615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5b4b540-b6b7-4368-8941-91dbba4ea46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0a3a56b-2ed9-4b1a-a4be-db17198a4e59', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:47:21 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bb2c0fde-f5dd-4832-a38f-ba05a16ab1d7 tempest-GroupsTest-760943615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fca4cb88-c30a-4f66-8d06-70c89d7c1524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:47:21 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-d3a786c4-819e-4b10-895b-52e5c15c42a5 tempest-VolumesSnapshotListTestJSON-2038328188 None] Lock "cinder-439b54a3-8776-4fd8-a15f-f023a799caf4-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:47:21 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-bb2c0fde-f5dd-4832-a38f-ba05a16ab1d7 tempest-GroupsTest-760943615 None] Volume volume-c0a3a56b-2ed9-4b1a-a4be-db17198a4e59 (c0a3a56b-2ed9-4b1a-a4be-db17198a4e59): created successfully
Jul 10 12:47:21 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bb2c0fde-f5dd-4832-a38f-ba05a16ab1d7 tempest-GroupsTest-760943615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fca4cb88-c30a-4f66-8d06-70c89d7c1524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:47:21 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bb2c0fde-f5dd-4832-a38f-ba05a16ab1d7 tempest-GroupsTest-760943615 None] Flow 'volume_create_manager' (8130f043-4ab9-4e04-a3e1-def7cb3b5c1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:47:21 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-d3a786c4-819e-4b10-895b-52e5c15c42a5 tempest-VolumesSnapshotListTestJSON-2038328188 None] Acquiring lock "cinder-quobyte-439b54a3-8776-4fd8-a15f-f023a799caf4" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:47:21 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-bb2c0fde-f5dd-4832-a38f-ba05a16ab1d7 tempest-GroupsTest-760943615 None] Created volume successfully.
Jul 10 12:47:21 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-d3a786c4-819e-4b10-895b-52e5c15c42a5 tempest-VolumesSnapshotListTestJSON-2038328188 None] Lock "cinder-quobyte-439b54a3-8776-4fd8-a15f-f023a799caf4" acquired by "delete_volume" :: waited 0.027s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:47:21 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3877df49-5540-47c1-8dea-01ddbf1e8ff3]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:47:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d3a786c4-819e-4b10-895b-52e5c15c42a5 tempest-VolumesSnapshotListTestJSON-2038328188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:21 devstack sudo[98226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4
Jul 10 12:47:21 devstack sudo[98226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:22 devstack sudo[98226]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d3a786c4-819e-4b10-895b-52e5c15c42a5 tempest-VolumesSnapshotListTestJSON-2038328188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4" returned: 0 in 0.984s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d3a786c4-819e-4b10-895b-52e5c15c42a5 tempest-VolumesSnapshotListTestJSON-2038328188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:22 devstack sudo[98233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4
Jul 10 12:47:22 devstack sudo[98233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:22 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-80897198-8219-4a12-8352-50a514c1e24f tempest-GroupsTest-760943615 None] Update group completed successfully.
Jul 10 12:47:23 devstack sudo[98233]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d3a786c4-819e-4b10-895b-52e5c15c42a5 tempest-VolumesSnapshotListTestJSON-2038328188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-439b54a3-8776-4fd8-a15f-f023a799caf4" returned: 0 in 0.887s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:23 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-d3a786c4-819e-4b10-895b-52e5c15c42a5 tempest-VolumesSnapshotListTestJSON-2038328188 None] Lock "cinder-quobyte-439b54a3-8776-4fd8-a15f-f023a799caf4" released by "delete_volume" :: held 1.954s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:47:23 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-d3a786c4-819e-4b10-895b-52e5c15c42a5 tempest-VolumesSnapshotListTestJSON-2038328188 None] Created reservations ['d0530412-e075-4cf3-bd44-43b078a30842', '68bdf5af-3622-4943-b131-3ce7e84fb850', 'a8fdae60-5e3f-43b6-b083-26f98844612d', '817927eb-7e6d-4a5b-8e23-c0f75881ac65'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:47:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d3a786c4-819e-4b10-895b-52e5c15c42a5 tempest-VolumesSnapshotListTestJSON-2038328188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:47:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d3a786c4-819e-4b10-895b-52e5c15c42a5 tempest-VolumesSnapshotListTestJSON-2038328188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:47:23 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-d3a786c4-819e-4b10-895b-52e5c15c42a5 tempest-VolumesSnapshotListTestJSON-2038328188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:47:23 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-d3a786c4-819e-4b10-895b-52e5c15c42a5 tempest-VolumesSnapshotListTestJSON-2038328188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:47:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d3a786c4-819e-4b10-895b-52e5c15c42a5 tempest-VolumesSnapshotListTestJSON-2038328188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:47:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d3a786c4-819e-4b10-895b-52e5c15c42a5 tempest-VolumesSnapshotListTestJSON-2038328188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:23 devstack sudo[98237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:47:23 devstack sudo[98237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:24 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-87c2a867-62d3-422b-9a70-3a74d28fd82a tempest-GroupsTest-760943615 None] Update group completed successfully.
Jul 10 12:47:24 devstack cinder-volume[87378]: INFO cinder.volume.manager [req-ffae0a29-582b-455d-bc92-92852014930b req-55796ca0-fb7f-4144-a0a7-de70772a0991 tempest-AttachVolumeNegativeTest-2056769334 None] Terminate volume connection completed successfully.
Jul 10 12:47:24 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-ffae0a29-582b-455d-bc92-92852014930b req-55796ca0-fb7f-4144-a0a7-de70772a0991 tempest-AttachVolumeNegativeTest-2056769334 None] Deleting attachment 72a282ea-deaf-499d-932a-b78729bd0553. {{(pid=87378) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 10 12:47:24 devstack sudo[98237]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d3a786c4-819e-4b10-895b-52e5c15c42a5 tempest-VolumesSnapshotListTestJSON-2038328188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 1.325s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:24 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-d3a786c4-819e-4b10-895b-52e5c15c42a5 tempest-VolumesSnapshotListTestJSON-2038328188 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:47:24 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-d3a786c4-819e-4b10-895b-52e5c15c42a5 tempest-VolumesSnapshotListTestJSON-2038328188 None] Deleted volume successfully.
Jul 10 12:47:24 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-d3a786c4-819e-4b10-895b-52e5c15c42a5 tempest-VolumesSnapshotListTestJSON-2038328188 None] Lock "cinder-439b54a3-8776-4fd8-a15f-f023a799caf4-delete_volume" released by "delete_volume" :: held 3.585s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:47:26 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-5db53bc6-2b6d-49c5-85e7-f03d6fc31836 tempest-GroupsTest-760943615 None] Acquiring lock "cinder-quobyte-c0a3a56b-2ed9-4b1a-a4be-db17198a4e59" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:47:26 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-5db53bc6-2b6d-49c5-85e7-f03d6fc31836 tempest-GroupsTest-760943615 None] Lock "cinder-quobyte-c0a3a56b-2ed9-4b1a-a4be-db17198a4e59" acquired by "delete_volume" :: waited 0.034s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:47:26 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ccda17-396d-431f-a2b5-c6fb3b5346cb]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:47:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5db53bc6-2b6d-49c5-85e7-f03d6fc31836 tempest-GroupsTest-760943615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-c0a3a56b-2ed9-4b1a-a4be-db17198a4e59 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:26 devstack sudo[98247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-c0a3a56b-2ed9-4b1a-a4be-db17198a4e59
Jul 10 12:47:26 devstack sudo[98247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:28 devstack sudo[98247]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5db53bc6-2b6d-49c5-85e7-f03d6fc31836 tempest-GroupsTest-760943615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-c0a3a56b-2ed9-4b1a-a4be-db17198a4e59" returned: 0 in 1.511s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5db53bc6-2b6d-49c5-85e7-f03d6fc31836 tempest-GroupsTest-760943615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-c0a3a56b-2ed9-4b1a-a4be-db17198a4e59 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:28 devstack sudo[98257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-c0a3a56b-2ed9-4b1a-a4be-db17198a4e59
Jul 10 12:47:28 devstack sudo[98257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:29 devstack sudo[98257]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5db53bc6-2b6d-49c5-85e7-f03d6fc31836 tempest-GroupsTest-760943615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-c0a3a56b-2ed9-4b1a-a4be-db17198a4e59" returned: 0 in 1.534s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:29 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-5db53bc6-2b6d-49c5-85e7-f03d6fc31836 tempest-GroupsTest-760943615 None] Lock "cinder-quobyte-c0a3a56b-2ed9-4b1a-a4be-db17198a4e59" released by "delete_volume" :: held 3.142s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:47:29 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-5db53bc6-2b6d-49c5-85e7-f03d6fc31836 tempest-GroupsTest-760943615 None] Acquiring lock "cinder-quobyte-ef8b4f13-4a6b-4559-b953-f768808504c3" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:47:29 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-5db53bc6-2b6d-49c5-85e7-f03d6fc31836 tempest-GroupsTest-760943615 None] Lock "cinder-quobyte-ef8b4f13-4a6b-4559-b953-f768808504c3" acquired by "delete_volume" :: waited 0.028s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:47:29 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[990e430b-1970-429c-ad57-dbd6d81789cc]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:47:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5db53bc6-2b6d-49c5-85e7-f03d6fc31836 tempest-GroupsTest-760943615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ef8b4f13-4a6b-4559-b953-f768808504c3 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:30 devstack sudo[98281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ef8b4f13-4a6b-4559-b953-f768808504c3
Jul 10 12:47:30 devstack sudo[98281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:31 devstack sudo[98281]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5db53bc6-2b6d-49c5-85e7-f03d6fc31836 tempest-GroupsTest-760943615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ef8b4f13-4a6b-4559-b953-f768808504c3" returned: 0 in 1.855s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5db53bc6-2b6d-49c5-85e7-f03d6fc31836 tempest-GroupsTest-760943615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ef8b4f13-4a6b-4559-b953-f768808504c3 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:31 devstack sudo[98292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ef8b4f13-4a6b-4559-b953-f768808504c3
Jul 10 12:47:31 devstack sudo[98292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:32 devstack sudo[98292]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5db53bc6-2b6d-49c5-85e7-f03d6fc31836 tempest-GroupsTest-760943615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ef8b4f13-4a6b-4559-b953-f768808504c3" returned: 0 in 1.082s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:32 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-5db53bc6-2b6d-49c5-85e7-f03d6fc31836 tempest-GroupsTest-760943615 None] Lock "cinder-quobyte-ef8b4f13-4a6b-4559-b953-f768808504c3" released by "delete_volume" :: held 3.011s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:47:32 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:SELECT=118,cinder:INSERT=28,cinder:UPDATE=90,cinder:DELETE=8 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:47:32 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:SELECT=101,cinder:UPDATE=126,cinder:INSERT=30,cinder:DELETE=9 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:47:32 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-5db53bc6-2b6d-49c5-85e7-f03d6fc31836 tempest-GroupsTest-760943615 None] Created reservations ['b9f20816-49c3-4080-a30a-4bffc4c1cc1e'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:47:32 devstack cinder-volume[87378]: WARNING cinder.quota [None req-5db53bc6-2b6d-49c5-85e7-f03d6fc31836 tempest-GroupsTest-760943615 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-849396986 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-849396986, it is now deprecated. Please use the default quota class for default quota.
Jul 10 12:47:32 devstack cinder-volume[87378]: WARNING cinder.quota [None req-5db53bc6-2b6d-49c5-85e7-f03d6fc31836 tempest-GroupsTest-760943615 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-849396986 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-849396986, it is now deprecated. Please use the default quota class for default quota.
Jul 10 12:47:32 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-5db53bc6-2b6d-49c5-85e7-f03d6fc31836 tempest-GroupsTest-760943615 None] Created reservations ['f85c49f9-c977-4041-ac97-aead97ba78a6', '56a85aad-92bb-46f5-9a8d-16442543e94e', 'b4f50f12-1d04-45f7-a21f-67fe022fe93e', 'b63549ec-bf7c-490c-aae3-0e7be718a0f5'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:47:33 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-5db53bc6-2b6d-49c5-85e7-f03d6fc31836 tempest-GroupsTest-760943615 None] Created reservations ['70e2535e-e235-46e2-b540-3c52bafe91fe', '436c8c62-ad5c-4361-8716-78da64510d87', '84a1af6b-6288-4763-b474-e6650612a2f4', 'ecec1383-d4a5-499e-864b-4baff0e2cc8a'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:47:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5db53bc6-2b6d-49c5-85e7-f03d6fc31836 tempest-GroupsTest-760943615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:47:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5db53bc6-2b6d-49c5-85e7-f03d6fc31836 tempest-GroupsTest-760943615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:47:33 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5db53bc6-2b6d-49c5-85e7-f03d6fc31836 tempest-GroupsTest-760943615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:47:33 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5db53bc6-2b6d-49c5-85e7-f03d6fc31836 tempest-GroupsTest-760943615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:47:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5db53bc6-2b6d-49c5-85e7-f03d6fc31836 tempest-GroupsTest-760943615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:47:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5db53bc6-2b6d-49c5-85e7-f03d6fc31836 tempest-GroupsTest-760943615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:33 devstack sudo[98295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:47:33 devstack sudo[98295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:34 devstack sudo[98295]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5db53bc6-2b6d-49c5-85e7-f03d6fc31836 tempest-GroupsTest-760943615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 1.519s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:34 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-5db53bc6-2b6d-49c5-85e7-f03d6fc31836 tempest-GroupsTest-760943615 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:47:34 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-5db53bc6-2b6d-49c5-85e7-f03d6fc31836 tempest-GroupsTest-760943615 None] Delete group completed successfully.
Jul 10 12:47:36 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:47:36 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Flow 'volume_create_manager' (09644507-7b7e-4c18-8f70-73357708ca05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:47:36 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30e8b928-bb67-4169-9d8f-8e06da098876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:47:36 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30e8b928-bb67-4169-9d8f-8e06da098876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:47:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=030b09c8-646b-472c-afa5-08e859ca478b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4ea9267b41a4d32ab59a4b612b656eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:47:36Z,use_quota=True,user_id='748be8cec2d8431b8395cb968323b4da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99b4f88a-59c3-42cf-a0ab-3f68784b5f12),volume_type_id=99b4f88a-59c3-42cf-a0ab-3f68784b5f12)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:47:36 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de916ee0-165d-4665-ae8e-6f91bbbcf2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:47:36 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de916ee0-165d-4665-ae8e-6f91bbbcf2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:47:36 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaf1bb0c-0659-40f7-bdfa-42239e446b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:47:36 devstack cinder-volume[87378]: DEBUG cinder.image.glance [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Creating Keystone auth plugin from conf {{(pid=87378) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 10 12:47:36 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1f05c939-de7b-4ef2-ad5a-ae982d91d9aa tempest-AttachVolumeNegativeTest-2056769334 None] Acquiring lock "cinder-2ec00070-451a-491f-9031-07380d9e52ae-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:47:37 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1f05c939-de7b-4ef2-ad5a-ae982d91d9aa tempest-AttachVolumeNegativeTest-2056769334 None] Lock "cinder-2ec00070-451a-491f-9031-07380d9e52ae-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:47:37 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1f05c939-de7b-4ef2-ad5a-ae982d91d9aa tempest-AttachVolumeNegativeTest-2056769334 None] Acquiring lock "cinder-quobyte-2ec00070-451a-491f-9031-07380d9e52ae" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:47:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaf1bb0c-0659-40f7-bdfa-42239e446b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '030b09c8-646b-472c-afa5-08e859ca478b', 'volume_name': 'volume-030b09c8-646b-472c-afa5-08e859ca478b', 'volume_size': 1, 'image_id': 'c9a7cd85-5ca0-4346-a76b-60e5e70d83c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c9a7cd85-5ca0-4346-a76b-60e5e70d83c2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '56b8532002f1d58a701a133c8c4dc658', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b4ea9267b41a4d32ab59a4b612b656eb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f8ec09cea781c5039eaf837a6180320a6512c73f48289af856bb5518a09ab7ef1709d7ac3e61e92bdd55babd98a07ab98807beb1af494e934169885af3dbad5a', 'id': 'c9a7cd85-5ca0-4346-a76b-60e5e70d83c2', 'created_at': datetime.datetime(2026, 7, 10, 10, 47, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 10, 47, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c9a7cd85-5ca0-4346-a76b-60e5e70d83c2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74a0abc0f320>}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:47:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6819fc18-d375-4f9a-b1d9-b2bb4d5dd33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:47:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6819fc18-d375-4f9a-b1d9-b2bb4d5dd33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:47:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2415614c-86df-41ee-b3fa-0459507bf3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:47:37 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Volume 030b09c8-646b-472c-afa5-08e859ca478b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-030b09c8-646b-472c-afa5-08e859ca478b', 'volume_size': 1, 'image_id': 'c9a7cd85-5ca0-4346-a76b-60e5e70d83c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c9a7cd85-5ca0-4346-a76b-60e5e70d83c2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '56b8532002f1d58a701a133c8c4dc658', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b4ea9267b41a4d32ab59a4b612b656eb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f8ec09cea781c5039eaf837a6180320a6512c73f48289af856bb5518a09ab7ef1709d7ac3e61e92bdd55babd98a07ab98807beb1af494e934169885af3dbad5a', 'id': 'c9a7cd85-5ca0-4346-a76b-60e5e70d83c2', 'created_at': datetime.datetime(2026, 7, 10, 10, 47, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 10, 47, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c9a7cd85-5ca0-4346-a76b-60e5e70d83c2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74a0abc0f320>}
Jul 10 12:47:37 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Trying to clone 030b09c8-646b-472c-afa5-08e859ca478b from image c9a7cd85-5ca0-4346-a76b-60e5e70d83c2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c9a7cd85-5ca0-4346-a76b-60e5e70d83c2', 'metadata': {}}]). {{(pid=87378) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 10 12:47:37 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1f05c939-de7b-4ef2-ad5a-ae982d91d9aa tempest-AttachVolumeNegativeTest-2056769334 None] Lock "cinder-quobyte-2ec00070-451a-491f-9031-07380d9e52ae" acquired by "delete_volume" :: waited 0.051s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:47:37 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd32bf28-2488-49ad-84ed-d02a936f8458]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:47:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1f05c939-de7b-4ef2-ad5a-ae982d91d9aa tempest-AttachVolumeNegativeTest-2056769334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2ec00070-451a-491f-9031-07380d9e52ae {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:37 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c9a7cd85-5ca0-4346-a76b-60e5e70d83c2__0ejp5dvdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87378) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 10 12:47:37 devstack cinder-volume[87378]: INFO cinder.image.image_utils [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Image download 0.00 MB at 0.00 MB/s
Jul 10 12:47:37 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09cda4c-9b33-4d82-ac42-da8dfab77af7]: (4, 'raw') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:47:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9a7cd85-5ca0-4346-a76b-60e5e70d83c2__0ejp5dvdevstack@QuobyteHD {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:37 devstack sudo[98305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2ec00070-451a-491f-9031-07380d9e52ae
Jul 10 12:47:37 devstack sudo[98305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:37 devstack sudo[98306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9a7cd85-5ca0-4346-a76b-60e5e70d83c2__0ejp5dvdevstack@QuobyteHD
Jul 10 12:47:37 devstack sudo[98306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:38 devstack sudo[98305]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1f05c939-de7b-4ef2-ad5a-ae982d91d9aa tempest-AttachVolumeNegativeTest-2056769334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2ec00070-451a-491f-9031-07380d9e52ae" returned: 0 in 1.262s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1f05c939-de7b-4ef2-ad5a-ae982d91d9aa tempest-AttachVolumeNegativeTest-2056769334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2ec00070-451a-491f-9031-07380d9e52ae {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:38 devstack sudo[98306]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9a7cd85-5ca0-4346-a76b-60e5e70d83c2__0ejp5dvdevstack@QuobyteHD" returned: 0 in 1.088s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9a7cd85-5ca0-4346-a76b-60e5e70d83c2__0ejp5dvdevstack@QuobyteHD {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:38 devstack sudo[98419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2ec00070-451a-491f-9031-07380d9e52ae
Jul 10 12:47:38 devstack sudo[98419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:38 devstack sudo[98420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9a7cd85-5ca0-4346-a76b-60e5e70d83c2__0ejp5dvdevstack@QuobyteHD
Jul 10 12:47:38 devstack sudo[98420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:39 devstack sudo[98419]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1f05c939-de7b-4ef2-ad5a-ae982d91d9aa tempest-AttachVolumeNegativeTest-2056769334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2ec00070-451a-491f-9031-07380d9e52ae" returned: 0 in 0.792s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:39 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1f05c939-de7b-4ef2-ad5a-ae982d91d9aa tempest-AttachVolumeNegativeTest-2056769334 None] Lock "cinder-quobyte-2ec00070-451a-491f-9031-07380d9e52ae" released by "delete_volume" :: held 2.133s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:47:39 devstack sudo[98420]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9a7cd85-5ca0-4346-a76b-60e5e70d83c2__0ejp5dvdevstack@QuobyteHD" returned: 1 in 0.858s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9a7cd85-5ca0-4346-a76b-60e5e70d83c2__0ejp5dvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 10 12:47:39 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Temporary image c9a7cd85-5ca0-4346-a76b-60e5e70d83c2 is fetched for user 748be8cec2d8431b8395cb968323b4da. {{(pid=87378) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 10 12:47:39 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-1f05c939-de7b-4ef2-ad5a-ae982d91d9aa tempest-AttachVolumeNegativeTest-2056769334 None] Created reservations ['d197586f-14dd-4d50-bc3c-ad6bc4eaca13', '30f55c5b-bc41-4817-aa18-7417b80c6c97', '603c9788-7be9-49ed-92ff-0a329ff8bf85', 'd436a936-c48a-48ee-b8dc-1c67bd0e871a'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:47:39 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[34812035-3da6-431c-845c-c7c5d6541c6c]: (4, 'raw') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:47:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9a7cd85-5ca0-4346-a76b-60e5e70d83c2__0ejp5dvdevstack@QuobyteHD {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1f05c939-de7b-4ef2-ad5a-ae982d91d9aa tempest-AttachVolumeNegativeTest-2056769334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:47:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1f05c939-de7b-4ef2-ad5a-ae982d91d9aa tempest-AttachVolumeNegativeTest-2056769334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:47:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-1f05c939-de7b-4ef2-ad5a-ae982d91d9aa tempest-AttachVolumeNegativeTest-2056769334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:47:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-1f05c939-de7b-4ef2-ad5a-ae982d91d9aa tempest-AttachVolumeNegativeTest-2056769334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:47:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1f05c939-de7b-4ef2-ad5a-ae982d91d9aa tempest-AttachVolumeNegativeTest-2056769334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:47:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1f05c939-de7b-4ef2-ad5a-ae982d91d9aa tempest-AttachVolumeNegativeTest-2056769334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:39 devstack sudo[98429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:47:39 devstack sudo[98429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:39 devstack sudo[98428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9a7cd85-5ca0-4346-a76b-60e5e70d83c2__0ejp5dvdevstack@QuobyteHD
Jul 10 12:47:39 devstack sudo[98428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:40 devstack sudo[98429]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1f05c939-de7b-4ef2-ad5a-ae982d91d9aa tempest-AttachVolumeNegativeTest-2056769334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.669s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:40 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-1f05c939-de7b-4ef2-ad5a-ae982d91d9aa tempest-AttachVolumeNegativeTest-2056769334 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:47:40 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-1f05c939-de7b-4ef2-ad5a-ae982d91d9aa tempest-AttachVolumeNegativeTest-2056769334 None] Deleted volume successfully.
Jul 10 12:47:40 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1f05c939-de7b-4ef2-ad5a-ae982d91d9aa tempest-AttachVolumeNegativeTest-2056769334 None] Lock "cinder-2ec00070-451a-491f-9031-07380d9e52ae-delete_volume" released by "delete_volume" :: held 3.151s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:47:40 devstack sudo[98428]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9a7cd85-5ca0-4346-a76b-60e5e70d83c2__0ejp5dvdevstack@QuobyteHD" returned: 0 in 0.790s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9a7cd85-5ca0-4346-a76b-60e5e70d83c2__0ejp5dvdevstack@QuobyteHD {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:40 devstack sudo[98435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9a7cd85-5ca0-4346-a76b-60e5e70d83c2__0ejp5dvdevstack@QuobyteHD
Jul 10 12:47:40 devstack sudo[98435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:40 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-64220dd7-d34b-412e-881a-cb1179e88ff0 tempest-AttachVolumeNegativeTest-2056769334 None] Acquiring lock "cinder-4468ec21-f794-4002-9fa6-12b1269a41fd-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:47:40 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-64220dd7-d34b-412e-881a-cb1179e88ff0 tempest-AttachVolumeNegativeTest-2056769334 None] Lock "cinder-4468ec21-f794-4002-9fa6-12b1269a41fd-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:47:40 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-64220dd7-d34b-412e-881a-cb1179e88ff0 tempest-AttachVolumeNegativeTest-2056769334 None] Acquiring lock "cinder-quobyte-4468ec21-f794-4002-9fa6-12b1269a41fd" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:47:40 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-64220dd7-d34b-412e-881a-cb1179e88ff0 tempest-AttachVolumeNegativeTest-2056769334 None] Lock "cinder-quobyte-4468ec21-f794-4002-9fa6-12b1269a41fd" acquired by "delete_volume" :: waited 0.024s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:47:40 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe1be65-d8ba-44e4-9fa0-9f090573b3f8]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:47:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-64220dd7-d34b-412e-881a-cb1179e88ff0 tempest-AttachVolumeNegativeTest-2056769334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4468ec21-f794-4002-9fa6-12b1269a41fd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:40 devstack sudo[98437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4468ec21-f794-4002-9fa6-12b1269a41fd
Jul 10 12:47:40 devstack sudo[98437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:41 devstack sudo[98435]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9a7cd85-5ca0-4346-a76b-60e5e70d83c2__0ejp5dvdevstack@QuobyteHD" returned: 1 in 0.833s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9a7cd85-5ca0-4346-a76b-60e5e70d83c2__0ejp5dvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 10 12:47:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:47:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:47:41 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:47:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=030b09c8-646b-472c-afa5-08e859ca478b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4ea9267b41a4d32ab59a4b612b656eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:47:36Z,use_quota=True,user_id='748be8cec2d8431b8395cb968323b4da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99b4f88a-59c3-42cf-a0ab-3f68784b5f12),volume_type_id=99b4f88a-59c3-42cf-a0ab-3f68784b5f12)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:47:41 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Creating volume 030b09c8-646b-472c-afa5-08e859ca478b {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:47:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:47:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:47:41 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:47:41 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:47:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:47:41 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:47:41 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:47:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-030b09c8-646b-472c-afa5-08e859ca478b 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:41 devstack sudo[98442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-030b09c8-646b-472c-afa5-08e859ca478b 1073741824
Jul 10 12:47:41 devstack sudo[98442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:41 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf613ec4-cb29-41e8-b72c-ecca559ad5a6 tempest-SnapshotsActionsTest-1562062894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:47:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bf613ec4-cb29-41e8-b72c-ecca559ad5a6 tempest-SnapshotsActionsTest-1562062894 None] Flow 'volume_create_manager' (06062714-5876-4343-9b58-44b67ec2cab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:47:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bf613ec4-cb29-41e8-b72c-ecca559ad5a6 tempest-SnapshotsActionsTest-1562062894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06244b62-ecb6-4316-949e-f973b68bb34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:47:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bf613ec4-cb29-41e8-b72c-ecca559ad5a6 tempest-SnapshotsActionsTest-1562062894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06244b62-ecb6-4316-949e-f973b68bb34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:47:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1827629113',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e645700-a883-4de8-83a0-309080c6985e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='280a9567b19c486ca25b9061e7309894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:47:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:47:41Z,use_quota=True,user_id='829ec3bd266a4ba59e2365f49de56c53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:47:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bf613ec4-cb29-41e8-b72c-ecca559ad5a6 tempest-SnapshotsActionsTest-1562062894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feae87f3-742d-42d0-897c-274c495a9131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:47:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bf613ec4-cb29-41e8-b72c-ecca559ad5a6 tempest-SnapshotsActionsTest-1562062894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feae87f3-742d-42d0-897c-274c495a9131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:47:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bf613ec4-cb29-41e8-b72c-ecca559ad5a6 tempest-SnapshotsActionsTest-1562062894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8398010-8eb4-45a0-9fa6-d35ba7be2800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:47:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bf613ec4-cb29-41e8-b72c-ecca559ad5a6 tempest-SnapshotsActionsTest-1562062894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8398010-8eb4-45a0-9fa6-d35ba7be2800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e645700-a883-4de8-83a0-309080c6985e', 'volume_name': 'volume-3e645700-a883-4de8-83a0-309080c6985e', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:47:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bf613ec4-cb29-41e8-b72c-ecca559ad5a6 tempest-SnapshotsActionsTest-1562062894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08aae0e1-e453-4aa9-b19b-76d4e0060685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:47:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bf613ec4-cb29-41e8-b72c-ecca559ad5a6 tempest-SnapshotsActionsTest-1562062894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08aae0e1-e453-4aa9-b19b-76d4e0060685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:47:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bf613ec4-cb29-41e8-b72c-ecca559ad5a6 tempest-SnapshotsActionsTest-1562062894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efbb527f-05b2-49cd-9ff1-331b8178bb8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:47:41 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-bf613ec4-cb29-41e8-b72c-ecca559ad5a6 tempest-SnapshotsActionsTest-1562062894 None] Volume 3e645700-a883-4de8-83a0-309080c6985e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e645700-a883-4de8-83a0-309080c6985e', 'volume_size': 1}
Jul 10 12:47:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-bf613ec4-cb29-41e8-b72c-ecca559ad5a6 tempest-SnapshotsActionsTest-1562062894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:47:41 devstack sudo[98437]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-64220dd7-d34b-412e-881a-cb1179e88ff0 tempest-AttachVolumeNegativeTest-2056769334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4468ec21-f794-4002-9fa6-12b1269a41fd" returned: 0 in 0.856s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-64220dd7-d34b-412e-881a-cb1179e88ff0 tempest-AttachVolumeNegativeTest-2056769334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4468ec21-f794-4002-9fa6-12b1269a41fd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:41 devstack sudo[98447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4468ec21-f794-4002-9fa6-12b1269a41fd
Jul 10 12:47:41 devstack sudo[98447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:41 devstack sudo[98442]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-030b09c8-646b-472c-afa5-08e859ca478b 1073741824" returned: 0 in 0.916s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-030b09c8-646b-472c-afa5-08e859ca478b {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:42 devstack sudo[98452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-030b09c8-646b-472c-afa5-08e859ca478b
Jul 10 12:47:42 devstack sudo[98452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:42 devstack sudo[98447]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-64220dd7-d34b-412e-881a-cb1179e88ff0 tempest-AttachVolumeNegativeTest-2056769334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4468ec21-f794-4002-9fa6-12b1269a41fd" returned: 0 in 0.701s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:42 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-64220dd7-d34b-412e-881a-cb1179e88ff0 tempest-AttachVolumeNegativeTest-2056769334 None] Lock "cinder-quobyte-4468ec21-f794-4002-9fa6-12b1269a41fd" released by "delete_volume" :: held 1.619s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:47:42 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-64220dd7-d34b-412e-881a-cb1179e88ff0 tempest-AttachVolumeNegativeTest-2056769334 None] Created reservations ['8a8fd526-684e-4a95-b77e-fdb0cafe087a', '1f9888ff-4673-4fd1-8cce-9072c51ed4a4', 'c611c424-a732-4d0d-b22a-611d91ed4266', 'a85e26bb-52bd-4340-9d15-8102e671f46c'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:47:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-64220dd7-d34b-412e-881a-cb1179e88ff0 tempest-AttachVolumeNegativeTest-2056769334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:47:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-64220dd7-d34b-412e-881a-cb1179e88ff0 tempest-AttachVolumeNegativeTest-2056769334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:47:42 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-64220dd7-d34b-412e-881a-cb1179e88ff0 tempest-AttachVolumeNegativeTest-2056769334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:47:42 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-64220dd7-d34b-412e-881a-cb1179e88ff0 tempest-AttachVolumeNegativeTest-2056769334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:47:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-64220dd7-d34b-412e-881a-cb1179e88ff0 tempest-AttachVolumeNegativeTest-2056769334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:47:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-64220dd7-d34b-412e-881a-cb1179e88ff0 tempest-AttachVolumeNegativeTest-2056769334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:42 devstack sudo[98455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:47:42 devstack sudo[98455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:42 devstack sudo[98452]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-030b09c8-646b-472c-afa5-08e859ca478b" returned: 0 in 0.664s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:42 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:47:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.630s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:47:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-bf613ec4-cb29-41e8-b72c-ecca559ad5a6 tempest-SnapshotsActionsTest-1562062894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.282s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:47:42 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-bf613ec4-cb29-41e8-b72c-ecca559ad5a6 tempest-SnapshotsActionsTest-1562062894 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:47:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1827629113',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e645700-a883-4de8-83a0-309080c6985e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='280a9567b19c486ca25b9061e7309894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:47:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:47:41Z,use_quota=True,user_id='829ec3bd266a4ba59e2365f49de56c53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:47:42 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-bf613ec4-cb29-41e8-b72c-ecca559ad5a6 tempest-SnapshotsActionsTest-1562062894 None] Creating volume 3e645700-a883-4de8-83a0-309080c6985e {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:47:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-bf613ec4-cb29-41e8-b72c-ecca559ad5a6 tempest-SnapshotsActionsTest-1562062894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:47:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-bf613ec4-cb29-41e8-b72c-ecca559ad5a6 tempest-SnapshotsActionsTest-1562062894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:47:42 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-bf613ec4-cb29-41e8-b72c-ecca559ad5a6 tempest-SnapshotsActionsTest-1562062894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:47:42 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-bf613ec4-cb29-41e8-b72c-ecca559ad5a6 tempest-SnapshotsActionsTest-1562062894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:47:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-bf613ec4-cb29-41e8-b72c-ecca559ad5a6 tempest-SnapshotsActionsTest-1562062894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:47:42 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-bf613ec4-cb29-41e8-b72c-ecca559ad5a6 tempest-SnapshotsActionsTest-1562062894 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:47:42 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-bf613ec4-cb29-41e8-b72c-ecca559ad5a6 tempest-SnapshotsActionsTest-1562062894 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:47:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-bf613ec4-cb29-41e8-b72c-ecca559ad5a6 tempest-SnapshotsActionsTest-1562062894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:42 devstack sudo[98458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e 1073741824
Jul 10 12:47:42 devstack sudo[98458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:42 devstack cinder-volume[87378]: DEBUG cinder.volume.volume_utils [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Attempting download of c9a7cd85-5ca0-4346-a76b-60e5e70d83c2 ((None, [{'url': 'file:///opt/stack/data/glance/images/c9a7cd85-5ca0-4346-a76b-60e5e70d83c2', 'metadata': {}}])) to volume 030b09c8-646b-472c-afa5-08e859ca478b. {{(pid=87378) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 10 12:47:42 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7356039-6f27-4bf2-b910-ab20af51392b]: (4, 'raw') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:47:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c9a7cd85-5ca0-4346-a76b-60e5e70d83c2_0valaodm {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:42 devstack sudo[98460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c9a7cd85-5ca0-4346-a76b-60e5e70d83c2_0valaodm
Jul 10 12:47:42 devstack sudo[98460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:43 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-500be356-6c6e-4cd1-8ea3-8c090ecf3828 tempest-AttachVolumeNegativeTest-2056769334 None] Acquiring lock "cinder-cb401785-82c0-433d-b15f-42ba10548f08-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:47:43 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-500be356-6c6e-4cd1-8ea3-8c090ecf3828 tempest-AttachVolumeNegativeTest-2056769334 None] Lock "cinder-cb401785-82c0-433d-b15f-42ba10548f08-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:47:43 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-500be356-6c6e-4cd1-8ea3-8c090ecf3828 tempest-AttachVolumeNegativeTest-2056769334 None] Acquiring lock "cinder-quobyte-cb401785-82c0-433d-b15f-42ba10548f08" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:47:43 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-500be356-6c6e-4cd1-8ea3-8c090ecf3828 tempest-AttachVolumeNegativeTest-2056769334 None] Lock "cinder-quobyte-cb401785-82c0-433d-b15f-42ba10548f08" acquired by "delete_volume" :: waited 0.017s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:47:43 devstack sudo[98455]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-64220dd7-d34b-412e-881a-cb1179e88ff0 tempest-AttachVolumeNegativeTest-2056769334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.814s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:43 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-64220dd7-d34b-412e-881a-cb1179e88ff0 tempest-AttachVolumeNegativeTest-2056769334 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:47:43 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-64220dd7-d34b-412e-881a-cb1179e88ff0 tempest-AttachVolumeNegativeTest-2056769334 None] Deleted volume successfully.
Jul 10 12:47:43 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc32a3e-ac70-45bd-a24d-95699867c540]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:47:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-500be356-6c6e-4cd1-8ea3-8c090ecf3828 tempest-AttachVolumeNegativeTest-2056769334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cb401785-82c0-433d-b15f-42ba10548f08 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:43 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-64220dd7-d34b-412e-881a-cb1179e88ff0 tempest-AttachVolumeNegativeTest-2056769334 None] Lock "cinder-4468ec21-f794-4002-9fa6-12b1269a41fd-delete_volume" released by "delete_volume" :: held 2.701s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:47:43 devstack sudo[98463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cb401785-82c0-433d-b15f-42ba10548f08
Jul 10 12:47:43 devstack sudo[98463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:43 devstack sudo[98458]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-bf613ec4-cb29-41e8-b72c-ecca559ad5a6 tempest-SnapshotsActionsTest-1562062894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e 1073741824" returned: 0 in 0.936s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-bf613ec4-cb29-41e8-b72c-ecca559ad5a6 tempest-SnapshotsActionsTest-1562062894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:43 devstack sudo[98471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e
Jul 10 12:47:43 devstack sudo[98471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:43 devstack sudo[98460]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c9a7cd85-5ca0-4346-a76b-60e5e70d83c2_0valaodm" returned: 0 in 0.971s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c9a7cd85-5ca0-4346-a76b-60e5e70d83c2_0valaodm {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:43 devstack sudo[98473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c9a7cd85-5ca0-4346-a76b-60e5e70d83c2_0valaodm
Jul 10 12:47:43 devstack sudo[98473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:44 devstack sudo[98463]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-500be356-6c6e-4cd1-8ea3-8c090ecf3828 tempest-AttachVolumeNegativeTest-2056769334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cb401785-82c0-433d-b15f-42ba10548f08" returned: 0 in 0.842s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-500be356-6c6e-4cd1-8ea3-8c090ecf3828 tempest-AttachVolumeNegativeTest-2056769334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cb401785-82c0-433d-b15f-42ba10548f08 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:44 devstack sudo[98478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cb401785-82c0-433d-b15f-42ba10548f08
Jul 10 12:47:44 devstack sudo[98478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:44 devstack sudo[98471]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-bf613ec4-cb29-41e8-b72c-ecca559ad5a6 tempest-SnapshotsActionsTest-1562062894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e" returned: 0 in 0.720s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:44 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-bf613ec4-cb29-41e8-b72c-ecca559ad5a6 tempest-SnapshotsActionsTest-1562062894 None] <== create_volume: return (1710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:47:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-bf613ec4-cb29-41e8-b72c-ecca559ad5a6 tempest-SnapshotsActionsTest-1562062894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.713s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:47:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bf613ec4-cb29-41e8-b72c-ecca559ad5a6 tempest-SnapshotsActionsTest-1562062894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efbb527f-05b2-49cd-9ff1-331b8178bb8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e645700-a883-4de8-83a0-309080c6985e', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:47:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bf613ec4-cb29-41e8-b72c-ecca559ad5a6 tempest-SnapshotsActionsTest-1562062894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ff063fa-5581-4bfa-833a-60e1ac1367d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:47:44 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-bf613ec4-cb29-41e8-b72c-ecca559ad5a6 tempest-SnapshotsActionsTest-1562062894 None] Volume volume-3e645700-a883-4de8-83a0-309080c6985e (3e645700-a883-4de8-83a0-309080c6985e): created successfully
Jul 10 12:47:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bf613ec4-cb29-41e8-b72c-ecca559ad5a6 tempest-SnapshotsActionsTest-1562062894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ff063fa-5581-4bfa-833a-60e1ac1367d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:47:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bf613ec4-cb29-41e8-b72c-ecca559ad5a6 tempest-SnapshotsActionsTest-1562062894 None] Flow 'volume_create_manager' (06062714-5876-4343-9b58-44b67ec2cab3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:47:44 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-bf613ec4-cb29-41e8-b72c-ecca559ad5a6 tempest-SnapshotsActionsTest-1562062894 None] Created volume successfully.
Jul 10 12:47:44 devstack sudo[98473]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c9a7cd85-5ca0-4346-a76b-60e5e70d83c2_0valaodm" returned: 1 in 0.784s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c9a7cd85-5ca0-4346-a76b-60e5e70d83c2_0valaodm' failed. Not Retrying. {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 10 12:47:44 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[377ae1cb-e41a-46fd-adc6-7563456bbd9e]: (4, 'raw') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:47:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9a7cd85-5ca0-4346-a76b-60e5e70d83c2__0ejp5dvdevstack@QuobyteHD {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:44 devstack sudo[98483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9a7cd85-5ca0-4346-a76b-60e5e70d83c2__0ejp5dvdevstack@QuobyteHD
Jul 10 12:47:44 devstack sudo[98483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:44 devstack sudo[98478]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-500be356-6c6e-4cd1-8ea3-8c090ecf3828 tempest-AttachVolumeNegativeTest-2056769334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cb401785-82c0-433d-b15f-42ba10548f08" returned: 0 in 0.671s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:44 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-500be356-6c6e-4cd1-8ea3-8c090ecf3828 tempest-AttachVolumeNegativeTest-2056769334 None] Lock "cinder-quobyte-cb401785-82c0-433d-b15f-42ba10548f08" released by "delete_volume" :: held 1.563s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:47:44 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-500be356-6c6e-4cd1-8ea3-8c090ecf3828 tempest-AttachVolumeNegativeTest-2056769334 None] Created reservations ['4a13f81a-123c-4b00-8707-4e4e92853d2c', '7218a8c6-8629-4671-9c35-6353734506a5', '42074464-e0c2-4402-bcd7-1a050955b37c', '5ce37708-dedd-4355-9541-7f20799af497'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:47:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-500be356-6c6e-4cd1-8ea3-8c090ecf3828 tempest-AttachVolumeNegativeTest-2056769334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:47:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-500be356-6c6e-4cd1-8ea3-8c090ecf3828 tempest-AttachVolumeNegativeTest-2056769334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:47:44 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-500be356-6c6e-4cd1-8ea3-8c090ecf3828 tempest-AttachVolumeNegativeTest-2056769334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:47:44 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-500be356-6c6e-4cd1-8ea3-8c090ecf3828 tempest-AttachVolumeNegativeTest-2056769334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:47:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-500be356-6c6e-4cd1-8ea3-8c090ecf3828 tempest-AttachVolumeNegativeTest-2056769334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:47:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-500be356-6c6e-4cd1-8ea3-8c090ecf3828 tempest-AttachVolumeNegativeTest-2056769334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:44 devstack sudo[98486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:47:44 devstack sudo[98486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:45 devstack sudo[98483]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9a7cd85-5ca0-4346-a76b-60e5e70d83c2__0ejp5dvdevstack@QuobyteHD" returned: 0 in 0.742s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9a7cd85-5ca0-4346-a76b-60e5e70d83c2__0ejp5dvdevstack@QuobyteHD {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:45 devstack sudo[98490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9a7cd85-5ca0-4346-a76b-60e5e70d83c2__0ejp5dvdevstack@QuobyteHD
Jul 10 12:47:45 devstack sudo[98490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:45 devstack sudo[98486]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-500be356-6c6e-4cd1-8ea3-8c090ecf3828 tempest-AttachVolumeNegativeTest-2056769334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.695s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:45 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-500be356-6c6e-4cd1-8ea3-8c090ecf3828 tempest-AttachVolumeNegativeTest-2056769334 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:47:45 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-500be356-6c6e-4cd1-8ea3-8c090ecf3828 tempest-AttachVolumeNegativeTest-2056769334 None] Deleted volume successfully.
Jul 10 12:47:45 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-500be356-6c6e-4cd1-8ea3-8c090ecf3828 tempest-AttachVolumeNegativeTest-2056769334 None] Lock "cinder-cb401785-82c0-433d-b15f-42ba10548f08-delete_volume" released by "delete_volume" :: held 2.587s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:47:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-b6e50245-01ac-476d-a088-6895f2a1a667 tempest-SnapshotsActionsTest-1562062894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:47:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-b6e50245-01ac-476d-a088-6895f2a1a667 tempest-SnapshotsActionsTest-1562062894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:47:45 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-b6e50245-01ac-476d-a088-6895f2a1a667 tempest-SnapshotsActionsTest-1562062894 None] Creating offline snapshot 0a5c42b6-f07a-4c65-99aa-d98aee036c23 of volume 3e645700-a883-4de8-83a0-309080c6985e {{(pid=87378) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 10 12:47:45 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c906199-9d4e-4a65-a9c1-fa6a22b61767]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:47:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b6e50245-01ac-476d-a088-6895f2a1a667 tempest-SnapshotsActionsTest-1562062894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:46 devstack sudo[98493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e
Jul 10 12:47:46 devstack sudo[98493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:46 devstack sudo[98490]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9a7cd85-5ca0-4346-a76b-60e5e70d83c2__0ejp5dvdevstack@QuobyteHD" returned: 1 in 0.893s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9a7cd85-5ca0-4346-a76b-60e5e70d83c2__0ejp5dvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 10 12:47:46 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] c9a7cd85-5ca0-4346-a76b-60e5e70d83c2 was raw, converting to raw {{(pid=87378) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 10 12:47:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c9a7cd85-5ca0-4346-a76b-60e5e70d83c2__0ejp5dvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-030b09c8-646b-472c-afa5-08e859ca478b {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:46 devstack sudo[98498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c9a7cd85-5ca0-4346-a76b-60e5e70d83c2__0ejp5dvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-030b09c8-646b-472c-afa5-08e859ca478b
Jul 10 12:47:46 devstack sudo[98498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:46 devstack sudo[98493]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b6e50245-01ac-476d-a088-6895f2a1a667 tempest-SnapshotsActionsTest-1562062894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e" returned: 0 in 0.937s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b6e50245-01ac-476d-a088-6895f2a1a667 tempest-SnapshotsActionsTest-1562062894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:46 devstack sudo[98504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23 1G
Jul 10 12:47:46 devstack sudo[98504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:47 devstack sudo[98498]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c9a7cd85-5ca0-4346-a76b-60e5e70d83c2__0ejp5dvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-030b09c8-646b-472c-afa5-08e859ca478b" returned: 0 in 0.965s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:47 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c9a7cd85-5ca0-4346-a76b-60e5e70d83c2__0ejp5dvdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-030b09c8-646b-472c-afa5-08e859ca478b {{(pid=87378) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 10 12:47:47 devstack cinder-volume[87378]: INFO cinder.image.image_utils [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Converted 0.00 MB image at 0.00 MB/s
Jul 10 12:47:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-030b09c8-646b-472c-afa5-08e859ca478b 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:47 devstack sudo[98511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-030b09c8-646b-472c-afa5-08e859ca478b 1G
Jul 10 12:47:47 devstack sudo[98511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:47 devstack sudo[98504]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b6e50245-01ac-476d-a088-6895f2a1a667 tempest-SnapshotsActionsTest-1562062894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23 1G" returned: 0 in 0.981s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b6e50245-01ac-476d-a088-6895f2a1a667 tempest-SnapshotsActionsTest-1562062894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e645700-a883-4de8-83a0-309080c6985e -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:47 devstack sudo[98519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e645700-a883-4de8-83a0-309080c6985e -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23
Jul 10 12:47:47 devstack sudo[98519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:48 devstack sudo[98511]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-030b09c8-646b-472c-afa5-08e859ca478b 1G" returned: 0 in 0.848s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:48 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[201a34b9-259c-4157-a275-f43cdfbc1bfd]: (4, 'raw') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:47:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-030b09c8-646b-472c-afa5-08e859ca478b {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:48 devstack sudo[98522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-030b09c8-646b-472c-afa5-08e859ca478b
Jul 10 12:47:48 devstack sudo[98522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:48 devstack sudo[98519]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b6e50245-01ac-476d-a088-6895f2a1a667 tempest-SnapshotsActionsTest-1562062894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e645700-a883-4de8-83a0-309080c6985e -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23" returned: 0 in 0.959s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:48 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-b6e50245-01ac-476d-a088-6895f2a1a667 tempest-SnapshotsActionsTest-1562062894 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23 is being set with open permissions: ugo+rw
Jul 10 12:47:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b6e50245-01ac-476d-a088-6895f2a1a667 tempest-SnapshotsActionsTest-1562062894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:48 devstack sudo[98531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23
Jul 10 12:47:48 devstack sudo[98531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:49 devstack sudo[98522]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-030b09c8-646b-472c-afa5-08e859ca478b" returned: 0 in 0.999s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-030b09c8-646b-472c-afa5-08e859ca478b {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:49 devstack sudo[98537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-030b09c8-646b-472c-afa5-08e859ca478b
Jul 10 12:47:49 devstack sudo[98537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:49 devstack sudo[98531]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b6e50245-01ac-476d-a088-6895f2a1a667 tempest-SnapshotsActionsTest-1562062894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23" returned: 0 in 0.789s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b6e50245-01ac-476d-a088-6895f2a1a667 tempest-SnapshotsActionsTest-1562062894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:49 devstack sudo[98543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.info
Jul 10 12:47:49 devstack sudo[98543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:49 devstack sudo[98537]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-030b09c8-646b-472c-afa5-08e859ca478b" returned: 1 in 0.847s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-030b09c8-646b-472c-afa5-08e859ca478b' failed. Not Retrying. {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 10 12:47:49 devstack cinder-volume[87378]: DEBUG cinder.volume.volume_utils [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Downloaded image c9a7cd85-5ca0-4346-a76b-60e5e70d83c2 ((None, [{'url': 'file:///opt/stack/data/glance/images/c9a7cd85-5ca0-4346-a76b-60e5e70d83c2', 'metadata': {}}])) to volume 030b09c8-646b-472c-afa5-08e859ca478b successfully. {{(pid=87378) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 10 12:47:49 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Temporary image c9a7cd85-5ca0-4346-a76b-60e5e70d83c2 for user 748be8cec2d8431b8395cb968323b4da is deleted. {{(pid=87378) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 10 12:47:49 devstack cinder-volume[87378]: DEBUG cinder.volume.volume_utils [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Marking volume 030b09c8-646b-472c-afa5-08e859ca478b as bootable. {{(pid=87378) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 10 12:47:49 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Copying metadata from image c9a7cd85-5ca0-4346-a76b-60e5e70d83c2 to 030b09c8-646b-472c-afa5-08e859ca478b. {{(pid=87378) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 10 12:47:49 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Creating volume glance metadata for volume 030b09c8-646b-472c-afa5-08e859ca478b backed by image c9a7cd85-5ca0-4346-a76b-60e5e70d83c2 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'c9a7cd85-5ca0-4346-a76b-60e5e70d83c2', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '56b8532002f1d58a701a133c8c4dc658', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87378) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 10 12:47:50 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2415614c-86df-41ee-b3fa-0459507bf3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-030b09c8-646b-472c-afa5-08e859ca478b', 'volume_size': 1, 'image_id': 'c9a7cd85-5ca0-4346-a76b-60e5e70d83c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c9a7cd85-5ca0-4346-a76b-60e5e70d83c2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '56b8532002f1d58a701a133c8c4dc658', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b4ea9267b41a4d32ab59a4b612b656eb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f8ec09cea781c5039eaf837a6180320a6512c73f48289af856bb5518a09ab7ef1709d7ac3e61e92bdd55babd98a07ab98807beb1af494e934169885af3dbad5a', 'id': 'c9a7cd85-5ca0-4346-a76b-60e5e70d83c2', 'created_at': datetime.datetime(2026, 7, 10, 10, 47, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 10, 47, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c9a7cd85-5ca0-4346-a76b-60e5e70d83c2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74a0abc0f320>}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:47:50 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29b23ecf-22cf-42e3-8b2f-ab00c52de39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:47:50 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Volume volume-030b09c8-646b-472c-afa5-08e859ca478b (030b09c8-646b-472c-afa5-08e859ca478b): created successfully
Jul 10 12:47:50 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29b23ecf-22cf-42e3-8b2f-ab00c52de39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:47:50 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Flow 'volume_create_manager' (09644507-7b7e-4c18-8f70-73357708ca05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:47:50 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-f18e06bc-7239-459d-bc3c-d8375233aed8 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Created volume successfully.
Jul 10 12:47:50 devstack sudo[98543]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b6e50245-01ac-476d-a088-6895f2a1a667 tempest-SnapshotsActionsTest-1562062894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.info" returned: 0 in 0.776s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:50 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-b6e50245-01ac-476d-a088-6895f2a1a667 tempest-SnapshotsActionsTest-1562062894 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.info is being set with open permissions: ugo+rw
Jul 10 12:47:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b6e50245-01ac-476d-a088-6895f2a1a667 tempest-SnapshotsActionsTest-1562062894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:50 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-85a38ae2-f2ed-4b09-a351-7a9c32cfbc05 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Acquiring lock "cinder-030b09c8-646b-472c-afa5-08e859ca478b-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:47:50 devstack sudo[98550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.info
Jul 10 12:47:50 devstack sudo[98550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:50 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-85a38ae2-f2ed-4b09-a351-7a9c32cfbc05 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Lock "cinder-030b09c8-646b-472c-afa5-08e859ca478b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:47:50 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-85a38ae2-f2ed-4b09-a351-7a9c32cfbc05 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Acquiring lock "cinder-quobyte-030b09c8-646b-472c-afa5-08e859ca478b" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:47:50 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-85a38ae2-f2ed-4b09-a351-7a9c32cfbc05 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Lock "cinder-quobyte-030b09c8-646b-472c-afa5-08e859ca478b" acquired by "delete_volume" :: waited 0.018s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:47:50 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b828232-aabe-4200-ac33-5ec6da256f2e]: (4, 'raw') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:47:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-85a38ae2-f2ed-4b09-a351-7a9c32cfbc05 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-030b09c8-646b-472c-afa5-08e859ca478b {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:50 devstack sudo[98552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-030b09c8-646b-472c-afa5-08e859ca478b
Jul 10 12:47:50 devstack sudo[98552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:51 devstack sudo[98550]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b6e50245-01ac-476d-a088-6895f2a1a667 tempest-SnapshotsActionsTest-1562062894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.info" returned: 0 in 0.712s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-b6e50245-01ac-476d-a088-6895f2a1a667 tempest-SnapshotsActionsTest-1562062894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.290s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:47:51 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-b6e50245-01ac-476d-a088-6895f2a1a667 tempest-SnapshotsActionsTest-1562062894 None] Create snapshot completed successfully
Jul 10 12:47:51 devstack sudo[98552]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-85a38ae2-f2ed-4b09-a351-7a9c32cfbc05 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-030b09c8-646b-472c-afa5-08e859ca478b" returned: 0 in 0.845s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-85a38ae2-f2ed-4b09-a351-7a9c32cfbc05 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-030b09c8-646b-472c-afa5-08e859ca478b {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:51 devstack sudo[98557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-030b09c8-646b-472c-afa5-08e859ca478b
Jul 10 12:47:51 devstack sudo[98557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-a1f07687-5f90-4447-aa6f-dac3e055f847 req-5ad8b481-3796-4ee3-97fa-88f401f91a07 tempest-TestInstancesWithCinderVolumes-1856690417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:47:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-a1f07687-5f90-4447-aa6f-dac3e055f847 req-5ad8b481-3796-4ee3-97fa-88f401f91a07 tempest-TestInstancesWithCinderVolumes-1856690417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:47:52 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04b6db3-7152-44e8-956b-65244cbc40ad]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:47:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-a1f07687-5f90-4447-aa6f-dac3e055f847 req-5ad8b481-3796-4ee3-97fa-88f401f91a07 tempest-TestInstancesWithCinderVolumes-1856690417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8c741089-5750-4ff2-8fc1-c35c4c3f864c {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:52 devstack sudo[98557]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-85a38ae2-f2ed-4b09-a351-7a9c32cfbc05 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-030b09c8-646b-472c-afa5-08e859ca478b" returned: 1 in 0.825s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-85a38ae2-f2ed-4b09-a351-7a9c32cfbc05 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-030b09c8-646b-472c-afa5-08e859ca478b' failed. Not Retrying. {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 10 12:47:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-85a38ae2-f2ed-4b09-a351-7a9c32cfbc05 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-030b09c8-646b-472c-afa5-08e859ca478b {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:52 devstack sudo[98571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-030b09c8-646b-472c-afa5-08e859ca478b
Jul 10 12:47:52 devstack sudo[98571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:52 devstack sudo[98570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8c741089-5750-4ff2-8fc1-c35c4c3f864c
Jul 10 12:47:52 devstack sudo[98570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-df9fc0f0-5b06-4560-bc76-35dc9d30c275 tempest-SnapshotsActionsTest-1562062894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:47:53 devstack sudo[98571]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-85a38ae2-f2ed-4b09-a351-7a9c32cfbc05 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-030b09c8-646b-472c-afa5-08e859ca478b" returned: 0 in 0.790s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:53 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-85a38ae2-f2ed-4b09-a351-7a9c32cfbc05 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Lock "cinder-quobyte-030b09c8-646b-472c-afa5-08e859ca478b" released by "delete_volume" :: held 2.527s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:47:53 devstack cinder-volume[87378]: WARNING cinder.quota [None req-85a38ae2-f2ed-4b09-a351-7a9c32cfbc05 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jul 10 12:47:53 devstack cinder-volume[87378]: WARNING cinder.quota [None req-85a38ae2-f2ed-4b09-a351-7a9c32cfbc05 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jul 10 12:47:53 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-85a38ae2-f2ed-4b09-a351-7a9c32cfbc05 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Created reservations ['35c8859e-09c4-4d92-94a5-1bd9bb60b1a0', '89b788e1-f0cb-4a96-8760-a186c0884776', 'a65295bf-eefb-4720-b78e-02f2836d8de9', '3a318018-4414-4d17-bfd3-8dd581f67f58'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:47:53 devstack sudo[98570]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-a1f07687-5f90-4447-aa6f-dac3e055f847 req-5ad8b481-3796-4ee3-97fa-88f401f91a07 tempest-TestInstancesWithCinderVolumes-1856690417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8c741089-5750-4ff2-8fc1-c35c4c3f864c" returned: 0 in 0.905s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-a1f07687-5f90-4447-aa6f-dac3e055f847 req-5ad8b481-3796-4ee3-97fa-88f401f91a07 tempest-TestInstancesWithCinderVolumes-1856690417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.930s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:47:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-df9fc0f0-5b06-4560-bc76-35dc9d30c275 tempest-SnapshotsActionsTest-1562062894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.120s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:47:53 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-df9fc0f0-5b06-4560-bc76-35dc9d30c275 tempest-SnapshotsActionsTest-1562062894 None] Creating offline snapshot 6f4fd20a-8b04-4406-a005-5600c68a0d0f of volume 3e645700-a883-4de8-83a0-309080c6985e {{(pid=87378) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 10 12:47:53 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5a8f04-a210-49b1-a72f-c6746186a79b]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:47:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-df9fc0f0-5b06-4560-bc76-35dc9d30c275 tempest-SnapshotsActionsTest-1562062894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:53 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-a1f07687-5f90-4447-aa6f-dac3e055f847 req-5ad8b481-3796-4ee3-97fa-88f401f91a07 tempest-TestInstancesWithCinderVolumes-1856690417 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be', 'name': 'volume-8c741089-5750-4ff2-8fc1-c35c4c3f864c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '20f957c8-6007-4285-88ef-673e8d54a061', 'enforce_multipath': True} {{(pid=87378) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 10 12:47:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-85a38ae2-f2ed-4b09-a351-7a9c32cfbc05 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:47:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-85a38ae2-f2ed-4b09-a351-7a9c32cfbc05 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:47:53 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-85a38ae2-f2ed-4b09-a351-7a9c32cfbc05 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:47:53 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-85a38ae2-f2ed-4b09-a351-7a9c32cfbc05 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:47:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-85a38ae2-f2ed-4b09-a351-7a9c32cfbc05 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:47:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-85a38ae2-f2ed-4b09-a351-7a9c32cfbc05 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:53 devstack sudo[98579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:47:53 devstack sudo[98579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:53 devstack sudo[98578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23
Jul 10 12:47:53 devstack sudo[98578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:53 devstack cinder-volume[87378]: INFO cinder.volume.manager [req-a1f07687-5f90-4447-aa6f-dac3e055f847 req-5ad8b481-3796-4ee3-97fa-88f401f91a07 tempest-TestInstancesWithCinderVolumes-1856690417 None] attachment_update completed successfully.
Jul 10 12:47:53 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-4eca5ece-b1e8-4fdc-9579-2089c558aa09 tempest-GroupSnapshotsTest-1497579122 None] Group tempest-GroupSnapshotsTest-Group-478850143: creating
Jul 10 12:47:53 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-4eca5ece-b1e8-4fdc-9579-2089c558aa09 tempest-GroupSnapshotsTest-1497579122 None] Group tempest-GroupSnapshotsTest-Group-478850143: created successfully
Jul 10 12:47:54 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-4eca5ece-b1e8-4fdc-9579-2089c558aa09 tempest-GroupSnapshotsTest-1497579122 None] Create group completed successfully.
Jul 10 12:47:54 devstack sudo[98578]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-df9fc0f0-5b06-4560-bc76-35dc9d30c275 tempest-SnapshotsActionsTest-1562062894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23" returned: 0 in 0.886s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:54 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-df9fc0f0-5b06-4560-bc76-35dc9d30c275 tempest-SnapshotsActionsTest-1562062894 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e645700-a883-4de8-83a0-309080c6985e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:47:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-df9fc0f0-5b06-4560-bc76-35dc9d30c275 tempest-SnapshotsActionsTest-1562062894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.6f4fd20a-8b04-4406-a005-5600c68a0d0f 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:54 devstack sudo[98579]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-85a38ae2-f2ed-4b09-a351-7a9c32cfbc05 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.828s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:54 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-85a38ae2-f2ed-4b09-a351-7a9c32cfbc05 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:47:54 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-85a38ae2-f2ed-4b09-a351-7a9c32cfbc05 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Deleted volume successfully.
Jul 10 12:47:54 devstack sudo[98586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.6f4fd20a-8b04-4406-a005-5600c68a0d0f 1G
Jul 10 12:47:54 devstack sudo[98586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:54 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-85a38ae2-f2ed-4b09-a351-7a9c32cfbc05 tempest-VolumeAndVolumeTypeFromImageTest-739524062 None] Lock "cinder-030b09c8-646b-472c-afa5-08e859ca478b-delete_volume" released by "delete_volume" :: held 3.674s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:47:54 devstack sudo[98586]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-df9fc0f0-5b06-4560-bc76-35dc9d30c275 tempest-SnapshotsActionsTest-1562062894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.6f4fd20a-8b04-4406-a005-5600c68a0d0f 1G" returned: 0 in 0.913s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-df9fc0f0-5b06-4560-bc76-35dc9d30c275 tempest-SnapshotsActionsTest-1562062894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.6f4fd20a-8b04-4406-a005-5600c68a0d0f {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:55 devstack sudo[98594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.6f4fd20a-8b04-4406-a005-5600c68a0d0f
Jul 10 12:47:55 devstack sudo[98594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:55 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-90585ed6-1a31-4101-8cc4-fb50a235b439 tempest-GroupSnapshotsTest-1497579122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:47:55 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-90585ed6-1a31-4101-8cc4-fb50a235b439 tempest-GroupSnapshotsTest-1497579122 None] Flow 'volume_create_manager' (1cdae6ac-0aeb-4eaa-a5aa-1d452cdd87df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:47:55 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-90585ed6-1a31-4101-8cc4-fb50a235b439 tempest-GroupSnapshotsTest-1497579122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a56053f7-e2fd-48a8-a54d-0073acceca7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:47:55 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-90585ed6-1a31-4101-8cc4-fb50a235b439 tempest-GroupSnapshotsTest-1497579122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a56053f7-e2fd-48a8-a54d-0073acceca7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:47:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-298380184',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=43f038a5-3e21-46f0-a95d-8a3111a34cf0,host='devstack@QuobyteHD#QuobyteHD',id=877497d9-ba11-4969-91e6-e95e0d9cd5de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca795075de2f45bf8c75eaa6d162dc93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:47:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:47:56Z,use_quota=True,user_id='662d32fbb232435a8c88e72656348521',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e85d7a4-49b2-4efc-9cd5-6a04ac13f5d1),volume_type_id=5e85d7a4-49b2-4efc-9cd5-6a04ac13f5d1)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:47:55 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-90585ed6-1a31-4101-8cc4-fb50a235b439 tempest-GroupSnapshotsTest-1497579122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b3f4d0a-3176-4587-85ec-452c0223da17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:47:55 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-90585ed6-1a31-4101-8cc4-fb50a235b439 tempest-GroupSnapshotsTest-1497579122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b3f4d0a-3176-4587-85ec-452c0223da17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:47:55 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-90585ed6-1a31-4101-8cc4-fb50a235b439 tempest-GroupSnapshotsTest-1497579122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc0ab181-9074-461a-8e83-ba33253fb197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:47:55 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-90585ed6-1a31-4101-8cc4-fb50a235b439 tempest-GroupSnapshotsTest-1497579122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc0ab181-9074-461a-8e83-ba33253fb197) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '877497d9-ba11-4969-91e6-e95e0d9cd5de', 'volume_name': 'volume-877497d9-ba11-4969-91e6-e95e0d9cd5de', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:47:55 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-90585ed6-1a31-4101-8cc4-fb50a235b439 tempest-GroupSnapshotsTest-1497579122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8cf9241-746f-4e6a-83e4-2b456d85287c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:47:55 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-90585ed6-1a31-4101-8cc4-fb50a235b439 tempest-GroupSnapshotsTest-1497579122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8cf9241-746f-4e6a-83e4-2b456d85287c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:47:55 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-90585ed6-1a31-4101-8cc4-fb50a235b439 tempest-GroupSnapshotsTest-1497579122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1b023ea-813c-489b-ab0f-6544a6d66f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:47:55 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-90585ed6-1a31-4101-8cc4-fb50a235b439 tempest-GroupSnapshotsTest-1497579122 None] Volume 877497d9-ba11-4969-91e6-e95e0d9cd5de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-877497d9-ba11-4969-91e6-e95e0d9cd5de', 'volume_size': 1}
Jul 10 12:47:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-90585ed6-1a31-4101-8cc4-fb50a235b439 tempest-GroupSnapshotsTest-1497579122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:47:55 devstack sudo[98594]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-df9fc0f0-5b06-4560-bc76-35dc9d30c275 tempest-SnapshotsActionsTest-1562062894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.6f4fd20a-8b04-4406-a005-5600c68a0d0f" returned: 0 in 0.883s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:55 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-df9fc0f0-5b06-4560-bc76-35dc9d30c275 tempest-SnapshotsActionsTest-1562062894 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.6f4fd20a-8b04-4406-a005-5600c68a0d0f is being set with open permissions: ugo+rw
Jul 10 12:47:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-df9fc0f0-5b06-4560-bc76-35dc9d30c275 tempest-SnapshotsActionsTest-1562062894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.6f4fd20a-8b04-4406-a005-5600c68a0d0f {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:55 devstack sudo[98599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.6f4fd20a-8b04-4406-a005-5600c68a0d0f
Jul 10 12:47:55 devstack sudo[98599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:56 devstack sudo[98599]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-df9fc0f0-5b06-4560-bc76-35dc9d30c275 tempest-SnapshotsActionsTest-1562062894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.6f4fd20a-8b04-4406-a005-5600c68a0d0f" returned: 0 in 0.719s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-df9fc0f0-5b06-4560-bc76-35dc9d30c275 tempest-SnapshotsActionsTest-1562062894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.516s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:47:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-90585ed6-1a31-4101-8cc4-fb50a235b439 tempest-GroupSnapshotsTest-1497579122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.817s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:47:56 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-90585ed6-1a31-4101-8cc4-fb50a235b439 tempest-GroupSnapshotsTest-1497579122 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=43f038a5-3e21-46f0-a95d-8a3111a34cf0,created_at=2026-07-10T10:47:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-298380184',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=43f038a5-3e21-46f0-a95d-8a3111a34cf0,host='devstack@QuobyteHD#QuobyteHD',id=877497d9-ba11-4969-91e6-e95e0d9cd5de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca795075de2f45bf8c75eaa6d162dc93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:47:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:47:56Z,use_quota=True,user_id='662d32fbb232435a8c88e72656348521',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e85d7a4-49b2-4efc-9cd5-6a04ac13f5d1),volume_type_id=5e85d7a4-49b2-4efc-9cd5-6a04ac13f5d1)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:47:56 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-90585ed6-1a31-4101-8cc4-fb50a235b439 tempest-GroupSnapshotsTest-1497579122 None] Creating volume 877497d9-ba11-4969-91e6-e95e0d9cd5de {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:47:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-90585ed6-1a31-4101-8cc4-fb50a235b439 tempest-GroupSnapshotsTest-1497579122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:47:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-90585ed6-1a31-4101-8cc4-fb50a235b439 tempest-GroupSnapshotsTest-1497579122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:47:56 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-90585ed6-1a31-4101-8cc4-fb50a235b439 tempest-GroupSnapshotsTest-1497579122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:47:56 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-90585ed6-1a31-4101-8cc4-fb50a235b439 tempest-GroupSnapshotsTest-1497579122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:47:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-90585ed6-1a31-4101-8cc4-fb50a235b439 tempest-GroupSnapshotsTest-1497579122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:47:56 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-90585ed6-1a31-4101-8cc4-fb50a235b439 tempest-GroupSnapshotsTest-1497579122 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:47:56 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-90585ed6-1a31-4101-8cc4-fb50a235b439 tempest-GroupSnapshotsTest-1497579122 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:47:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-90585ed6-1a31-4101-8cc4-fb50a235b439 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:56 devstack sudo[98603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de 1073741824
Jul 10 12:47:56 devstack sudo[98603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:56 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-df9fc0f0-5b06-4560-bc76-35dc9d30c275 tempest-SnapshotsActionsTest-1562062894 None] Create snapshot completed successfully
Jul 10 12:47:57 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-452c7257-e33a-40c8-9bb4-2bcc8fe3ba61 tempest-SnapshotsActionsTest-789273322 None] Acquiring lock "cinder-6f4fd20a-8b04-4406-a005-5600c68a0d0f-delete_snapshot" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:47:57 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-452c7257-e33a-40c8-9bb4-2bcc8fe3ba61 tempest-SnapshotsActionsTest-789273322 None] Lock "cinder-6f4fd20a-8b04-4406-a005-5600c68a0d0f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:47:57 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-452c7257-e33a-40c8-9bb4-2bcc8fe3ba61 tempest-SnapshotsActionsTest-789273322 None] Acquiring lock "cinder-quobyte-3e645700-a883-4de8-83a0-309080c6985e" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:47:57 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-452c7257-e33a-40c8-9bb4-2bcc8fe3ba61 tempest-SnapshotsActionsTest-789273322 None] Lock "cinder-quobyte-3e645700-a883-4de8-83a0-309080c6985e" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:47:57 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-452c7257-e33a-40c8-9bb4-2bcc8fe3ba61 tempest-SnapshotsActionsTest-789273322 None] Acquiring lock "cinder-quobyte-6f4fd20a-8b04-4406-a005-5600c68a0d0f" by "_delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:47:57 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-452c7257-e33a-40c8-9bb4-2bcc8fe3ba61 tempest-SnapshotsActionsTest-789273322 None] Lock "cinder-quobyte-6f4fd20a-8b04-4406-a005-5600c68a0d0f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:47:57 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-452c7257-e33a-40c8-9bb4-2bcc8fe3ba61 tempest-SnapshotsActionsTest-789273322 None] Deleting offline snapshot 6f4fd20a-8b04-4406-a005-5600c68a0d0f of volume 3e645700-a883-4de8-83a0-309080c6985e {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 10 12:47:57 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-452c7257-e33a-40c8-9bb4-2bcc8fe3ba61 tempest-SnapshotsActionsTest-789273322 None] snapshot_file for this snap is: volume-3e645700-a883-4de8-83a0-309080c6985e.6f4fd20a-8b04-4406-a005-5600c68a0d0f {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 10 12:47:57 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[70470b9d-6e15-49dd-bd80-470ceb6fac92]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:47:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-452c7257-e33a-40c8-9bb4-2bcc8fe3ba61 tempest-SnapshotsActionsTest-789273322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.6f4fd20a-8b04-4406-a005-5600c68a0d0f {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:57 devstack sudo[98613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.6f4fd20a-8b04-4406-a005-5600c68a0d0f
Jul 10 12:47:57 devstack sudo[98613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:57 devstack sudo[98603]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-90585ed6-1a31-4101-8cc4-fb50a235b439 tempest-GroupSnapshotsTest-1497579122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de 1073741824" returned: 0 in 1.041s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-90585ed6-1a31-4101-8cc4-fb50a235b439 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:57 devstack sudo[98617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de
Jul 10 12:47:57 devstack sudo[98617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:58 devstack sudo[98613]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-452c7257-e33a-40c8-9bb4-2bcc8fe3ba61 tempest-SnapshotsActionsTest-789273322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.6f4fd20a-8b04-4406-a005-5600c68a0d0f" returned: 0 in 0.883s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:58 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-452c7257-e33a-40c8-9bb4-2bcc8fe3ba61 tempest-SnapshotsActionsTest-789273322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e645700-a883-4de8-83a0-309080c6985e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:47:58 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[9054fe83-f606-4cb2-9305-d31ce490d5bf]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:47:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-452c7257-e33a-40c8-9bb4-2bcc8fe3ba61 tempest-SnapshotsActionsTest-789273322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:58 devstack sudo[98617]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-90585ed6-1a31-4101-8cc4-fb50a235b439 tempest-GroupSnapshotsTest-1497579122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de" returned: 0 in 0.739s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:58 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-90585ed6-1a31-4101-8cc4-fb50a235b439 tempest-GroupSnapshotsTest-1497579122 None] <== create_volume: return (1843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:47:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-90585ed6-1a31-4101-8cc4-fb50a235b439 tempest-GroupSnapshotsTest-1497579122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.846s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:47:58 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-90585ed6-1a31-4101-8cc4-fb50a235b439 tempest-GroupSnapshotsTest-1497579122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1b023ea-813c-489b-ab0f-6544a6d66f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-877497d9-ba11-4969-91e6-e95e0d9cd5de', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:47:58 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-90585ed6-1a31-4101-8cc4-fb50a235b439 tempest-GroupSnapshotsTest-1497579122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8229565d-f0ce-4bb8-9ef9-c389077b1f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:47:58 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-90585ed6-1a31-4101-8cc4-fb50a235b439 tempest-GroupSnapshotsTest-1497579122 None] Volume volume-877497d9-ba11-4969-91e6-e95e0d9cd5de (877497d9-ba11-4969-91e6-e95e0d9cd5de): created successfully
Jul 10 12:47:58 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-90585ed6-1a31-4101-8cc4-fb50a235b439 tempest-GroupSnapshotsTest-1497579122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8229565d-f0ce-4bb8-9ef9-c389077b1f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:47:58 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-90585ed6-1a31-4101-8cc4-fb50a235b439 tempest-GroupSnapshotsTest-1497579122 None] Flow 'volume_create_manager' (1cdae6ac-0aeb-4eaa-a5aa-1d452cdd87df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:47:58 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-90585ed6-1a31-4101-8cc4-fb50a235b439 tempest-GroupSnapshotsTest-1497579122 None] Created volume successfully.
Jul 10 12:47:58 devstack sudo[98626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23
Jul 10 12:47:58 devstack sudo[98626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:59 devstack sudo[98626]: pam_unix(sudo:session): session closed for user root
Jul 10 12:47:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-452c7257-e33a-40c8-9bb4-2bcc8fe3ba61 tempest-SnapshotsActionsTest-789273322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23" returned: 0 in 0.847s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:47:59 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-452c7257-e33a-40c8-9bb4-2bcc8fe3ba61 tempest-SnapshotsActionsTest-789273322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e645700-a883-4de8-83a0-309080c6985e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:47:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-452c7257-e33a-40c8-9bb4-2bcc8fe3ba61 tempest-SnapshotsActionsTest-789273322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.6f4fd20a-8b04-4406-a005-5600c68a0d0f {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:59 devstack sudo[98634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.6f4fd20a-8b04-4406-a005-5600c68a0d0f
Jul 10 12:47:59 devstack sudo[98634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:47:59 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-38681712-4141-4c4f-b645-a850b2608dc8 tempest-GroupSnapshotsTest-1497579122 None] GroupSnapshot eb447fc7-9964-4ac8-a73e-28837ab817e8: creating.
Jul 10 12:47:59 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-38681712-4141-4c4f-b645-a850b2608dc8 tempest-GroupSnapshotsTest-1497579122 None] Group snapshot eb447fc7-9964-4ac8-a73e-28837ab817e8: creating. {{(pid=87378) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 10 12:47:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-38681712-4141-4c4f-b645-a850b2608dc8 tempest-GroupSnapshotsTest-1497579122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:47:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-38681712-4141-4c4f-b645-a850b2608dc8 tempest-GroupSnapshotsTest-1497579122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:47:59 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-38681712-4141-4c4f-b645-a850b2608dc8 tempest-GroupSnapshotsTest-1497579122 None] Creating offline snapshot a5191d95-2283-4928-9aac-5038c4643c5a of volume 877497d9-ba11-4969-91e6-e95e0d9cd5de {{(pid=87378) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 10 12:47:59 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[773a45b4-640d-437b-a785-1871f0f017ce]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:47:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-38681712-4141-4c4f-b645-a850b2608dc8 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:47:59 devstack sudo[98636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de
Jul 10 12:47:59 devstack sudo[98636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:00 devstack sudo[98634]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-452c7257-e33a-40c8-9bb4-2bcc8fe3ba61 tempest-SnapshotsActionsTest-789273322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.6f4fd20a-8b04-4406-a005-5600c68a0d0f" returned: 0 in 0.890s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-452c7257-e33a-40c8-9bb4-2bcc8fe3ba61 tempest-SnapshotsActionsTest-789273322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.6f4fd20a-8b04-4406-a005-5600c68a0d0f {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:00 devstack sudo[98646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.6f4fd20a-8b04-4406-a005-5600c68a0d0f
Jul 10 12:48:00 devstack sudo[98646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:00 devstack sudo[98636]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-38681712-4141-4c4f-b645-a850b2608dc8 tempest-GroupSnapshotsTest-1497579122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de" returned: 0 in 0.907s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-38681712-4141-4c4f-b645-a850b2608dc8 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de.a5191d95-2283-4928-9aac-5038c4643c5a 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:00 devstack sudo[98653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de.a5191d95-2283-4928-9aac-5038c4643c5a 1G
Jul 10 12:48:00 devstack sudo[98653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:00 devstack sudo[98646]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-452c7257-e33a-40c8-9bb4-2bcc8fe3ba61 tempest-SnapshotsActionsTest-789273322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.6f4fd20a-8b04-4406-a005-5600c68a0d0f" returned: 0 in 0.761s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:00 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-452c7257-e33a-40c8-9bb4-2bcc8fe3ba61 tempest-SnapshotsActionsTest-789273322 None] Lock "cinder-quobyte-6f4fd20a-8b04-4406-a005-5600c68a0d0f" released by "_delete_snapshot" :: held 3.512s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:48:00 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-452c7257-e33a-40c8-9bb4-2bcc8fe3ba61 tempest-SnapshotsActionsTest-789273322 None] Lock "cinder-quobyte-3e645700-a883-4de8-83a0-309080c6985e" released by "delete_snapshot" :: held 3.540s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:48:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-98d2ff7b-e02b-4828-a21a-7660ce79da40 req-049c64eb-2051-465c-b28d-94527ca079da tempest-TestInstancesWithCinderVolumes-1856690417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:48:01 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-452c7257-e33a-40c8-9bb4-2bcc8fe3ba61 tempest-SnapshotsActionsTest-789273322 None] Created reservations ['228a2a3f-248e-44c9-b5b8-6c855e4f0e23', '32ba7ba9-65fa-4ce3-9562-b4e05a61292b', '6bedc67a-e922-43d2-bf52-4f7b2e8201af', 'dd015ff7-fe74-4c8a-ac7c-80f2f2d9f19e'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:48:01 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-452c7257-e33a-40c8-9bb4-2bcc8fe3ba61 tempest-SnapshotsActionsTest-789273322 None] Delete snapshot completed successfully.
Jul 10 12:48:01 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-452c7257-e33a-40c8-9bb4-2bcc8fe3ba61 tempest-SnapshotsActionsTest-789273322 None] Lock "cinder-6f4fd20a-8b04-4406-a005-5600c68a0d0f-delete_snapshot" released by "delete_snapshot" :: held 3.730s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:48:01 devstack sudo[98653]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-38681712-4141-4c4f-b645-a850b2608dc8 tempest-GroupSnapshotsTest-1497579122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de.a5191d95-2283-4928-9aac-5038c4643c5a 1G" returned: 0 in 0.897s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-38681712-4141-4c4f-b645-a850b2608dc8 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-877497d9-ba11-4969-91e6-e95e0d9cd5de -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de.a5191d95-2283-4928-9aac-5038c4643c5a {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:01 devstack sudo[98668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-877497d9-ba11-4969-91e6-e95e0d9cd5de -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de.a5191d95-2283-4928-9aac-5038c4643c5a
Jul 10 12:48:01 devstack sudo[98668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:01 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:48:01 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Flow 'volume_create_manager' (96eb1554-1f17-4302-93b7-f7c7a6af19e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:48:01 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fd16384-1d3e-4227-861d-a25a54302958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:01 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fd16384-1d3e-4227-861d-a25a54302958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:48:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3db6faeb-f77f-4924-9a41-33eb45cc4993,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='454a56d2798f4d8f829c2f472e74b1e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:48:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:48:02Z,use_quota=True,user_id='f2932a6c1da6497c929f8c3344f94c95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:48:01 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (379fa443-cf2f-4871-8bd5-d76275fd14b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:01 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (379fa443-cf2f-4871-8bd5-d76275fd14b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:48:01 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3d04935-3680-4770-9232-5c2dbdc4bbed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:01 devstack cinder-volume[87378]: DEBUG cinder.image.glance [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Creating Keystone auth plugin from conf {{(pid=87378) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 10 12:48:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1681eb60-c26a-43e7-84ef-97becdf2a69e tempest-SnapshotsActionsTest-1562062894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:48:02 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3d04935-3680-4770-9232-5c2dbdc4bbed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3db6faeb-f77f-4924-9a41-33eb45cc4993', 'volume_name': 'volume-3db6faeb-f77f-4924-9a41-33eb45cc4993', 'volume_size': 1, 'image_id': 'a05b04d1-793d-499f-9a68-3a5115e5f96d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a05b04d1-793d-499f-9a68-3a5115e5f96d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '71cc4e086bb609886fbb2f9813466055', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '454a56d2798f4d8f829c2f472e74b1e8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ea0f10d2f585e09b73b388151f3ba4c3461b262bbb51d07e15135dc3fd9a0ed43cd9471341256dac98dad51f31076985c5f064aa9ec53bd006c825380d701747', 'id': 'a05b04d1-793d-499f-9a68-3a5115e5f96d', 'created_at': datetime.datetime(2026, 7, 10, 10, 47, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 10, 48, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a05b04d1-793d-499f-9a68-3a5115e5f96d/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74a0a162daf0>}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:48:02 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02a8d41d-9a0d-434e-8a94-2106dee8cdd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:02 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02a8d41d-9a0d-434e-8a94-2106dee8cdd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:48:02 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (017280cf-f07f-454c-9f0b-cf93d5281f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:02 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Volume 3db6faeb-f77f-4924-9a41-33eb45cc4993: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3db6faeb-f77f-4924-9a41-33eb45cc4993', 'volume_size': 1, 'image_id': 'a05b04d1-793d-499f-9a68-3a5115e5f96d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a05b04d1-793d-499f-9a68-3a5115e5f96d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '71cc4e086bb609886fbb2f9813466055', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '454a56d2798f4d8f829c2f472e74b1e8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ea0f10d2f585e09b73b388151f3ba4c3461b262bbb51d07e15135dc3fd9a0ed43cd9471341256dac98dad51f31076985c5f064aa9ec53bd006c825380d701747', 'id': 'a05b04d1-793d-499f-9a68-3a5115e5f96d', 'created_at': datetime.datetime(2026, 7, 10, 10, 47, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 10, 48, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a05b04d1-793d-499f-9a68-3a5115e5f96d/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74a0a162daf0>}
Jul 10 12:48:02 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Trying to clone 3db6faeb-f77f-4924-9a41-33eb45cc4993 from image a05b04d1-793d-499f-9a68-3a5115e5f96d at location (None, [{'url': 'file:///opt/stack/data/glance/images/a05b04d1-793d-499f-9a68-3a5115e5f96d', 'metadata': {}}]). {{(pid=87378) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 10 12:48:02 devstack sudo[98668]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-38681712-4141-4c4f-b645-a850b2608dc8 tempest-GroupSnapshotsTest-1497579122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-877497d9-ba11-4969-91e6-e95e0d9cd5de -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de.a5191d95-2283-4928-9aac-5038c4643c5a" returned: 0 in 0.798s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:02 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-38681712-4141-4c4f-b645-a850b2608dc8 tempest-GroupSnapshotsTest-1497579122 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de.a5191d95-2283-4928-9aac-5038c4643c5a is being set with open permissions: ugo+rw: NotImplementedError
Jul 10 12:48:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-38681712-4141-4c4f-b645-a850b2608dc8 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de.a5191d95-2283-4928-9aac-5038c4643c5a {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:02 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a05b04d1-793d-499f-9a68-3a5115e5f96d_j8kazk6udevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87378) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 10 12:48:02 devstack cinder-volume[87378]: INFO cinder.image.image_utils [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Image download 0.00 MB at 0.00 MB/s
Jul 10 12:48:02 devstack sudo[98674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de.a5191d95-2283-4928-9aac-5038c4643c5a
Jul 10 12:48:02 devstack sudo[98674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:02 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d84414-20a9-448c-b0fe-5c94d4663a4a]: (4, 'raw') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:48:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a05b04d1-793d-499f-9a68-3a5115e5f96d_j8kazk6udevstack@QuobyteHD {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:02 devstack sudo[98676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a05b04d1-793d-499f-9a68-3a5115e5f96d_j8kazk6udevstack@QuobyteHD
Jul 10 12:48:02 devstack sudo[98676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:02 devstack sudo[98674]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-38681712-4141-4c4f-b645-a850b2608dc8 tempest-GroupSnapshotsTest-1497579122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de.a5191d95-2283-4928-9aac-5038c4643c5a" returned: 0 in 0.681s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-38681712-4141-4c4f-b645-a850b2608dc8 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:03 devstack sudo[98679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de.info
Jul 10 12:48:03 devstack sudo[98679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:03 devstack sudo[98676]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a05b04d1-793d-499f-9a68-3a5115e5f96d_j8kazk6udevstack@QuobyteHD" returned: 0 in 0.758s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a05b04d1-793d-499f-9a68-3a5115e5f96d_j8kazk6udevstack@QuobyteHD {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:03 devstack sudo[98683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a05b04d1-793d-499f-9a68-3a5115e5f96d_j8kazk6udevstack@QuobyteHD
Jul 10 12:48:03 devstack sudo[98683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:03 devstack sudo[98679]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-38681712-4141-4c4f-b645-a850b2608dc8 tempest-GroupSnapshotsTest-1497579122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de.info" returned: 0 in 0.636s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:03 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-38681712-4141-4c4f-b645-a850b2608dc8 tempest-GroupSnapshotsTest-1497579122 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 10 12:48:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-38681712-4141-4c4f-b645-a850b2608dc8 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:03 devstack sudo[98686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de.info
Jul 10 12:48:03 devstack sudo[98686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:03 devstack sudo[98683]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a05b04d1-793d-499f-9a68-3a5115e5f96d_j8kazk6udevstack@QuobyteHD" returned: 1 in 0.826s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a05b04d1-793d-499f-9a68-3a5115e5f96d_j8kazk6udevstack@QuobyteHD' failed. Not Retrying. {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 10 12:48:03 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Temporary image a05b04d1-793d-499f-9a68-3a5115e5f96d is fetched for user f2932a6c1da6497c929f8c3344f94c95. {{(pid=87378) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 10 12:48:04 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8adc8ce-f6c6-4598-95fb-3ab7ca006a2c]: (4, 'raw') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:48:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a05b04d1-793d-499f-9a68-3a5115e5f96d_j8kazk6udevstack@QuobyteHD {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:04 devstack sudo[98691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a05b04d1-793d-499f-9a68-3a5115e5f96d_j8kazk6udevstack@QuobyteHD
Jul 10 12:48:04 devstack sudo[98691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:04 devstack sudo[98686]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-38681712-4141-4c4f-b645-a850b2608dc8 tempest-GroupSnapshotsTest-1497579122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de.info" returned: 0 in 0.632s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-38681712-4141-4c4f-b645-a850b2608dc8 tempest-GroupSnapshotsTest-1497579122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.639s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:48:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-98d2ff7b-e02b-4828-a21a-7660ce79da40 req-049c64eb-2051-465c-b28d-94527ca079da tempest-TestInstancesWithCinderVolumes-1856690417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.260s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:48:04 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[918b9f5f-c440-4fc7-ad48-8303257525a4]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:48:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-98d2ff7b-e02b-4828-a21a-7660ce79da40 req-049c64eb-2051-465c-b28d-94527ca079da tempest-TestInstancesWithCinderVolumes-1856690417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6f208719-4a9a-4626-b1dd-f867d44e13e3 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:04 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-38681712-4141-4c4f-b645-a850b2608dc8 tempest-GroupSnapshotsTest-1497579122 None] group_snapshot eb447fc7-9964-4ac8-a73e-28837ab817e8: created successfully
Jul 10 12:48:04 devstack sudo[98694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6f208719-4a9a-4626-b1dd-f867d44e13e3
Jul 10 12:48:04 devstack sudo[98694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:04 devstack sudo[98691]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a05b04d1-793d-499f-9a68-3a5115e5f96d_j8kazk6udevstack@QuobyteHD" returned: 0 in 0.772s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a05b04d1-793d-499f-9a68-3a5115e5f96d_j8kazk6udevstack@QuobyteHD {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:04 devstack sudo[98698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a05b04d1-793d-499f-9a68-3a5115e5f96d_j8kazk6udevstack@QuobyteHD
Jul 10 12:48:04 devstack sudo[98698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:05 devstack sudo[98694]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-98d2ff7b-e02b-4828-a21a-7660ce79da40 req-049c64eb-2051-465c-b28d-94527ca079da tempest-TestInstancesWithCinderVolumes-1856690417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6f208719-4a9a-4626-b1dd-f867d44e13e3" returned: 0 in 0.773s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-98d2ff7b-e02b-4828-a21a-7660ce79da40 req-049c64eb-2051-465c-b28d-94527ca079da tempest-TestInstancesWithCinderVolumes-1856690417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.794s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:48:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1681eb60-c26a-43e7-84ef-97becdf2a69e tempest-SnapshotsActionsTest-1562062894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.942s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:48:05 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-1681eb60-c26a-43e7-84ef-97becdf2a69e tempest-SnapshotsActionsTest-1562062894 None] Creating offline snapshot c92eecbc-1f76-43b6-900c-05441256cf7b of volume 3e645700-a883-4de8-83a0-309080c6985e {{(pid=87378) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 10 12:48:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-98d2ff7b-e02b-4828-a21a-7660ce79da40 req-049c64eb-2051-465c-b28d-94527ca079da tempest-TestInstancesWithCinderVolumes-1856690417 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be', 'name': 'volume-6f208719-4a9a-4626-b1dd-f867d44e13e3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bf4a5a57-9ee2-427c-92bf-c8388347d154', 'enforce_multipath': True} {{(pid=87378) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 10 12:48:05 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bd44e2-899a-433d-8c6f-81465d0f9467]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:48:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1681eb60-c26a-43e7-84ef-97becdf2a69e tempest-SnapshotsActionsTest-1562062894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:05 devstack cinder-volume[87378]: INFO cinder.volume.manager [req-98d2ff7b-e02b-4828-a21a-7660ce79da40 req-049c64eb-2051-465c-b28d-94527ca079da tempest-TestInstancesWithCinderVolumes-1856690417 None] attachment_update completed successfully.
Jul 10 12:48:05 devstack sudo[98703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23
Jul 10 12:48:05 devstack sudo[98703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:05 devstack sudo[98698]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a05b04d1-793d-499f-9a68-3a5115e5f96d_j8kazk6udevstack@QuobyteHD" returned: 1 in 0.766s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a05b04d1-793d-499f-9a68-3a5115e5f96d_j8kazk6udevstack@QuobyteHD' failed. Not Retrying. {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 10 12:48:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:48:05 devstack sudo[98703]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1681eb60-c26a-43e7-84ef-97becdf2a69e tempest-SnapshotsActionsTest-1562062894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23" returned: 0 in 0.782s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:05 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-1681eb60-c26a-43e7-84ef-97becdf2a69e tempest-SnapshotsActionsTest-1562062894 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e645700-a883-4de8-83a0-309080c6985e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:48:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1681eb60-c26a-43e7-84ef-97becdf2a69e tempest-SnapshotsActionsTest-1562062894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.c92eecbc-1f76-43b6-900c-05441256cf7b 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:05 devstack sudo[98712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.c92eecbc-1f76-43b6-900c-05441256cf7b 1G
Jul 10 12:48:05 devstack sudo[98712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-69b04d62-8a0c-4faf-9556-61fd97ce17b2 tempest-GroupSnapshotsTest-1497579122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:48:06 devstack sudo[98712]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1681eb60-c26a-43e7-84ef-97becdf2a69e tempest-SnapshotsActionsTest-1562062894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.c92eecbc-1f76-43b6-900c-05441256cf7b 1G" returned: 0 in 0.887s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1681eb60-c26a-43e7-84ef-97becdf2a69e tempest-SnapshotsActionsTest-1562062894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.c92eecbc-1f76-43b6-900c-05441256cf7b {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:06 devstack sudo[98719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.c92eecbc-1f76-43b6-900c-05441256cf7b
Jul 10 12:48:06 devstack sudo[98719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:07 devstack sudo[98719]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1681eb60-c26a-43e7-84ef-97becdf2a69e tempest-SnapshotsActionsTest-1562062894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.c92eecbc-1f76-43b6-900c-05441256cf7b" returned: 0 in 0.672s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:07 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-1681eb60-c26a-43e7-84ef-97becdf2a69e tempest-SnapshotsActionsTest-1562062894 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.c92eecbc-1f76-43b6-900c-05441256cf7b is being set with open permissions: ugo+rw
Jul 10 12:48:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1681eb60-c26a-43e7-84ef-97becdf2a69e tempest-SnapshotsActionsTest-1562062894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.c92eecbc-1f76-43b6-900c-05441256cf7b {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:07 devstack sudo[98724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.c92eecbc-1f76-43b6-900c-05441256cf7b
Jul 10 12:48:07 devstack sudo[98724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:08 devstack sudo[98724]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1681eb60-c26a-43e7-84ef-97becdf2a69e tempest-SnapshotsActionsTest-1562062894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.c92eecbc-1f76-43b6-900c-05441256cf7b" returned: 0 in 0.650s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1681eb60-c26a-43e7-84ef-97becdf2a69e tempest-SnapshotsActionsTest-1562062894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.103s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:48:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.634s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:48:08 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:48:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3db6faeb-f77f-4924-9a41-33eb45cc4993,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='454a56d2798f4d8f829c2f472e74b1e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:48:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:48:02Z,use_quota=True,user_id='f2932a6c1da6497c929f8c3344f94c95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:48:08 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Creating volume 3db6faeb-f77f-4924-9a41-33eb45cc4993 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:48:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:48:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:48:08 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:48:08 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:48:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:48:08 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:48:08 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:48:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3db6faeb-f77f-4924-9a41-33eb45cc4993 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:08 devstack sudo[98727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3db6faeb-f77f-4924-9a41-33eb45cc4993 1073741824
Jul 10 12:48:08 devstack sudo[98727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:08 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-1681eb60-c26a-43e7-84ef-97becdf2a69e tempest-SnapshotsActionsTest-1562062894 None] Create snapshot completed successfully
Jul 10 12:48:08 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9a23f36b-7863-4cf9-8a5d-c542013991ba tempest-SnapshotsActionsTest-789273322 None] Acquiring lock "cinder-c92eecbc-1f76-43b6-900c-05441256cf7b-delete_snapshot" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:48:08 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9a23f36b-7863-4cf9-8a5d-c542013991ba tempest-SnapshotsActionsTest-789273322 None] Lock "cinder-c92eecbc-1f76-43b6-900c-05441256cf7b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:48:08 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9a23f36b-7863-4cf9-8a5d-c542013991ba tempest-SnapshotsActionsTest-789273322 None] Acquiring lock "cinder-quobyte-3e645700-a883-4de8-83a0-309080c6985e" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:48:08 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9a23f36b-7863-4cf9-8a5d-c542013991ba tempest-SnapshotsActionsTest-789273322 None] Lock "cinder-quobyte-3e645700-a883-4de8-83a0-309080c6985e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:48:08 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9a23f36b-7863-4cf9-8a5d-c542013991ba tempest-SnapshotsActionsTest-789273322 None] Acquiring lock "cinder-quobyte-c92eecbc-1f76-43b6-900c-05441256cf7b" by "_delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:48:08 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9a23f36b-7863-4cf9-8a5d-c542013991ba tempest-SnapshotsActionsTest-789273322 None] Lock "cinder-quobyte-c92eecbc-1f76-43b6-900c-05441256cf7b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:48:08 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-9a23f36b-7863-4cf9-8a5d-c542013991ba tempest-SnapshotsActionsTest-789273322 None] Deleting offline snapshot c92eecbc-1f76-43b6-900c-05441256cf7b of volume 3e645700-a883-4de8-83a0-309080c6985e {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 10 12:48:08 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-9a23f36b-7863-4cf9-8a5d-c542013991ba tempest-SnapshotsActionsTest-789273322 None] snapshot_file for this snap is: volume-3e645700-a883-4de8-83a0-309080c6985e.c92eecbc-1f76-43b6-900c-05441256cf7b {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 10 12:48:08 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a04549-9eb7-4d9f-824f-8c869eec5266]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:48:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9a23f36b-7863-4cf9-8a5d-c542013991ba tempest-SnapshotsActionsTest-789273322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.c92eecbc-1f76-43b6-900c-05441256cf7b {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:09 devstack sudo[98735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.c92eecbc-1f76-43b6-900c-05441256cf7b
Jul 10 12:48:09 devstack sudo[98735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:09 devstack sudo[98727]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3db6faeb-f77f-4924-9a41-33eb45cc4993 1073741824" returned: 0 in 0.901s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3db6faeb-f77f-4924-9a41-33eb45cc4993 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:09 devstack sudo[98738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3db6faeb-f77f-4924-9a41-33eb45cc4993
Jul 10 12:48:09 devstack sudo[98738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:09 devstack sudo[98735]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9a23f36b-7863-4cf9-8a5d-c542013991ba tempest-SnapshotsActionsTest-789273322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.c92eecbc-1f76-43b6-900c-05441256cf7b" returned: 0 in 0.919s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:09 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-9a23f36b-7863-4cf9-8a5d-c542013991ba tempest-SnapshotsActionsTest-789273322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e645700-a883-4de8-83a0-309080c6985e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:48:09 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3ae9bb-d243-4add-87f1-1985e4064259]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:48:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9a23f36b-7863-4cf9-8a5d-c542013991ba tempest-SnapshotsActionsTest-789273322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:09 devstack sudo[98738]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3db6faeb-f77f-4924-9a41-33eb45cc4993" returned: 0 in 0.794s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:09 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] <== create_volume: return (1737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:48:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.740s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:48:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-69b04d62-8a0c-4faf-9556-61fd97ce17b2 tempest-GroupSnapshotsTest-1497579122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.793s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:48:09 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-69b04d62-8a0c-4faf-9556-61fd97ce17b2 tempest-GroupSnapshotsTest-1497579122 None] Acquiring lock "cinder-quobyte-a5191d95-2283-4928-9aac-5038c4643c5a-82340f2e-d594-49ae-b258-c46c1ced0494" by "_create_volume_from_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:48:09 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-69b04d62-8a0c-4faf-9556-61fd97ce17b2 tempest-GroupSnapshotsTest-1497579122 None] Lock "cinder-quobyte-a5191d95-2283-4928-9aac-5038c4643c5a-82340f2e-d594-49ae-b258-c46c1ced0494" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:48:09 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-69b04d62-8a0c-4faf-9556-61fd97ce17b2 tempest-GroupSnapshotsTest-1497579122 None] Creating volume 82340f2e-d594-49ae-b258-c46c1ced0494 from snapshot a5191d95-2283-4928-9aac-5038c4643c5a {{(pid=87378) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 10 12:48:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-69b04d62-8a0c-4faf-9556-61fd97ce17b2 tempest-GroupSnapshotsTest-1497579122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:48:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-69b04d62-8a0c-4faf-9556-61fd97ce17b2 tempest-GroupSnapshotsTest-1497579122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:48:09 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-69b04d62-8a0c-4faf-9556-61fd97ce17b2 tempest-GroupSnapshotsTest-1497579122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:48:09 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-69b04d62-8a0c-4faf-9556-61fd97ce17b2 tempest-GroupSnapshotsTest-1497579122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:48:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-69b04d62-8a0c-4faf-9556-61fd97ce17b2 tempest-GroupSnapshotsTest-1497579122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:48:09 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-69b04d62-8a0c-4faf-9556-61fd97ce17b2 tempest-GroupSnapshotsTest-1497579122 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:48:09 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-69b04d62-8a0c-4faf-9556-61fd97ce17b2 tempest-GroupSnapshotsTest-1497579122 None] Acquiring lock "cinder-quobyte-82340f2e-d594-49ae-b258-c46c1ced0494" by "_copy_volume_from_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:48:09 devstack cinder-volume[87378]: DEBUG cinder.volume.volume_utils [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Attempting download of a05b04d1-793d-499f-9a68-3a5115e5f96d ((None, [{'url': 'file:///opt/stack/data/glance/images/a05b04d1-793d-499f-9a68-3a5115e5f96d', 'metadata': {}}])) to volume 3db6faeb-f77f-4924-9a41-33eb45cc4993. {{(pid=87378) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 10 12:48:10 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-69b04d62-8a0c-4faf-9556-61fd97ce17b2 tempest-GroupSnapshotsTest-1497579122 None] Lock "cinder-quobyte-82340f2e-d594-49ae-b258-c46c1ced0494" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:48:10 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-69b04d62-8a0c-4faf-9556-61fd97ce17b2 tempest-GroupSnapshotsTest-1497579122 None] snapshot: a5191d95-2283-4928-9aac-5038c4643c5a, volume: 82340f2e-d594-49ae-b258-c46c1ced0494,  {{(pid=87378) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 10 12:48:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-69b04d62-8a0c-4faf-9556-61fd97ce17b2 tempest-GroupSnapshotsTest-1497579122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:48:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-69b04d62-8a0c-4faf-9556-61fd97ce17b2 tempest-GroupSnapshotsTest-1497579122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:48:10 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-69b04d62-8a0c-4faf-9556-61fd97ce17b2 tempest-GroupSnapshotsTest-1497579122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:48:10 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-69b04d62-8a0c-4faf-9556-61fd97ce17b2 tempest-GroupSnapshotsTest-1497579122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:48:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-69b04d62-8a0c-4faf-9556-61fd97ce17b2 tempest-GroupSnapshotsTest-1497579122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:48:10 devstack sudo[98752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23
Jul 10 12:48:10 devstack sudo[98752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:10 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0f17a1-62da-4e75-affb-2133fa6f40d9]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:48:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-69b04d62-8a0c-4faf-9556-61fd97ce17b2 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de.a5191d95-2283-4928-9aac-5038c4643c5a {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:10 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[2746ed2b-d744-4257-aed8-6bfa5a41dee0]: (4, 'raw') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:48:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a05b04d1-793d-499f-9a68-3a5115e5f96d_ejds5t3c {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:10 devstack sudo[98754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de.a5191d95-2283-4928-9aac-5038c4643c5a
Jul 10 12:48:10 devstack sudo[98754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:10 devstack sudo[98755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a05b04d1-793d-499f-9a68-3a5115e5f96d_ejds5t3c
Jul 10 12:48:10 devstack sudo[98755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:10 devstack sudo[98752]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:10 devstack sudo[98755]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9a23f36b-7863-4cf9-8a5d-c542013991ba tempest-SnapshotsActionsTest-789273322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23" returned: 0 in 0.994s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a05b04d1-793d-499f-9a68-3a5115e5f96d_ejds5t3c" returned: 0 in 0.817s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:10 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-9a23f36b-7863-4cf9-8a5d-c542013991ba tempest-SnapshotsActionsTest-789273322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e645700-a883-4de8-83a0-309080c6985e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:48:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9a23f36b-7863-4cf9-8a5d-c542013991ba tempest-SnapshotsActionsTest-789273322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.c92eecbc-1f76-43b6-900c-05441256cf7b {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a05b04d1-793d-499f-9a68-3a5115e5f96d_ejds5t3c {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:10 devstack sudo[98766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.c92eecbc-1f76-43b6-900c-05441256cf7b
Jul 10 12:48:10 devstack sudo[98766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:10 devstack sudo[98754]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-69b04d62-8a0c-4faf-9556-61fd97ce17b2 tempest-GroupSnapshotsTest-1497579122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de.a5191d95-2283-4928-9aac-5038c4643c5a" returned: 0 in 0.886s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:10 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-69b04d62-8a0c-4faf-9556-61fd97ce17b2 tempest-GroupSnapshotsTest-1497579122 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-877497d9-ba11-4969-91e6-e95e0d9cd5de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:48:10 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-69b04d62-8a0c-4faf-9556-61fd97ce17b2 tempest-GroupSnapshotsTest-1497579122 None] will copy from snapshot at /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de {{(pid=87378) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 10 12:48:10 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-69b04d62-8a0c-4faf-9556-61fd97ce17b2 tempest-GroupSnapshotsTest-1497579122 None] Creating direct copy from snapshot {{(pid=87378) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 10 12:48:10 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa739fec-f744-429d-acf9-d873de6f286e]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:48:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-69b04d62-8a0c-4faf-9556-61fd97ce17b2 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:11 devstack sudo[98767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a05b04d1-793d-499f-9a68-3a5115e5f96d_ejds5t3c
Jul 10 12:48:11 devstack sudo[98767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:11 devstack sudo[98769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de
Jul 10 12:48:11 devstack sudo[98769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:11 devstack sudo[98766]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9a23f36b-7863-4cf9-8a5d-c542013991ba tempest-SnapshotsActionsTest-789273322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.c92eecbc-1f76-43b6-900c-05441256cf7b" returned: 0 in 0.920s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9a23f36b-7863-4cf9-8a5d-c542013991ba tempest-SnapshotsActionsTest-789273322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.c92eecbc-1f76-43b6-900c-05441256cf7b {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:11 devstack sudo[98767]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a05b04d1-793d-499f-9a68-3a5115e5f96d_ejds5t3c" returned: 1 in 0.931s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a05b04d1-793d-499f-9a68-3a5115e5f96d_ejds5t3c' failed. Not Retrying. {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 10 12:48:11 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93945f9-12c7-46c0-ab7d-6e16eae04c4c]: (4, 'raw') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:48:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a05b04d1-793d-499f-9a68-3a5115e5f96d_j8kazk6udevstack@QuobyteHD {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:11 devstack sudo[98787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.c92eecbc-1f76-43b6-900c-05441256cf7b
Jul 10 12:48:11 devstack sudo[98787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:11 devstack sudo[98769]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-69b04d62-8a0c-4faf-9556-61fd97ce17b2 tempest-GroupSnapshotsTest-1497579122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de" returned: 0 in 0.946s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:11 devstack cinder-volume[87378]: DEBUG cinder.utils [None req-69b04d62-8a0c-4faf-9556-61fd97ce17b2 tempest-GroupSnapshotsTest-1497579122 None] Path /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-82340f2e-d594-49ae-b258-c46c1ced0494 not found in is_blk_device check {{(pid=87378) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 10 12:48:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-69b04d62-8a0c-4faf-9556-61fd97ce17b2 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-82340f2e-d594-49ae-b258-c46c1ced0494 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:11 devstack sudo[98793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-82340f2e-d594-49ae-b258-c46c1ced0494
Jul 10 12:48:11 devstack sudo[98793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:11 devstack sudo[98788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a05b04d1-793d-499f-9a68-3a5115e5f96d_j8kazk6udevstack@QuobyteHD
Jul 10 12:48:11 devstack sudo[98788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:12 devstack sudo[98788]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a05b04d1-793d-499f-9a68-3a5115e5f96d_j8kazk6udevstack@QuobyteHD" returned: 0 in 0.806s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a05b04d1-793d-499f-9a68-3a5115e5f96d_j8kazk6udevstack@QuobyteHD {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:12 devstack sudo[98787]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9a23f36b-7863-4cf9-8a5d-c542013991ba tempest-SnapshotsActionsTest-789273322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.c92eecbc-1f76-43b6-900c-05441256cf7b" returned: 0 in 0.877s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:12 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9a23f36b-7863-4cf9-8a5d-c542013991ba tempest-SnapshotsActionsTest-789273322 None] Lock "cinder-quobyte-c92eecbc-1f76-43b6-900c-05441256cf7b" released by "_delete_snapshot" :: held 3.831s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:48:12 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9a23f36b-7863-4cf9-8a5d-c542013991ba tempest-SnapshotsActionsTest-789273322 None] Lock "cinder-quobyte-3e645700-a883-4de8-83a0-309080c6985e" released by "delete_snapshot" :: held 3.862s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:48:12 devstack sudo[98814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a05b04d1-793d-499f-9a68-3a5115e5f96d_j8kazk6udevstack@QuobyteHD
Jul 10 12:48:12 devstack sudo[98814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:12 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-9a23f36b-7863-4cf9-8a5d-c542013991ba tempest-SnapshotsActionsTest-789273322 None] Created reservations ['0ef7b26d-7c5c-465e-ad4f-a9088cdcc5be', '6d42cf9e-fdee-4e9f-b74b-2fffc6328cff', '86175fa1-62cb-4f97-9860-c23632c559d4', '32fef883-8cf0-43ff-9e30-8cc7d908d2d9'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:48:12 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-9a23f36b-7863-4cf9-8a5d-c542013991ba tempest-SnapshotsActionsTest-789273322 None] Delete snapshot completed successfully.
Jul 10 12:48:12 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9a23f36b-7863-4cf9-8a5d-c542013991ba tempest-SnapshotsActionsTest-789273322 None] Lock "cinder-c92eecbc-1f76-43b6-900c-05441256cf7b-delete_snapshot" released by "delete_snapshot" :: held 4.031s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:48:12 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:48:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:48:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:48:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:48:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:48:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:48:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:13 devstack sudo[98825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:48:13 devstack sudo[98825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-9a1f8f7c-7de1-4047-a46f-e503b862cb19 tempest-SnapshotsActionsTest-1562062894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:48:14 devstack sudo[98814]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a05b04d1-793d-499f-9a68-3a5115e5f96d_j8kazk6udevstack@QuobyteHD" returned: 1 in 1.783s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a05b04d1-793d-499f-9a68-3a5115e5f96d_j8kazk6udevstack@QuobyteHD' failed. Not Retrying. {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 10 12:48:14 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] a05b04d1-793d-499f-9a68-3a5115e5f96d was raw, converting to raw {{(pid=87378) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 10 12:48:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a05b04d1-793d-499f-9a68-3a5115e5f96d_j8kazk6udevstack@QuobyteHD /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3db6faeb-f77f-4924-9a41-33eb45cc4993 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:14 devstack sudo[98832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a05b04d1-793d-499f-9a68-3a5115e5f96d_j8kazk6udevstack@QuobyteHD /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3db6faeb-f77f-4924-9a41-33eb45cc4993
Jul 10 12:48:14 devstack sudo[98832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:14 devstack sudo[98825]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 1.655s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:14 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:48:14 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager._thread_info {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:48:14 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread count: 28 {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 10 12:48:14 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread info: [<_MainThread(MainThread, started 128233544536192)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128233445424704)>, <Thread(Thread-3 (stat_writer), started daemon 128233435118528)>, <Thread(Rabbit-heartbeat, started daemon 128233435718016)>, <Thread(Thread-5 (_runner), started daemon 128233432624448)>, <Thread(Thread-7 (_runner), started daemon 128233432674688)>, <Thread(fd_logger, started daemon 128233428569472)>, <Thread(privsep_reader, started daemon 128233429417088)>, <Thread(tpool_thread_0, started daemon 128233421182656)>, <Thread(tpool_thread_1, started daemon 128233412789952)>, <Thread(tpool_thread_2, started daemon 128233404397248)>, <Thread(tpool_thread_3, started daemon 128233396004544)>, <Thread(tpool_thread_4, started daemon 128233387611840)>, <Thread(tpool_thread_5, started daemon 128233379219136)>, <Thread(tpool_thread_6, started daemon 128233370826432)>, <Thread(tpool_thread_7, started daemon 128233362433728)>, <Thread(tpool_thread_8, started daemon 128233354041024)>, <Thread(tpool_thread_9, started daemon 128233345631936)>, <Thread(tpool_thread_10, started daemon 128233337222848)>, <Thread(tpool_thread_11, started daemon 128233328813760)>, <Thread(tpool_thread_12, started daemon 128233320404672)>, <Thread(tpool_thread_13, started daemon 128233311995584)>, <Thread(tpool_thread_14, started daemon 128233303586496)>, <Thread(tpool_thread_15, started daemon 128233295177408)>, <Thread(tpool_thread_16, started daemon 128233286768320)>, <Thread(tpool_thread_17, started daemon 128233278359232)>, <Thread(tpool_thread_18, started daemon 128233269950144)>, <Thread(tpool_thread_19, started daemon 128233261541056)>] {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 10 12:48:15 devstack cinder-volume[87378]: INFO cinder.volume.manager [req-46afc727-393c-4196-a9cf-65d0cd86b1f5 req-d79751ff-84b2-44b3-a45e-ae102af1a770 tempest-TestInstancesWithCinderVolumes-1856690417 None] Terminate volume connection completed successfully.
Jul 10 12:48:15 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-46afc727-393c-4196-a9cf-65d0cd86b1f5 req-d79751ff-84b2-44b3-a45e-ae102af1a770 tempest-TestInstancesWithCinderVolumes-1856690417 None] Deleting attachment 20f957c8-6007-4285-88ef-673e8d54a061. {{(pid=87378) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 10 12:48:16 devstack sudo[98832]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a05b04d1-793d-499f-9a68-3a5115e5f96d_j8kazk6udevstack@QuobyteHD /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3db6faeb-f77f-4924-9a41-33eb45cc4993" returned: 0 in 1.552s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:16 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a05b04d1-793d-499f-9a68-3a5115e5f96d_j8kazk6udevstack@QuobyteHD, size 0.00 MB, duration 1.55 sec, destination /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3db6faeb-f77f-4924-9a41-33eb45cc4993 {{(pid=87378) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 10 12:48:16 devstack cinder-volume[87378]: INFO cinder.image.image_utils [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Converted 0.00 MB image at 0.00 MB/s
Jul 10 12:48:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3db6faeb-f77f-4924-9a41-33eb45cc4993 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:16 devstack sudo[98840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3db6faeb-f77f-4924-9a41-33eb45cc4993 1G
Jul 10 12:48:16 devstack sudo[98840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:17 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-937ac2fe-5894-4cff-848a-e61455ad0322 tempest-TestInstancesWithCinderVolumes-1856690417 None] Acquiring lock "cinder-8c741089-5750-4ff2-8fc1-c35c4c3f864c-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:48:17 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-937ac2fe-5894-4cff-848a-e61455ad0322 tempest-TestInstancesWithCinderVolumes-1856690417 None] Lock "cinder-8c741089-5750-4ff2-8fc1-c35c4c3f864c-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:48:17 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-937ac2fe-5894-4cff-848a-e61455ad0322 tempest-TestInstancesWithCinderVolumes-1856690417 None] Acquiring lock "cinder-quobyte-8c741089-5750-4ff2-8fc1-c35c4c3f864c" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:48:17 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-937ac2fe-5894-4cff-848a-e61455ad0322 tempest-TestInstancesWithCinderVolumes-1856690417 None] Lock "cinder-quobyte-8c741089-5750-4ff2-8fc1-c35c4c3f864c" acquired by "delete_volume" :: waited 0.048s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:48:17 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05d59bd-6d93-4d6e-9cb0-16d62f288cba]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:48:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-937ac2fe-5894-4cff-848a-e61455ad0322 tempest-TestInstancesWithCinderVolumes-1856690417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8c741089-5750-4ff2-8fc1-c35c4c3f864c {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:17 devstack sudo[98846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8c741089-5750-4ff2-8fc1-c35c4c3f864c
Jul 10 12:48:17 devstack sudo[98846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:18 devstack sudo[98840]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3db6faeb-f77f-4924-9a41-33eb45cc4993 1G" returned: 0 in 2.067s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:18 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[86bcb2c0-08cb-429f-a865-8fd92cd51696]: (4, 'raw') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:48:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3db6faeb-f77f-4924-9a41-33eb45cc4993 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:18 devstack sudo[98851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3db6faeb-f77f-4924-9a41-33eb45cc4993
Jul 10 12:48:18 devstack sudo[98851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:18 devstack sudo[98793]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-69b04d62-8a0c-4faf-9556-61fd97ce17b2 tempest-GroupSnapshotsTest-1497579122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-82340f2e-d594-49ae-b258-c46c1ced0494" returned: 0 in 6.377s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:18 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[df161a29-0317-4b7d-8fd0-00834a2f5cfc]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:48:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-69b04d62-8a0c-4faf-9556-61fd97ce17b2 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:18 devstack sudo[98853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de
Jul 10 12:48:18 devstack sudo[98853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:18 devstack sudo[98846]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-937ac2fe-5894-4cff-848a-e61455ad0322 tempest-TestInstancesWithCinderVolumes-1856690417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8c741089-5750-4ff2-8fc1-c35c4c3f864c" returned: 0 in 1.353s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-937ac2fe-5894-4cff-848a-e61455ad0322 tempest-TestInstancesWithCinderVolumes-1856690417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8c741089-5750-4ff2-8fc1-c35c4c3f864c {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:18 devstack sudo[98858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8c741089-5750-4ff2-8fc1-c35c4c3f864c
Jul 10 12:48:18 devstack sudo[98858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:19 devstack sudo[98851]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3db6faeb-f77f-4924-9a41-33eb45cc4993" returned: 0 in 0.902s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3db6faeb-f77f-4924-9a41-33eb45cc4993 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:19 devstack sudo[98863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3db6faeb-f77f-4924-9a41-33eb45cc4993
Jul 10 12:48:19 devstack sudo[98863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:19 devstack sudo[98853]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-69b04d62-8a0c-4faf-9556-61fd97ce17b2 tempest-GroupSnapshotsTest-1497579122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de" returned: 0 in 1.220s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:19 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-69b04d62-8a0c-4faf-9556-61fd97ce17b2 tempest-GroupSnapshotsTest-1497579122 None] Image conversion details: src /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de, size 1024.00 MB, duration 6.38 sec, destination /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-82340f2e-d594-49ae-b258-c46c1ced0494 {{(pid=87378) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 10 12:48:19 devstack cinder-volume[87378]: INFO cinder.image.image_utils [None req-69b04d62-8a0c-4faf-9556-61fd97ce17b2 tempest-GroupSnapshotsTest-1497579122 None] Converted 1024.00 MB image at 160.53 MB/s
Jul 10 12:48:19 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-69b04d62-8a0c-4faf-9556-61fd97ce17b2 tempest-GroupSnapshotsTest-1497579122 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-82340f2e-d594-49ae-b258-c46c1ced0494 is being set with open permissions: ugo+rw: NotImplementedError
Jul 10 12:48:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-69b04d62-8a0c-4faf-9556-61fd97ce17b2 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-82340f2e-d594-49ae-b258-c46c1ced0494 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:19 devstack sudo[98872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-82340f2e-d594-49ae-b258-c46c1ced0494
Jul 10 12:48:19 devstack sudo[98858]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:19 devstack sudo[98872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-937ac2fe-5894-4cff-848a-e61455ad0322 tempest-TestInstancesWithCinderVolumes-1856690417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8c741089-5750-4ff2-8fc1-c35c4c3f864c" returned: 0 in 0.759s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:19 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-937ac2fe-5894-4cff-848a-e61455ad0322 tempest-TestInstancesWithCinderVolumes-1856690417 None] Lock "cinder-quobyte-8c741089-5750-4ff2-8fc1-c35c4c3f864c" released by "delete_volume" :: held 2.244s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:48:19 devstack cinder-volume[87378]: WARNING cinder.quota [None req-937ac2fe-5894-4cff-848a-e61455ad0322 tempest-TestInstancesWithCinderVolumes-1856690417 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-580206497-1520250085 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-580206497-1520250085, it is now deprecated. Please use the default quota class for default quota.
Jul 10 12:48:19 devstack cinder-volume[87378]: WARNING cinder.quota [None req-937ac2fe-5894-4cff-848a-e61455ad0322 tempest-TestInstancesWithCinderVolumes-1856690417 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-580206497-1520250085 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-580206497-1520250085, it is now deprecated. Please use the default quota class for default quota.
Jul 10 12:48:19 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-937ac2fe-5894-4cff-848a-e61455ad0322 tempest-TestInstancesWithCinderVolumes-1856690417 None] Created reservations ['b6935348-fee2-4d22-b91e-e6991fd448dc', 'a45a8094-af63-4ee5-bb09-af15719b818f', '9998b28e-7823-476c-b6ea-2befa92f90d4', 'b8e96461-e2f3-40c4-908e-d07bfd37e995'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:48:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-937ac2fe-5894-4cff-848a-e61455ad0322 tempest-TestInstancesWithCinderVolumes-1856690417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:48:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-937ac2fe-5894-4cff-848a-e61455ad0322 tempest-TestInstancesWithCinderVolumes-1856690417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:48:19 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-937ac2fe-5894-4cff-848a-e61455ad0322 tempest-TestInstancesWithCinderVolumes-1856690417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:48:19 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-937ac2fe-5894-4cff-848a-e61455ad0322 tempest-TestInstancesWithCinderVolumes-1856690417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:48:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-937ac2fe-5894-4cff-848a-e61455ad0322 tempest-TestInstancesWithCinderVolumes-1856690417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:48:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-937ac2fe-5894-4cff-848a-e61455ad0322 tempest-TestInstancesWithCinderVolumes-1856690417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:19 devstack sudo[98880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:48:19 devstack sudo[98880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:19 devstack sudo[98863]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3db6faeb-f77f-4924-9a41-33eb45cc4993" returned: 1 in 0.928s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3db6faeb-f77f-4924-9a41-33eb45cc4993' failed. Not Retrying. {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 10 12:48:20 devstack cinder-volume[87378]: DEBUG cinder.volume.volume_utils [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Downloaded image a05b04d1-793d-499f-9a68-3a5115e5f96d ((None, [{'url': 'file:///opt/stack/data/glance/images/a05b04d1-793d-499f-9a68-3a5115e5f96d', 'metadata': {}}])) to volume 3db6faeb-f77f-4924-9a41-33eb45cc4993 successfully. {{(pid=87378) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 10 12:48:20 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Temporary image a05b04d1-793d-499f-9a68-3a5115e5f96d for user f2932a6c1da6497c929f8c3344f94c95 is deleted. {{(pid=87378) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 10 12:48:20 devstack cinder-volume[87378]: DEBUG cinder.volume.volume_utils [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Marking volume 3db6faeb-f77f-4924-9a41-33eb45cc4993 as bootable. {{(pid=87378) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 10 12:48:20 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Copying metadata from image a05b04d1-793d-499f-9a68-3a5115e5f96d to 3db6faeb-f77f-4924-9a41-33eb45cc4993. {{(pid=87378) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 10 12:48:20 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Creating volume glance metadata for volume 3db6faeb-f77f-4924-9a41-33eb45cc4993 backed by image a05b04d1-793d-499f-9a68-3a5115e5f96d with: {'image_id': 'a05b04d1-793d-499f-9a68-3a5115e5f96d', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '71cc4e086bb609886fbb2f9813466055', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87378) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 10 12:48:20 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (017280cf-f07f-454c-9f0b-cf93d5281f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3db6faeb-f77f-4924-9a41-33eb45cc4993', 'volume_size': 1, 'image_id': 'a05b04d1-793d-499f-9a68-3a5115e5f96d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a05b04d1-793d-499f-9a68-3a5115e5f96d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '71cc4e086bb609886fbb2f9813466055', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '454a56d2798f4d8f829c2f472e74b1e8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ea0f10d2f585e09b73b388151f3ba4c3461b262bbb51d07e15135dc3fd9a0ed43cd9471341256dac98dad51f31076985c5f064aa9ec53bd006c825380d701747', 'id': 'a05b04d1-793d-499f-9a68-3a5115e5f96d', 'created_at': datetime.datetime(2026, 7, 10, 10, 47, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 10, 48, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a05b04d1-793d-499f-9a68-3a5115e5f96d/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74a0a162daf0>}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:48:20 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab4dcfa4-2f8d-4db3-bc45-a4fa12602d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:20 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Volume volume-3db6faeb-f77f-4924-9a41-33eb45cc4993 (3db6faeb-f77f-4924-9a41-33eb45cc4993): created successfully
Jul 10 12:48:20 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab4dcfa4-2f8d-4db3-bc45-a4fa12602d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:48:20 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Flow 'volume_create_manager' (96eb1554-1f17-4302-93b7-f7c7a6af19e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:48:20 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-9d69498d-b26c-4916-a5b4-fb4ff80545a4 tempest-VolumeImageDependencyTests-1505690432 None] Created volume successfully.
Jul 10 12:48:20 devstack sudo[98872]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-69b04d62-8a0c-4faf-9556-61fd97ce17b2 tempest-GroupSnapshotsTest-1497579122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-82340f2e-d594-49ae-b258-c46c1ced0494" returned: 0 in 0.789s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:20 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-69b04d62-8a0c-4faf-9556-61fd97ce17b2 tempest-GroupSnapshotsTest-1497579122 None] Lock "cinder-quobyte-82340f2e-d594-49ae-b258-c46c1ced0494" released by "_copy_volume_from_snapshot" :: held 10.349s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:48:20 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-69b04d62-8a0c-4faf-9556-61fd97ce17b2 tempest-GroupSnapshotsTest-1497579122 None] Lock "cinder-quobyte-a5191d95-2283-4928-9aac-5038c4643c5a-82340f2e-d594-49ae-b258-c46c1ced0494" released by "_create_volume_from_snapshot" :: held 10.395s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:48:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-69b04d62-8a0c-4faf-9556-61fd97ce17b2 tempest-GroupSnapshotsTest-1497579122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.427s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:48:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-9a1f8f7c-7de1-4047-a46f-e503b862cb19 tempest-SnapshotsActionsTest-1562062894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.064s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:48:20 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-9a1f8f7c-7de1-4047-a46f-e503b862cb19 tempest-SnapshotsActionsTest-1562062894 None] Creating offline snapshot d9563657-c045-4d96-8f77-95b291237816 of volume 3e645700-a883-4de8-83a0-309080c6985e {{(pid=87378) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 10 12:48:20 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0a4b0a-ecb0-4cff-a670-167027fb9794]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:48:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9a1f8f7c-7de1-4047-a46f-e503b862cb19 tempest-SnapshotsActionsTest-1562062894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:20 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-69b04d62-8a0c-4faf-9556-61fd97ce17b2 tempest-GroupSnapshotsTest-1497579122 None] Create group from source-snapshot-eb447fc7-9964-4ac8-a73e-28837ab817e8 completed successfully.
Jul 10 12:48:20 devstack sudo[98896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23
Jul 10 12:48:20 devstack sudo[98896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:20 devstack sudo[98880]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-937ac2fe-5894-4cff-848a-e61455ad0322 tempest-TestInstancesWithCinderVolumes-1856690417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.762s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:20 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-937ac2fe-5894-4cff-848a-e61455ad0322 tempest-TestInstancesWithCinderVolumes-1856690417 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:48:20 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-937ac2fe-5894-4cff-848a-e61455ad0322 tempest-TestInstancesWithCinderVolumes-1856690417 None] Deleted volume successfully.
Jul 10 12:48:20 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-937ac2fe-5894-4cff-848a-e61455ad0322 tempest-TestInstancesWithCinderVolumes-1856690417 None] Lock "cinder-8c741089-5750-4ff2-8fc1-c35c4c3f864c-delete_volume" released by "delete_volume" :: held 3.410s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:48:20 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-cf7ff5fa-d202-49ce-9e6e-970eab482791 tempest-VolumeImageDependencyTests-1505690432 None] Acquiring lock "cinder-3db6faeb-f77f-4924-9a41-33eb45cc4993-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:48:20 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-cf7ff5fa-d202-49ce-9e6e-970eab482791 tempest-VolumeImageDependencyTests-1505690432 None] Lock "cinder-3db6faeb-f77f-4924-9a41-33eb45cc4993-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:48:20 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-cf7ff5fa-d202-49ce-9e6e-970eab482791 tempest-VolumeImageDependencyTests-1505690432 None] Acquiring lock "cinder-quobyte-3db6faeb-f77f-4924-9a41-33eb45cc4993" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:48:21 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-cf7ff5fa-d202-49ce-9e6e-970eab482791 tempest-VolumeImageDependencyTests-1505690432 None] Lock "cinder-quobyte-3db6faeb-f77f-4924-9a41-33eb45cc4993" acquired by "delete_volume" :: waited 0.014s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:48:21 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7a06b3-fa2f-4594-aed6-0ccebf329982]: (4, 'raw') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:48:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cf7ff5fa-d202-49ce-9e6e-970eab482791 tempest-VolumeImageDependencyTests-1505690432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3db6faeb-f77f-4924-9a41-33eb45cc4993 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:21 devstack sudo[98911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3db6faeb-f77f-4924-9a41-33eb45cc4993
Jul 10 12:48:21 devstack sudo[98911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:21 devstack sudo[98896]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9a1f8f7c-7de1-4047-a46f-e503b862cb19 tempest-SnapshotsActionsTest-1562062894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23" returned: 0 in 0.855s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:21 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-9a1f8f7c-7de1-4047-a46f-e503b862cb19 tempest-SnapshotsActionsTest-1562062894 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e645700-a883-4de8-83a0-309080c6985e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:48:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9a1f8f7c-7de1-4047-a46f-e503b862cb19 tempest-SnapshotsActionsTest-1562062894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.d9563657-c045-4d96-8f77-95b291237816 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:21 devstack sudo[98941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.d9563657-c045-4d96-8f77-95b291237816 1G
Jul 10 12:48:21 devstack sudo[98941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:21 devstack sudo[98911]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cf7ff5fa-d202-49ce-9e6e-970eab482791 tempest-VolumeImageDependencyTests-1505690432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3db6faeb-f77f-4924-9a41-33eb45cc4993" returned: 0 in 0.795s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cf7ff5fa-d202-49ce-9e6e-970eab482791 tempest-VolumeImageDependencyTests-1505690432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3db6faeb-f77f-4924-9a41-33eb45cc4993 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:21 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-18eaee59-163b-4238-915e-0868795d8c6a tempest-GroupSnapshotsTest-1497579122 None] Acquiring lock "cinder-quobyte-82340f2e-d594-49ae-b258-c46c1ced0494" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:48:21 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-18eaee59-163b-4238-915e-0868795d8c6a tempest-GroupSnapshotsTest-1497579122 None] Lock "cinder-quobyte-82340f2e-d594-49ae-b258-c46c1ced0494" acquired by "delete_volume" :: waited 0.038s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:48:21 devstack sudo[98947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3db6faeb-f77f-4924-9a41-33eb45cc4993
Jul 10 12:48:21 devstack sudo[98947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:22 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f96252a-8c15-4295-a207-dc94f0324f7c]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:48:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-18eaee59-163b-4238-915e-0868795d8c6a tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-82340f2e-d594-49ae-b258-c46c1ced0494 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:22 devstack sudo[98952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-82340f2e-d594-49ae-b258-c46c1ced0494
Jul 10 12:48:22 devstack sudo[98952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:22 devstack cinder-volume[87378]: INFO cinder.volume.manager [req-6b014f98-4604-46ad-b92e-0cc8fc8bccae req-0abe37f7-4af1-48b5-ae38-1147a062b6a8 tempest-TestInstancesWithCinderVolumes-1856690417 None] Terminate volume connection completed successfully.
Jul 10 12:48:22 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-6b014f98-4604-46ad-b92e-0cc8fc8bccae req-0abe37f7-4af1-48b5-ae38-1147a062b6a8 tempest-TestInstancesWithCinderVolumes-1856690417 None] Deleting attachment bf4a5a57-9ee2-427c-92bf-c8388347d154. {{(pid=87378) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 10 12:48:22 devstack sudo[98941]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9a1f8f7c-7de1-4047-a46f-e503b862cb19 tempest-SnapshotsActionsTest-1562062894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.d9563657-c045-4d96-8f77-95b291237816 1G" returned: 0 in 0.991s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9a1f8f7c-7de1-4047-a46f-e503b862cb19 tempest-SnapshotsActionsTest-1562062894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.d9563657-c045-4d96-8f77-95b291237816 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:22 devstack sudo[98957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.d9563657-c045-4d96-8f77-95b291237816
Jul 10 12:48:22 devstack sudo[98957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:22 devstack sudo[98947]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cf7ff5fa-d202-49ce-9e6e-970eab482791 tempest-VolumeImageDependencyTests-1505690432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3db6faeb-f77f-4924-9a41-33eb45cc4993" returned: 1 in 0.910s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cf7ff5fa-d202-49ce-9e6e-970eab482791 tempest-VolumeImageDependencyTests-1505690432 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3db6faeb-f77f-4924-9a41-33eb45cc4993' failed. Not Retrying. {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 10 12:48:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cf7ff5fa-d202-49ce-9e6e-970eab482791 tempest-VolumeImageDependencyTests-1505690432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3db6faeb-f77f-4924-9a41-33eb45cc4993 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:22 devstack sudo[98965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3db6faeb-f77f-4924-9a41-33eb45cc4993
Jul 10 12:48:22 devstack sudo[98965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:22 devstack sudo[98952]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-18eaee59-163b-4238-915e-0868795d8c6a tempest-GroupSnapshotsTest-1497579122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-82340f2e-d594-49ae-b258-c46c1ced0494" returned: 0 in 0.882s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-18eaee59-163b-4238-915e-0868795d8c6a tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-82340f2e-d594-49ae-b258-c46c1ced0494 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:22 devstack sudo[98972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-82340f2e-d594-49ae-b258-c46c1ced0494
Jul 10 12:48:22 devstack sudo[98972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:23 devstack sudo[98957]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9a1f8f7c-7de1-4047-a46f-e503b862cb19 tempest-SnapshotsActionsTest-1562062894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.d9563657-c045-4d96-8f77-95b291237816" returned: 0 in 0.740s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:23 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-9a1f8f7c-7de1-4047-a46f-e503b862cb19 tempest-SnapshotsActionsTest-1562062894 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.d9563657-c045-4d96-8f77-95b291237816 is being set with open permissions: ugo+rw
Jul 10 12:48:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9a1f8f7c-7de1-4047-a46f-e503b862cb19 tempest-SnapshotsActionsTest-1562062894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.d9563657-c045-4d96-8f77-95b291237816 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:23 devstack sudo[98974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.d9563657-c045-4d96-8f77-95b291237816
Jul 10 12:48:23 devstack sudo[98974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:23 devstack sudo[98965]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cf7ff5fa-d202-49ce-9e6e-970eab482791 tempest-VolumeImageDependencyTests-1505690432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3db6faeb-f77f-4924-9a41-33eb45cc4993" returned: 0 in 0.759s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:23 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-cf7ff5fa-d202-49ce-9e6e-970eab482791 tempest-VolumeImageDependencyTests-1505690432 None] Lock "cinder-quobyte-3db6faeb-f77f-4924-9a41-33eb45cc4993" released by "delete_volume" :: held 2.528s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:48:23 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-cf7ff5fa-d202-49ce-9e6e-970eab482791 tempest-VolumeImageDependencyTests-1505690432 None] Created reservations ['9390aab4-919d-4af3-9aa5-e2be13d0a48f', 'c33c7a2b-8bc7-4cce-a498-d7e949f31b32', '3ae8683a-04f8-4684-8e65-1f7803710ab4', '80737803-ad01-4ee3-9631-75986e05ce9d'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:48:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-cf7ff5fa-d202-49ce-9e6e-970eab482791 tempest-VolumeImageDependencyTests-1505690432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:48:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-cf7ff5fa-d202-49ce-9e6e-970eab482791 tempest-VolumeImageDependencyTests-1505690432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:48:23 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-cf7ff5fa-d202-49ce-9e6e-970eab482791 tempest-VolumeImageDependencyTests-1505690432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:48:23 devstack sudo[98972]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:23 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-cf7ff5fa-d202-49ce-9e6e-970eab482791 tempest-VolumeImageDependencyTests-1505690432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:48:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-cf7ff5fa-d202-49ce-9e6e-970eab482791 tempest-VolumeImageDependencyTests-1505690432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:48:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cf7ff5fa-d202-49ce-9e6e-970eab482791 tempest-VolumeImageDependencyTests-1505690432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-18eaee59-163b-4238-915e-0868795d8c6a tempest-GroupSnapshotsTest-1497579122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-82340f2e-d594-49ae-b258-c46c1ced0494" returned: 0 in 0.762s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:23 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-18eaee59-163b-4238-915e-0868795d8c6a tempest-GroupSnapshotsTest-1497579122 None] Lock "cinder-quobyte-82340f2e-d594-49ae-b258-c46c1ced0494" released by "delete_volume" :: held 1.706s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:48:23 devstack sudo[98979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:48:23 devstack sudo[98979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:23 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-18eaee59-163b-4238-915e-0868795d8c6a tempest-GroupSnapshotsTest-1497579122 None] Created reservations ['a7dd42a7-a908-4bf5-9c34-eac17e320a5b'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:48:23 devstack sudo[98974]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9a1f8f7c-7de1-4047-a46f-e503b862cb19 tempest-SnapshotsActionsTest-1562062894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.d9563657-c045-4d96-8f77-95b291237816" returned: 0 in 0.758s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:23 devstack cinder-volume[87378]: WARNING cinder.quota [None req-18eaee59-163b-4238-915e-0868795d8c6a tempest-GroupSnapshotsTest-1497579122 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-891458365 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-891458365, it is now deprecated. Please use the default quota class for default quota.
Jul 10 12:48:23 devstack cinder-volume[87378]: WARNING cinder.quota [None req-18eaee59-163b-4238-915e-0868795d8c6a tempest-GroupSnapshotsTest-1497579122 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-891458365 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-891458365, it is now deprecated. Please use the default quota class for default quota.
Jul 10 12:48:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-9a1f8f7c-7de1-4047-a46f-e503b862cb19 tempest-SnapshotsActionsTest-1562062894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.467s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:48:23 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-18eaee59-163b-4238-915e-0868795d8c6a tempest-GroupSnapshotsTest-1497579122 None] Created reservations ['dbe79878-8e1d-4434-aa49-c2d975941f26', '00734e99-a7a0-4f5a-ad42-6590f2ec16b8', '3cd40f01-98fd-45a8-b167-7cdd1583554a', 'e00f2254-1090-4726-9655-3312c09853f5'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:48:23 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-9a1f8f7c-7de1-4047-a46f-e503b862cb19 tempest-SnapshotsActionsTest-1562062894 None] Create snapshot completed successfully
Jul 10 12:48:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-18eaee59-163b-4238-915e-0868795d8c6a tempest-GroupSnapshotsTest-1497579122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:48:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-18eaee59-163b-4238-915e-0868795d8c6a tempest-GroupSnapshotsTest-1497579122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:48:23 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-18eaee59-163b-4238-915e-0868795d8c6a tempest-GroupSnapshotsTest-1497579122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:48:23 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-18eaee59-163b-4238-915e-0868795d8c6a tempest-GroupSnapshotsTest-1497579122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:48:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-18eaee59-163b-4238-915e-0868795d8c6a tempest-GroupSnapshotsTest-1497579122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:48:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-18eaee59-163b-4238-915e-0868795d8c6a tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:23 devstack sudo[98981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:48:23 devstack sudo[98981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:24 devstack sudo[98979]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cf7ff5fa-d202-49ce-9e6e-970eab482791 tempest-VolumeImageDependencyTests-1505690432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.719s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:24 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-cf7ff5fa-d202-49ce-9e6e-970eab482791 tempest-VolumeImageDependencyTests-1505690432 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:48:24 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-cf7ff5fa-d202-49ce-9e6e-970eab482791 tempest-VolumeImageDependencyTests-1505690432 None] Deleted volume successfully.
Jul 10 12:48:24 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-c57f6d90-d8be-4ba9-9859-68f0b6765b85 tempest-TestInstancesWithCinderVolumes-1856690417 None] Acquiring lock "cinder-6f208719-4a9a-4626-b1dd-f867d44e13e3-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:48:24 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-cf7ff5fa-d202-49ce-9e6e-970eab482791 tempest-VolumeImageDependencyTests-1505690432 None] Lock "cinder-3db6faeb-f77f-4924-9a41-33eb45cc4993-delete_volume" released by "delete_volume" :: held 3.504s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:48:24 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-c57f6d90-d8be-4ba9-9859-68f0b6765b85 tempest-TestInstancesWithCinderVolumes-1856690417 None] Lock "cinder-6f208719-4a9a-4626-b1dd-f867d44e13e3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:48:24 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-ccc40743-158d-4e41-a854-5d339768ac39 tempest-GroupSnapshotsTest-1497579122 None] group_snapshot eb447fc7-9964-4ac8-a73e-28837ab817e8: deleting
Jul 10 12:48:24 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ccc40743-158d-4e41-a854-5d339768ac39 tempest-GroupSnapshotsTest-1497579122 None] group_snapshot eb447fc7-9964-4ac8-a73e-28837ab817e8: deleting {{(pid=87378) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 10 12:48:24 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-c57f6d90-d8be-4ba9-9859-68f0b6765b85 tempest-TestInstancesWithCinderVolumes-1856690417 None] Acquiring lock "cinder-quobyte-6f208719-4a9a-4626-b1dd-f867d44e13e3" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:48:24 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-ccc40743-158d-4e41-a854-5d339768ac39 tempest-GroupSnapshotsTest-1497579122 None] Acquiring lock "cinder-quobyte-877497d9-ba11-4969-91e6-e95e0d9cd5de" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:48:24 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-c57f6d90-d8be-4ba9-9859-68f0b6765b85 tempest-TestInstancesWithCinderVolumes-1856690417 None] Lock "cinder-quobyte-6f208719-4a9a-4626-b1dd-f867d44e13e3" acquired by "delete_volume" :: waited 0.041s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:48:24 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-ccc40743-158d-4e41-a854-5d339768ac39 tempest-GroupSnapshotsTest-1497579122 None] Lock "cinder-quobyte-877497d9-ba11-4969-91e6-e95e0d9cd5de" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:48:24 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-ccc40743-158d-4e41-a854-5d339768ac39 tempest-GroupSnapshotsTest-1497579122 None] Acquiring lock "cinder-quobyte-a5191d95-2283-4928-9aac-5038c4643c5a" by "_delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:48:24 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c576deb1-b1c7-4698-ac08-f5a2e70f7a89]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:48:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c57f6d90-d8be-4ba9-9859-68f0b6765b85 tempest-TestInstancesWithCinderVolumes-1856690417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6f208719-4a9a-4626-b1dd-f867d44e13e3 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:24 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-ccc40743-158d-4e41-a854-5d339768ac39 tempest-GroupSnapshotsTest-1497579122 None] Lock "cinder-quobyte-a5191d95-2283-4928-9aac-5038c4643c5a" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:48:24 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-ccc40743-158d-4e41-a854-5d339768ac39 tempest-GroupSnapshotsTest-1497579122 None] Deleting offline snapshot a5191d95-2283-4928-9aac-5038c4643c5a of volume 877497d9-ba11-4969-91e6-e95e0d9cd5de {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 10 12:48:24 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-ccc40743-158d-4e41-a854-5d339768ac39 tempest-GroupSnapshotsTest-1497579122 None] snapshot_file for this snap is: volume-877497d9-ba11-4969-91e6-e95e0d9cd5de.a5191d95-2283-4928-9aac-5038c4643c5a {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 10 12:48:24 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8408d8c-5f8b-47bb-a29d-82409e06ca45]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:48:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ccc40743-158d-4e41-a854-5d339768ac39 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de.a5191d95-2283-4928-9aac-5038c4643c5a {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:24 devstack sudo[98985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6f208719-4a9a-4626-b1dd-f867d44e13e3
Jul 10 12:48:24 devstack sudo[98985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:24 devstack sudo[98981]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-18eaee59-163b-4238-915e-0868795d8c6a tempest-GroupSnapshotsTest-1497579122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.909s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:24 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-18eaee59-163b-4238-915e-0868795d8c6a tempest-GroupSnapshotsTest-1497579122 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:48:24 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-18eaee59-163b-4238-915e-0868795d8c6a tempest-GroupSnapshotsTest-1497579122 None] Delete group completed successfully.
Jul 10 12:48:24 devstack sudo[98986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de.a5191d95-2283-4928-9aac-5038c4643c5a
Jul 10 12:48:24 devstack sudo[98986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:25 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-64239904-ffa8-434d-99e5-71bfe5ef03d6 tempest-SnapshotsActionsTest-789273322 None] Acquiring lock "cinder-d9563657-c045-4d96-8f77-95b291237816-delete_snapshot" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:48:25 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-64239904-ffa8-434d-99e5-71bfe5ef03d6 tempest-SnapshotsActionsTest-789273322 None] Lock "cinder-d9563657-c045-4d96-8f77-95b291237816-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:48:25 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-64239904-ffa8-434d-99e5-71bfe5ef03d6 tempest-SnapshotsActionsTest-789273322 None] Acquiring lock "cinder-quobyte-3e645700-a883-4de8-83a0-309080c6985e" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:48:25 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-64239904-ffa8-434d-99e5-71bfe5ef03d6 tempest-SnapshotsActionsTest-789273322 None] Lock "cinder-quobyte-3e645700-a883-4de8-83a0-309080c6985e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:48:25 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-64239904-ffa8-434d-99e5-71bfe5ef03d6 tempest-SnapshotsActionsTest-789273322 None] Acquiring lock "cinder-quobyte-d9563657-c045-4d96-8f77-95b291237816" by "_delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:48:25 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-64239904-ffa8-434d-99e5-71bfe5ef03d6 tempest-SnapshotsActionsTest-789273322 None] Lock "cinder-quobyte-d9563657-c045-4d96-8f77-95b291237816" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:48:25 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-64239904-ffa8-434d-99e5-71bfe5ef03d6 tempest-SnapshotsActionsTest-789273322 None] Deleting offline snapshot d9563657-c045-4d96-8f77-95b291237816 of volume 3e645700-a883-4de8-83a0-309080c6985e {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 10 12:48:25 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-64239904-ffa8-434d-99e5-71bfe5ef03d6 tempest-SnapshotsActionsTest-789273322 None] snapshot_file for this snap is: volume-3e645700-a883-4de8-83a0-309080c6985e.d9563657-c045-4d96-8f77-95b291237816 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 10 12:48:25 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[2706ff90-2cbe-4779-8c6d-067f887022b9]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:48:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-64239904-ffa8-434d-99e5-71bfe5ef03d6 tempest-SnapshotsActionsTest-789273322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.d9563657-c045-4d96-8f77-95b291237816 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:25 devstack sudo[98989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.d9563657-c045-4d96-8f77-95b291237816
Jul 10 12:48:25 devstack sudo[98989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:25 devstack sudo[98986]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ccc40743-158d-4e41-a854-5d339768ac39 tempest-GroupSnapshotsTest-1497579122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de.a5191d95-2283-4928-9aac-5038c4643c5a" returned: 0 in 1.204s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:25 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-ccc40743-158d-4e41-a854-5d339768ac39 tempest-GroupSnapshotsTest-1497579122 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-877497d9-ba11-4969-91e6-e95e0d9cd5de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:48:26 devstack sudo[98985]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:26 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[9764c13b-263c-4aad-976c-0b216e15a8a2]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:48:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ccc40743-158d-4e41-a854-5d339768ac39 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c57f6d90-d8be-4ba9-9859-68f0b6765b85 tempest-TestInstancesWithCinderVolumes-1856690417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6f208719-4a9a-4626-b1dd-f867d44e13e3" returned: 0 in 1.373s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c57f6d90-d8be-4ba9-9859-68f0b6765b85 tempest-TestInstancesWithCinderVolumes-1856690417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6f208719-4a9a-4626-b1dd-f867d44e13e3 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:26 devstack sudo[98999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6f208719-4a9a-4626-b1dd-f867d44e13e3
Jul 10 12:48:26 devstack sudo[98999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:26 devstack sudo[98998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de
Jul 10 12:48:26 devstack sudo[98998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:26 devstack sudo[98989]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-64239904-ffa8-434d-99e5-71bfe5ef03d6 tempest-SnapshotsActionsTest-789273322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.d9563657-c045-4d96-8f77-95b291237816" returned: 0 in 1.505s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:26 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-64239904-ffa8-434d-99e5-71bfe5ef03d6 tempest-SnapshotsActionsTest-789273322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e645700-a883-4de8-83a0-309080c6985e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:48:26 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8070ca-2a10-472e-816b-8d816b612611]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:48:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-64239904-ffa8-434d-99e5-71bfe5ef03d6 tempest-SnapshotsActionsTest-789273322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:27 devstack sudo[99010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23
Jul 10 12:48:27 devstack sudo[99010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:27 devstack sudo[98998]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ccc40743-158d-4e41-a854-5d339768ac39 tempest-GroupSnapshotsTest-1497579122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de" returned: 0 in 1.012s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ccc40743-158d-4e41-a854-5d339768ac39 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de.a5191d95-2283-4928-9aac-5038c4643c5a {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:27 devstack sudo[99012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de.a5191d95-2283-4928-9aac-5038c4643c5a
Jul 10 12:48:27 devstack sudo[99012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:27 devstack sudo[98999]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c57f6d90-d8be-4ba9-9859-68f0b6765b85 tempest-TestInstancesWithCinderVolumes-1856690417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6f208719-4a9a-4626-b1dd-f867d44e13e3" returned: 0 in 1.334s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:27 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-c57f6d90-d8be-4ba9-9859-68f0b6765b85 tempest-TestInstancesWithCinderVolumes-1856690417 None] Lock "cinder-quobyte-6f208719-4a9a-4626-b1dd-f867d44e13e3" released by "delete_volume" :: held 2.817s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:48:27 devstack cinder-volume[87378]: WARNING cinder.quota [None req-c57f6d90-d8be-4ba9-9859-68f0b6765b85 tempest-TestInstancesWithCinderVolumes-1856690417 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2073510541-1346723781 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2073510541-1346723781, it is now deprecated. Please use the default quota class for default quota.
Jul 10 12:48:27 devstack cinder-volume[87378]: WARNING cinder.quota [None req-c57f6d90-d8be-4ba9-9859-68f0b6765b85 tempest-TestInstancesWithCinderVolumes-1856690417 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2073510541-1346723781 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2073510541-1346723781, it is now deprecated. Please use the default quota class for default quota.
Jul 10 12:48:27 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-c57f6d90-d8be-4ba9-9859-68f0b6765b85 tempest-TestInstancesWithCinderVolumes-1856690417 None] Created reservations ['012206ab-562e-4189-a234-830e418221db', 'c861e7a1-8eca-4ac2-8727-3a9be15bcdb1', '14932440-75aa-4f31-91f5-ce2f35500be9', 'a5611ff0-7b33-43d4-92bc-8276b1ebc8d9'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:48:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c57f6d90-d8be-4ba9-9859-68f0b6765b85 tempest-TestInstancesWithCinderVolumes-1856690417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:48:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c57f6d90-d8be-4ba9-9859-68f0b6765b85 tempest-TestInstancesWithCinderVolumes-1856690417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:48:27 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-c57f6d90-d8be-4ba9-9859-68f0b6765b85 tempest-TestInstancesWithCinderVolumes-1856690417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:48:27 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-c57f6d90-d8be-4ba9-9859-68f0b6765b85 tempest-TestInstancesWithCinderVolumes-1856690417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:48:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c57f6d90-d8be-4ba9-9859-68f0b6765b85 tempest-TestInstancesWithCinderVolumes-1856690417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:48:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c57f6d90-d8be-4ba9-9859-68f0b6765b85 tempest-TestInstancesWithCinderVolumes-1856690417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:27 devstack sudo[99016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:48:27 devstack sudo[99016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:28 devstack sudo[99010]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-64239904-ffa8-434d-99e5-71bfe5ef03d6 tempest-SnapshotsActionsTest-789273322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23" returned: 0 in 1.330s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:28 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-64239904-ffa8-434d-99e5-71bfe5ef03d6 tempest-SnapshotsActionsTest-789273322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e645700-a883-4de8-83a0-309080c6985e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:48:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-64239904-ffa8-434d-99e5-71bfe5ef03d6 tempest-SnapshotsActionsTest-789273322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.d9563657-c045-4d96-8f77-95b291237816 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:28 devstack sudo[99025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.d9563657-c045-4d96-8f77-95b291237816
Jul 10 12:48:28 devstack sudo[99025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:28 devstack sudo[99012]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ccc40743-158d-4e41-a854-5d339768ac39 tempest-GroupSnapshotsTest-1497579122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de.a5191d95-2283-4928-9aac-5038c4643c5a" returned: 0 in 1.435s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ccc40743-158d-4e41-a854-5d339768ac39 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de.a5191d95-2283-4928-9aac-5038c4643c5a {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:28 devstack sudo[99028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de.a5191d95-2283-4928-9aac-5038c4643c5a
Jul 10 12:48:28 devstack sudo[99028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:28 devstack sudo[99016]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c57f6d90-d8be-4ba9-9859-68f0b6765b85 tempest-TestInstancesWithCinderVolumes-1856690417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 1.094s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:28 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-c57f6d90-d8be-4ba9-9859-68f0b6765b85 tempest-TestInstancesWithCinderVolumes-1856690417 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:48:28 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-c57f6d90-d8be-4ba9-9859-68f0b6765b85 tempest-TestInstancesWithCinderVolumes-1856690417 None] Deleted volume successfully.
Jul 10 12:48:28 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-c57f6d90-d8be-4ba9-9859-68f0b6765b85 tempest-TestInstancesWithCinderVolumes-1856690417 None] Lock "cinder-6f208719-4a9a-4626-b1dd-f867d44e13e3-delete_volume" released by "delete_volume" :: held 4.416s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:48:29 devstack sudo[99025]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-64239904-ffa8-434d-99e5-71bfe5ef03d6 tempest-SnapshotsActionsTest-789273322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.d9563657-c045-4d96-8f77-95b291237816" returned: 0 in 1.318s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-64239904-ffa8-434d-99e5-71bfe5ef03d6 tempest-SnapshotsActionsTest-789273322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.d9563657-c045-4d96-8f77-95b291237816 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:29 devstack sudo[99028]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ccc40743-158d-4e41-a854-5d339768ac39 tempest-GroupSnapshotsTest-1497579122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de.a5191d95-2283-4928-9aac-5038c4643c5a" returned: 0 in 1.040s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:29 devstack sudo[99038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.d9563657-c045-4d96-8f77-95b291237816
Jul 10 12:48:29 devstack sudo[99038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:29 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-ccc40743-158d-4e41-a854-5d339768ac39 tempest-GroupSnapshotsTest-1497579122 None] Lock "cinder-quobyte-a5191d95-2283-4928-9aac-5038c4643c5a" released by "_delete_snapshot" :: held 4.864s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:48:29 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-ccc40743-158d-4e41-a854-5d339768ac39 tempest-GroupSnapshotsTest-1497579122 None] Lock "cinder-quobyte-877497d9-ba11-4969-91e6-e95e0d9cd5de" released by "delete_snapshot" :: held 4.926s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:48:29 devstack cinder-volume[87378]: WARNING cinder.quota [None req-ccc40743-158d-4e41-a854-5d339768ac39 tempest-GroupSnapshotsTest-1497579122 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-891458365 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-891458365, it is now deprecated. Please use the default quota class for default quota.
Jul 10 12:48:29 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-ccc40743-158d-4e41-a854-5d339768ac39 tempest-GroupSnapshotsTest-1497579122 None] Created reservations ['8e0beef6-ae7d-44b9-9004-2631d0a5b655', '74211f46-701a-4720-8de7-ebb49447b6ed', 'aedd2a7e-12d5-4ae6-8ef2-3569b47b0e3a', 'e688d547-b99e-414e-944d-b5ed5c1f0b57'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:48:29 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-17557a7d-224d-4354-ad2a-a4d5fccbd8ff tempest-CinderUnicodeTest-1254226005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:48:29 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-17557a7d-224d-4354-ad2a-a4d5fccbd8ff tempest-CinderUnicodeTest-1254226005 None] Flow 'volume_create_manager' (dff93ce6-338c-487c-9f82-27556e6dfe1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:48:29 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-17557a7d-224d-4354-ad2a-a4d5fccbd8ff tempest-CinderUnicodeTest-1254226005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7c32cf2-696d-47c4-886a-dbbc3283a374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:29 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-17557a7d-224d-4354-ad2a-a4d5fccbd8ff tempest-CinderUnicodeTest-1254226005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7c32cf2-696d-47c4-886a-dbbc3283a374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:48:29Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4149450-cc9e-4c49-954d-e44091589089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82dc6c5ded5f453cbe00f1c36cefb905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:48:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:48:30Z,use_quota=True,user_id='3125045c1329406ba4f5223fc91a86ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:48:29 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-17557a7d-224d-4354-ad2a-a4d5fccbd8ff tempest-CinderUnicodeTest-1254226005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c31982c3-1fd9-441e-a1ed-dba34a378e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:29 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-17557a7d-224d-4354-ad2a-a4d5fccbd8ff tempest-CinderUnicodeTest-1254226005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c31982c3-1fd9-441e-a1ed-dba34a378e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:48:29 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-17557a7d-224d-4354-ad2a-a4d5fccbd8ff tempest-CinderUnicodeTest-1254226005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07bed87e-9385-4367-b971-a423945f4f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:29 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-17557a7d-224d-4354-ad2a-a4d5fccbd8ff tempest-CinderUnicodeTest-1254226005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07bed87e-9385-4367-b971-a423945f4f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4149450-cc9e-4c49-954d-e44091589089', 'volume_name': 'volume-e4149450-cc9e-4c49-954d-e44091589089', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:48:29 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-17557a7d-224d-4354-ad2a-a4d5fccbd8ff tempest-CinderUnicodeTest-1254226005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ccadf10-38be-4410-9ecb-3962660ebb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:29 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-17557a7d-224d-4354-ad2a-a4d5fccbd8ff tempest-CinderUnicodeTest-1254226005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ccadf10-38be-4410-9ecb-3962660ebb30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:48:29 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-17557a7d-224d-4354-ad2a-a4d5fccbd8ff tempest-CinderUnicodeTest-1254226005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4485f9a-8759-40b4-b85f-808574a707f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:29 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-17557a7d-224d-4354-ad2a-a4d5fccbd8ff tempest-CinderUnicodeTest-1254226005 None] Volume e4149450-cc9e-4c49-954d-e44091589089: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4149450-cc9e-4c49-954d-e44091589089', 'volume_size': 1}
Jul 10 12:48:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-17557a7d-224d-4354-ad2a-a4d5fccbd8ff tempest-CinderUnicodeTest-1254226005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:48:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-17557a7d-224d-4354-ad2a-a4d5fccbd8ff tempest-CinderUnicodeTest-1254226005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:48:29 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-17557a7d-224d-4354-ad2a-a4d5fccbd8ff tempest-CinderUnicodeTest-1254226005 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:48:29Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4149450-cc9e-4c49-954d-e44091589089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82dc6c5ded5f453cbe00f1c36cefb905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:48:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:48:30Z,use_quota=True,user_id='3125045c1329406ba4f5223fc91a86ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:48:29 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-17557a7d-224d-4354-ad2a-a4d5fccbd8ff tempest-CinderUnicodeTest-1254226005 None] Creating volume e4149450-cc9e-4c49-954d-e44091589089 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:48:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-17557a7d-224d-4354-ad2a-a4d5fccbd8ff tempest-CinderUnicodeTest-1254226005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:48:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-17557a7d-224d-4354-ad2a-a4d5fccbd8ff tempest-CinderUnicodeTest-1254226005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:48:29 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-17557a7d-224d-4354-ad2a-a4d5fccbd8ff tempest-CinderUnicodeTest-1254226005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:48:29 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-17557a7d-224d-4354-ad2a-a4d5fccbd8ff tempest-CinderUnicodeTest-1254226005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:48:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-17557a7d-224d-4354-ad2a-a4d5fccbd8ff tempest-CinderUnicodeTest-1254226005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:48:29 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-17557a7d-224d-4354-ad2a-a4d5fccbd8ff tempest-CinderUnicodeTest-1254226005 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:48:29 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-17557a7d-224d-4354-ad2a-a4d5fccbd8ff tempest-CinderUnicodeTest-1254226005 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:48:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-17557a7d-224d-4354-ad2a-a4d5fccbd8ff tempest-CinderUnicodeTest-1254226005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e4149450-cc9e-4c49-954d-e44091589089 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:30 devstack sudo[99041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e4149450-cc9e-4c49-954d-e44091589089 1073741824
Jul 10 12:48:30 devstack sudo[99041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:30 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-ccc40743-158d-4e41-a854-5d339768ac39 tempest-GroupSnapshotsTest-1497579122 None] group_snapshot eb447fc7-9964-4ac8-a73e-28837ab817e8: deleted successfully
Jul 10 12:48:30 devstack sudo[99038]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:30 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-64239904-ffa8-434d-99e5-71bfe5ef03d6 tempest-SnapshotsActionsTest-789273322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.d9563657-c045-4d96-8f77-95b291237816" returned: 0 in 0.819s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:30 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-64239904-ffa8-434d-99e5-71bfe5ef03d6 tempest-SnapshotsActionsTest-789273322 None] Lock "cinder-quobyte-d9563657-c045-4d96-8f77-95b291237816" released by "_delete_snapshot" :: held 5.153s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:48:30 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-64239904-ffa8-434d-99e5-71bfe5ef03d6 tempest-SnapshotsActionsTest-789273322 None] Lock "cinder-quobyte-3e645700-a883-4de8-83a0-309080c6985e" released by "delete_snapshot" :: held 5.198s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:48:30 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-64239904-ffa8-434d-99e5-71bfe5ef03d6 tempest-SnapshotsActionsTest-789273322 None] Created reservations ['1535f7de-b7f4-4fc7-aa58-0e0022160f1b', '7f815aa0-833e-4b30-9028-9cfebef54b7e', '5c5d6bee-8f86-482c-a8a7-157fbc2e65cc', 'd7a201a6-0f1d-44ad-a80a-5fb78c8910c0'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:48:30 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-64239904-ffa8-434d-99e5-71bfe5ef03d6 tempest-SnapshotsActionsTest-789273322 None] Delete snapshot completed successfully.
Jul 10 12:48:30 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-64239904-ffa8-434d-99e5-71bfe5ef03d6 tempest-SnapshotsActionsTest-789273322 None] Lock "cinder-d9563657-c045-4d96-8f77-95b291237816-delete_snapshot" released by "delete_snapshot" :: held 5.395s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:48:31 devstack sudo[99041]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-17557a7d-224d-4354-ad2a-a4d5fccbd8ff tempest-CinderUnicodeTest-1254226005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e4149450-cc9e-4c49-954d-e44091589089 1073741824" returned: 0 in 1.192s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-17557a7d-224d-4354-ad2a-a4d5fccbd8ff tempest-CinderUnicodeTest-1254226005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e4149450-cc9e-4c49-954d-e44091589089 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:31 devstack sudo[99068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e4149450-cc9e-4c49-954d-e44091589089
Jul 10 12:48:31 devstack sudo[99068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:31 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-09fa487e-641e-4544-92c7-6fc69fe434d8 tempest-GroupSnapshotsTest-1497579122 None] Acquiring lock "cinder-quobyte-877497d9-ba11-4969-91e6-e95e0d9cd5de" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:48:31 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-09fa487e-641e-4544-92c7-6fc69fe434d8 tempest-GroupSnapshotsTest-1497579122 None] Lock "cinder-quobyte-877497d9-ba11-4969-91e6-e95e0d9cd5de" acquired by "delete_volume" :: waited 0.024s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:48:31 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[becc2fef-614c-4d68-a899-124c1eccc6a0]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:48:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-09fa487e-641e-4544-92c7-6fc69fe434d8 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:31 devstack sudo[99072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de
Jul 10 12:48:31 devstack sudo[99072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-83c7bb70-552f-4a2e-a761-66e2303ac7c6 tempest-SnapshotsActionsTest-1562062894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:48:32 devstack sudo[99068]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-17557a7d-224d-4354-ad2a-a4d5fccbd8ff tempest-CinderUnicodeTest-1254226005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e4149450-cc9e-4c49-954d-e44091589089" returned: 0 in 1.054s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:32 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-17557a7d-224d-4354-ad2a-a4d5fccbd8ff tempest-CinderUnicodeTest-1254226005 None] <== create_volume: return (2304ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:48:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-17557a7d-224d-4354-ad2a-a4d5fccbd8ff tempest-CinderUnicodeTest-1254226005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.309s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:48:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-83c7bb70-552f-4a2e-a761-66e2303ac7c6 tempest-SnapshotsActionsTest-1562062894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.148s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:48:32 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-17557a7d-224d-4354-ad2a-a4d5fccbd8ff tempest-CinderUnicodeTest-1254226005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4485f9a-8759-40b4-b85f-808574a707f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4149450-cc9e-4c49-954d-e44091589089', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:48:32 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-17557a7d-224d-4354-ad2a-a4d5fccbd8ff tempest-CinderUnicodeTest-1254226005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fef7161-4677-4a67-854c-ecf7c9797b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:32 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-83c7bb70-552f-4a2e-a761-66e2303ac7c6 tempest-SnapshotsActionsTest-1562062894 None] Creating offline snapshot b13ab7b3-0491-4423-9ad5-8a0eccc57869 of volume 3e645700-a883-4de8-83a0-309080c6985e {{(pid=87378) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 10 12:48:32 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-17557a7d-224d-4354-ad2a-a4d5fccbd8ff tempest-CinderUnicodeTest-1254226005 None] Volume volume-e4149450-cc9e-4c49-954d-e44091589089 (e4149450-cc9e-4c49-954d-e44091589089): created successfully
Jul 10 12:48:32 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-17557a7d-224d-4354-ad2a-a4d5fccbd8ff tempest-CinderUnicodeTest-1254226005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fef7161-4677-4a67-854c-ecf7c9797b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:48:32 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-17557a7d-224d-4354-ad2a-a4d5fccbd8ff tempest-CinderUnicodeTest-1254226005 None] Flow 'volume_create_manager' (dff93ce6-338c-487c-9f82-27556e6dfe1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:48:32 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f77022-909b-4a3d-91ca-92065f76f7b5]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:48:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-83c7bb70-552f-4a2e-a761-66e2303ac7c6 tempest-SnapshotsActionsTest-1562062894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:32 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-17557a7d-224d-4354-ad2a-a4d5fccbd8ff tempest-CinderUnicodeTest-1254226005 None] Created volume successfully.
Jul 10 12:48:32 devstack sudo[99076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23
Jul 10 12:48:32 devstack sudo[99076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:32 devstack sudo[99072]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-09fa487e-641e-4544-92c7-6fc69fe434d8 tempest-GroupSnapshotsTest-1497579122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de" returned: 0 in 1.075s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-09fa487e-641e-4544-92c7-6fc69fe434d8 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:32 devstack sudo[99081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de
Jul 10 12:48:32 devstack sudo[99081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:33 devstack sudo[99076]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-83c7bb70-552f-4a2e-a761-66e2303ac7c6 tempest-SnapshotsActionsTest-1562062894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23" returned: 0 in 0.923s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:33 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-83c7bb70-552f-4a2e-a761-66e2303ac7c6 tempest-SnapshotsActionsTest-1562062894 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e645700-a883-4de8-83a0-309080c6985e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:48:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-83c7bb70-552f-4a2e-a761-66e2303ac7c6 tempest-SnapshotsActionsTest-1562062894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.b13ab7b3-0491-4423-9ad5-8a0eccc57869 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:33 devstack sudo[99087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.b13ab7b3-0491-4423-9ad5-8a0eccc57869 1G
Jul 10 12:48:33 devstack sudo[99087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:33 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:SELECT=124,cinder:INSERT=40,cinder:UPDATE=135,cinder:DELETE=9 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:48:33 devstack sudo[99081]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-09fa487e-641e-4544-92c7-6fc69fe434d8 tempest-GroupSnapshotsTest-1497579122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-877497d9-ba11-4969-91e6-e95e0d9cd5de" returned: 0 in 0.804s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:33 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:SELECT=148,cinder:UPDATE=143,cinder:INSERT=44,cinder:DELETE=7 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:48:33 devstack cinder-volume[87378]: INFO cinder.volume.manager [req-1de40b60-5dd7-4099-86d7-afdbb8ada0cb req-29b983f5-1dfe-4a73-a3d9-ff921cabe0f6 tempest-TestInstancesWithCinderVolumes-1856690417 None] Terminate volume connection completed successfully.
Jul 10 12:48:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-1de40b60-5dd7-4099-86d7-afdbb8ada0cb req-29b983f5-1dfe-4a73-a3d9-ff921cabe0f6 tempest-TestInstancesWithCinderVolumes-1856690417 None] Deleting attachment d286b276-e323-40e6-9322-047f8448514e. {{(pid=87378) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 10 12:48:33 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-09fa487e-641e-4544-92c7-6fc69fe434d8 tempest-GroupSnapshotsTest-1497579122 None] Lock "cinder-quobyte-877497d9-ba11-4969-91e6-e95e0d9cd5de" released by "delete_volume" :: held 1.997s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:48:33 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1c6d54c-cc20-4044-b3de-a93d76904d8d tempest-CinderUnicodeTest-1254226005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:48:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a1c6d54c-cc20-4044-b3de-a93d76904d8d tempest-CinderUnicodeTest-1254226005 None] Flow 'volume_create_manager' (28a0c795-ab54-4f9d-9cfd-2d88cac368a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:48:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a1c6d54c-cc20-4044-b3de-a93d76904d8d tempest-CinderUnicodeTest-1254226005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42a38820-eca5-4251-b1aa-3d29d8c3e9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:33 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-09fa487e-641e-4544-92c7-6fc69fe434d8 tempest-GroupSnapshotsTest-1497579122 None] Created reservations ['8de1ea38-2978-45f2-8d35-8fa6af10654c'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:48:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a1c6d54c-cc20-4044-b3de-a93d76904d8d tempest-CinderUnicodeTest-1254226005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42a38820-eca5-4251-b1aa-3d29d8c3e9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:48:33Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1234033714',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf9f56e3-3b08-4217-a1f6-f617b64812f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82dc6c5ded5f453cbe00f1c36cefb905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:48:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:48:34Z,use_quota=True,user_id='3125045c1329406ba4f5223fc91a86ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:48:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a1c6d54c-cc20-4044-b3de-a93d76904d8d tempest-CinderUnicodeTest-1254226005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2876be6-0c17-4cc1-9e6b-d965acc67b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a1c6d54c-cc20-4044-b3de-a93d76904d8d tempest-CinderUnicodeTest-1254226005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2876be6-0c17-4cc1-9e6b-d965acc67b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:48:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a1c6d54c-cc20-4044-b3de-a93d76904d8d tempest-CinderUnicodeTest-1254226005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b9ab8fc-a362-4195-b381-2c7201ac597f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a1c6d54c-cc20-4044-b3de-a93d76904d8d tempest-CinderUnicodeTest-1254226005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b9ab8fc-a362-4195-b381-2c7201ac597f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf9f56e3-3b08-4217-a1f6-f617b64812f7', 'volume_name': 'volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:48:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a1c6d54c-cc20-4044-b3de-a93d76904d8d tempest-CinderUnicodeTest-1254226005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8838ddc-e72f-4fdd-8b73-3fd77dad2940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a1c6d54c-cc20-4044-b3de-a93d76904d8d tempest-CinderUnicodeTest-1254226005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8838ddc-e72f-4fdd-8b73-3fd77dad2940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:48:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a1c6d54c-cc20-4044-b3de-a93d76904d8d tempest-CinderUnicodeTest-1254226005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad20dcbc-a791-46d7-b8cd-aab7364b28f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:33 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-a1c6d54c-cc20-4044-b3de-a93d76904d8d tempest-CinderUnicodeTest-1254226005 None] Volume cf9f56e3-3b08-4217-a1f6-f617b64812f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7', 'volume_size': 1}
Jul 10 12:48:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a1c6d54c-cc20-4044-b3de-a93d76904d8d tempest-CinderUnicodeTest-1254226005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:48:33 devstack cinder-volume[87378]: WARNING cinder.db.api [None req-09fa487e-641e-4544-92c7-6fc69fe434d8 tempest-GroupSnapshotsTest-1497579122 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-891458365']
Jul 10 12:48:33 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-09fa487e-641e-4544-92c7-6fc69fe434d8 tempest-GroupSnapshotsTest-1497579122 None] Created reservations ['ac491066-0558-4163-a7a8-24301aee6217', 'b01b5131-f5dc-453f-ae39-c2de025fcff7', 'c3fbcb0f-90ad-4f23-bbbb-77195e39f1f9', '6f5ffa2f-151e-4e4d-a160-1e3cfd029786'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:48:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-09fa487e-641e-4544-92c7-6fc69fe434d8 tempest-GroupSnapshotsTest-1497579122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:48:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-09fa487e-641e-4544-92c7-6fc69fe434d8 tempest-GroupSnapshotsTest-1497579122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:48:33 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-09fa487e-641e-4544-92c7-6fc69fe434d8 tempest-GroupSnapshotsTest-1497579122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:48:33 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-09fa487e-641e-4544-92c7-6fc69fe434d8 tempest-GroupSnapshotsTest-1497579122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:48:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-09fa487e-641e-4544-92c7-6fc69fe434d8 tempest-GroupSnapshotsTest-1497579122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:48:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-09fa487e-641e-4544-92c7-6fc69fe434d8 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:33 devstack sudo[99089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:48:33 devstack sudo[99089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:34 devstack sudo[99087]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-83c7bb70-552f-4a2e-a761-66e2303ac7c6 tempest-SnapshotsActionsTest-1562062894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.b13ab7b3-0491-4423-9ad5-8a0eccc57869 1G" returned: 0 in 1.010s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-83c7bb70-552f-4a2e-a761-66e2303ac7c6 tempest-SnapshotsActionsTest-1562062894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.b13ab7b3-0491-4423-9ad5-8a0eccc57869 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:34 devstack sudo[99096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.b13ab7b3-0491-4423-9ad5-8a0eccc57869
Jul 10 12:48:34 devstack sudo[99096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:34 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-26d84081-d5e8-49cf-b0dd-28be478288f8 tempest-GroupSnapshotsTest-1497579122 None] Group tempest-GroupSnapshotsTest-Group-1419746999: creating
Jul 10 12:48:34 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-26d84081-d5e8-49cf-b0dd-28be478288f8 tempest-GroupSnapshotsTest-1497579122 None] Group tempest-GroupSnapshotsTest-Group-1419746999: created successfully
Jul 10 12:48:34 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-26d84081-d5e8-49cf-b0dd-28be478288f8 tempest-GroupSnapshotsTest-1497579122 None] Create group completed successfully.
Jul 10 12:48:34 devstack sudo[99089]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-09fa487e-641e-4544-92c7-6fc69fe434d8 tempest-GroupSnapshotsTest-1497579122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.821s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:34 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-09fa487e-641e-4544-92c7-6fc69fe434d8 tempest-GroupSnapshotsTest-1497579122 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:48:34 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-09fa487e-641e-4544-92c7-6fc69fe434d8 tempest-GroupSnapshotsTest-1497579122 None] Delete group completed successfully.
Jul 10 12:48:35 devstack sudo[99096]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-83c7bb70-552f-4a2e-a761-66e2303ac7c6 tempest-SnapshotsActionsTest-1562062894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.b13ab7b3-0491-4423-9ad5-8a0eccc57869" returned: 0 in 0.789s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:35 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-83c7bb70-552f-4a2e-a761-66e2303ac7c6 tempest-SnapshotsActionsTest-1562062894 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.b13ab7b3-0491-4423-9ad5-8a0eccc57869 is being set with open permissions: ugo+rw
Jul 10 12:48:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-83c7bb70-552f-4a2e-a761-66e2303ac7c6 tempest-SnapshotsActionsTest-1562062894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.b13ab7b3-0491-4423-9ad5-8a0eccc57869 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:35 devstack sudo[99108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.b13ab7b3-0491-4423-9ad5-8a0eccc57869
Jul 10 12:48:35 devstack sudo[99108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:35 devstack sudo[99108]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-83c7bb70-552f-4a2e-a761-66e2303ac7c6 tempest-SnapshotsActionsTest-1562062894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.b13ab7b3-0491-4423-9ad5-8a0eccc57869" returned: 0 in 0.711s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-83c7bb70-552f-4a2e-a761-66e2303ac7c6 tempest-SnapshotsActionsTest-1562062894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.625s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:48:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a1c6d54c-cc20-4044-b3de-a93d76904d8d tempest-CinderUnicodeTest-1254226005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.222s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:48:35 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-a1c6d54c-cc20-4044-b3de-a93d76904d8d tempest-CinderUnicodeTest-1254226005 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:48:33Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1234033714',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf9f56e3-3b08-4217-a1f6-f617b64812f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82dc6c5ded5f453cbe00f1c36cefb905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:48:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:48:34Z,use_quota=True,user_id='3125045c1329406ba4f5223fc91a86ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:48:35 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-a1c6d54c-cc20-4044-b3de-a93d76904d8d tempest-CinderUnicodeTest-1254226005 None] Creating volume cf9f56e3-3b08-4217-a1f6-f617b64812f7 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:48:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a1c6d54c-cc20-4044-b3de-a93d76904d8d tempest-CinderUnicodeTest-1254226005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:48:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a1c6d54c-cc20-4044-b3de-a93d76904d8d tempest-CinderUnicodeTest-1254226005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:48:35 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-a1c6d54c-cc20-4044-b3de-a93d76904d8d tempest-CinderUnicodeTest-1254226005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:48:35 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-a1c6d54c-cc20-4044-b3de-a93d76904d8d tempest-CinderUnicodeTest-1254226005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:48:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a1c6d54c-cc20-4044-b3de-a93d76904d8d tempest-CinderUnicodeTest-1254226005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:48:35 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-a1c6d54c-cc20-4044-b3de-a93d76904d8d tempest-CinderUnicodeTest-1254226005 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:48:35 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-a1c6d54c-cc20-4044-b3de-a93d76904d8d tempest-CinderUnicodeTest-1254226005 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:48:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a1c6d54c-cc20-4044-b3de-a93d76904d8d tempest-CinderUnicodeTest-1254226005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:35 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-83c7bb70-552f-4a2e-a761-66e2303ac7c6 tempest-SnapshotsActionsTest-1562062894 None] Create snapshot completed successfully
Jul 10 12:48:35 devstack sudo[99111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7 1073741824
Jul 10 12:48:35 devstack sudo[99111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:36 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdd4d571-b6a4-43f1-8426-324fb3ee8220 tempest-GroupSnapshotsTest-1497579122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:48:36 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bdd4d571-b6a4-43f1-8426-324fb3ee8220 tempest-GroupSnapshotsTest-1497579122 None] Flow 'volume_create_manager' (0e64050f-85a0-4ce7-9d83-ca9001e00f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:48:36 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bdd4d571-b6a4-43f1-8426-324fb3ee8220 tempest-GroupSnapshotsTest-1497579122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eb200bc-b4cd-4453-978d-e0cfdac55dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:36 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bdd4d571-b6a4-43f1-8426-324fb3ee8220 tempest-GroupSnapshotsTest-1497579122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eb200bc-b4cd-4453-978d-e0cfdac55dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:48:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1565547905',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7470aaf4-5c3e-4308-a4ae-5bcd4ae50fc5,host='devstack@QuobyteHD#QuobyteHD',id=eaa22196-59d6-4ea0-af8b-199c442a5a4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca795075de2f45bf8c75eaa6d162dc93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:48:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:48:36Z,use_quota=True,user_id='662d32fbb232435a8c88e72656348521',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(759dd9b6-061d-48d4-b172-3fc3a9ac37ff),volume_type_id=759dd9b6-061d-48d4-b172-3fc3a9ac37ff)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:48:36 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bdd4d571-b6a4-43f1-8426-324fb3ee8220 tempest-GroupSnapshotsTest-1497579122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac224610-6af7-49ab-a4b1-7bbb361720cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:36 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bdd4d571-b6a4-43f1-8426-324fb3ee8220 tempest-GroupSnapshotsTest-1497579122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac224610-6af7-49ab-a4b1-7bbb361720cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:48:36 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bdd4d571-b6a4-43f1-8426-324fb3ee8220 tempest-GroupSnapshotsTest-1497579122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6baac85-09a6-4869-9b78-2746cc9352f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:36 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bdd4d571-b6a4-43f1-8426-324fb3ee8220 tempest-GroupSnapshotsTest-1497579122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6baac85-09a6-4869-9b78-2746cc9352f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eaa22196-59d6-4ea0-af8b-199c442a5a4e', 'volume_name': 'volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:48:36 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bdd4d571-b6a4-43f1-8426-324fb3ee8220 tempest-GroupSnapshotsTest-1497579122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1c3bf42-fe5a-437b-ba9b-f1084d7bd0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:36 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bdd4d571-b6a4-43f1-8426-324fb3ee8220 tempest-GroupSnapshotsTest-1497579122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1c3bf42-fe5a-437b-ba9b-f1084d7bd0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:48:36 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bdd4d571-b6a4-43f1-8426-324fb3ee8220 tempest-GroupSnapshotsTest-1497579122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (360d76cc-2f5c-4128-aacb-f675dd53a938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:36 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-bdd4d571-b6a4-43f1-8426-324fb3ee8220 tempest-GroupSnapshotsTest-1497579122 None] Volume eaa22196-59d6-4ea0-af8b-199c442a5a4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e', 'volume_size': 1}
Jul 10 12:48:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-bdd4d571-b6a4-43f1-8426-324fb3ee8220 tempest-GroupSnapshotsTest-1497579122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:48:36 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3530cdd6-2526-418c-9461-a11f0e0d291b tempest-SnapshotsActionsTest-789273322 None] Acquiring lock "cinder-b13ab7b3-0491-4423-9ad5-8a0eccc57869-delete_snapshot" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:48:36 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3530cdd6-2526-418c-9461-a11f0e0d291b tempest-SnapshotsActionsTest-789273322 None] Lock "cinder-b13ab7b3-0491-4423-9ad5-8a0eccc57869-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:48:36 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3530cdd6-2526-418c-9461-a11f0e0d291b tempest-SnapshotsActionsTest-789273322 None] Acquiring lock "cinder-quobyte-3e645700-a883-4de8-83a0-309080c6985e" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:48:36 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3530cdd6-2526-418c-9461-a11f0e0d291b tempest-SnapshotsActionsTest-789273322 None] Lock "cinder-quobyte-3e645700-a883-4de8-83a0-309080c6985e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:48:36 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3530cdd6-2526-418c-9461-a11f0e0d291b tempest-SnapshotsActionsTest-789273322 None] Acquiring lock "cinder-quobyte-b13ab7b3-0491-4423-9ad5-8a0eccc57869" by "_delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:48:36 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3530cdd6-2526-418c-9461-a11f0e0d291b tempest-SnapshotsActionsTest-789273322 None] Lock "cinder-quobyte-b13ab7b3-0491-4423-9ad5-8a0eccc57869" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:48:36 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-3530cdd6-2526-418c-9461-a11f0e0d291b tempest-SnapshotsActionsTest-789273322 None] Deleting offline snapshot b13ab7b3-0491-4423-9ad5-8a0eccc57869 of volume 3e645700-a883-4de8-83a0-309080c6985e {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 10 12:48:36 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-3530cdd6-2526-418c-9461-a11f0e0d291b tempest-SnapshotsActionsTest-789273322 None] snapshot_file for this snap is: volume-3e645700-a883-4de8-83a0-309080c6985e.b13ab7b3-0491-4423-9ad5-8a0eccc57869 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 10 12:48:36 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ec3954-817c-46a9-9c35-c6e22512fac0]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:48:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3530cdd6-2526-418c-9461-a11f0e0d291b tempest-SnapshotsActionsTest-789273322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.b13ab7b3-0491-4423-9ad5-8a0eccc57869 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:36 devstack sudo[99113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.b13ab7b3-0491-4423-9ad5-8a0eccc57869
Jul 10 12:48:36 devstack sudo[99113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:36 devstack sudo[99111]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a1c6d54c-cc20-4044-b3de-a93d76904d8d tempest-CinderUnicodeTest-1254226005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7 1073741824" returned: 0 in 0.949s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:36 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f201aa53-8e56-4f8e-89e0-94ebe3b540ee tempest-TestInstancesWithCinderVolumes-1856690417 None] Acquiring lock "cinder-22def002-3e0c-4802-903b-1ec123510c2d-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:48:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a1c6d54c-cc20-4044-b3de-a93d76904d8d tempest-CinderUnicodeTest-1254226005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:36 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f201aa53-8e56-4f8e-89e0-94ebe3b540ee tempest-TestInstancesWithCinderVolumes-1856690417 None] Lock "cinder-22def002-3e0c-4802-903b-1ec123510c2d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:48:36 devstack sudo[99118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7
Jul 10 12:48:36 devstack sudo[99118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:37 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f201aa53-8e56-4f8e-89e0-94ebe3b540ee tempest-TestInstancesWithCinderVolumes-1856690417 None] Acquiring lock "cinder-quobyte-22def002-3e0c-4802-903b-1ec123510c2d" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:48:37 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f201aa53-8e56-4f8e-89e0-94ebe3b540ee tempest-TestInstancesWithCinderVolumes-1856690417 None] Lock "cinder-quobyte-22def002-3e0c-4802-903b-1ec123510c2d" acquired by "delete_volume" :: waited 0.025s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:48:37 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f740bbe3-359b-42e4-9156-609e388882d2]: (4, 'raw') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:48:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f201aa53-8e56-4f8e-89e0-94ebe3b540ee tempest-TestInstancesWithCinderVolumes-1856690417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22def002-3e0c-4802-903b-1ec123510c2d {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:37 devstack sudo[99120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22def002-3e0c-4802-903b-1ec123510c2d
Jul 10 12:48:37 devstack sudo[99120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:37 devstack sudo[99113]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3530cdd6-2526-418c-9461-a11f0e0d291b tempest-SnapshotsActionsTest-789273322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.b13ab7b3-0491-4423-9ad5-8a0eccc57869" returned: 0 in 0.813s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:37 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-3530cdd6-2526-418c-9461-a11f0e0d291b tempest-SnapshotsActionsTest-789273322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e645700-a883-4de8-83a0-309080c6985e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:48:37 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c991445-1b42-4cba-8b88-15a28e0ab718]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:48:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3530cdd6-2526-418c-9461-a11f0e0d291b tempest-SnapshotsActionsTest-789273322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:37 devstack sudo[99125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23
Jul 10 12:48:37 devstack sudo[99125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:37 devstack sudo[99118]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a1c6d54c-cc20-4044-b3de-a93d76904d8d tempest-CinderUnicodeTest-1254226005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7" returned: 0 in 0.732s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:37 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-a1c6d54c-cc20-4044-b3de-a93d76904d8d tempest-CinderUnicodeTest-1254226005 None] <== create_volume: return (1743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:48:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a1c6d54c-cc20-4044-b3de-a93d76904d8d tempest-CinderUnicodeTest-1254226005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.747s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:48:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-bdd4d571-b6a4-43f1-8426-324fb3ee8220 tempest-GroupSnapshotsTest-1497579122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.461s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:48:37 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-bdd4d571-b6a4-43f1-8426-324fb3ee8220 tempest-GroupSnapshotsTest-1497579122 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=7470aaf4-5c3e-4308-a4ae-5bcd4ae50fc5,created_at=2026-07-10T10:48:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1565547905',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7470aaf4-5c3e-4308-a4ae-5bcd4ae50fc5,host='devstack@QuobyteHD#QuobyteHD',id=eaa22196-59d6-4ea0-af8b-199c442a5a4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca795075de2f45bf8c75eaa6d162dc93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:48:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:48:36Z,use_quota=True,user_id='662d32fbb232435a8c88e72656348521',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(759dd9b6-061d-48d4-b172-3fc3a9ac37ff),volume_type_id=759dd9b6-061d-48d4-b172-3fc3a9ac37ff)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:48:37 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-bdd4d571-b6a4-43f1-8426-324fb3ee8220 tempest-GroupSnapshotsTest-1497579122 None] Creating volume eaa22196-59d6-4ea0-af8b-199c442a5a4e {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:48:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-bdd4d571-b6a4-43f1-8426-324fb3ee8220 tempest-GroupSnapshotsTest-1497579122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:48:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-bdd4d571-b6a4-43f1-8426-324fb3ee8220 tempest-GroupSnapshotsTest-1497579122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:48:37 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-bdd4d571-b6a4-43f1-8426-324fb3ee8220 tempest-GroupSnapshotsTest-1497579122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:48:37 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-bdd4d571-b6a4-43f1-8426-324fb3ee8220 tempest-GroupSnapshotsTest-1497579122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:48:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-bdd4d571-b6a4-43f1-8426-324fb3ee8220 tempest-GroupSnapshotsTest-1497579122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:48:37 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-bdd4d571-b6a4-43f1-8426-324fb3ee8220 tempest-GroupSnapshotsTest-1497579122 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:48:37 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-bdd4d571-b6a4-43f1-8426-324fb3ee8220 tempest-GroupSnapshotsTest-1497579122 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:48:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-bdd4d571-b6a4-43f1-8426-324fb3ee8220 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:37 devstack sudo[99128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e 1073741824
Jul 10 12:48:37 devstack sudo[99128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a1c6d54c-cc20-4044-b3de-a93d76904d8d tempest-CinderUnicodeTest-1254226005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad20dcbc-a791-46d7-b8cd-aab7364b28f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:48:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a1c6d54c-cc20-4044-b3de-a93d76904d8d tempest-CinderUnicodeTest-1254226005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4a938b4-77be-42ef-8206-1c06f11878f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:37 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-a1c6d54c-cc20-4044-b3de-a93d76904d8d tempest-CinderUnicodeTest-1254226005 None] Volume volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7 (cf9f56e3-3b08-4217-a1f6-f617b64812f7): created successfully
Jul 10 12:48:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a1c6d54c-cc20-4044-b3de-a93d76904d8d tempest-CinderUnicodeTest-1254226005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4a938b4-77be-42ef-8206-1c06f11878f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:48:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a1c6d54c-cc20-4044-b3de-a93d76904d8d tempest-CinderUnicodeTest-1254226005 None] Flow 'volume_create_manager' (28a0c795-ab54-4f9d-9cfd-2d88cac368a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:48:37 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-a1c6d54c-cc20-4044-b3de-a93d76904d8d tempest-CinderUnicodeTest-1254226005 None] Created volume successfully.
Jul 10 12:48:38 devstack sudo[99120]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f201aa53-8e56-4f8e-89e0-94ebe3b540ee tempest-TestInstancesWithCinderVolumes-1856690417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22def002-3e0c-4802-903b-1ec123510c2d" returned: 0 in 1.016s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f201aa53-8e56-4f8e-89e0-94ebe3b540ee tempest-TestInstancesWithCinderVolumes-1856690417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22def002-3e0c-4802-903b-1ec123510c2d {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-6276600c-2208-4d13-983d-14216dc9b91b tempest-CinderUnicodeTest-1254226005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:48:38 devstack sudo[99133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22def002-3e0c-4802-903b-1ec123510c2d
Jul 10 12:48:38 devstack sudo[99133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:38 devstack sudo[99125]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3530cdd6-2526-418c-9461-a11f0e0d291b tempest-SnapshotsActionsTest-789273322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23" returned: 0 in 0.990s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:38 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-3530cdd6-2526-418c-9461-a11f0e0d291b tempest-SnapshotsActionsTest-789273322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e645700-a883-4de8-83a0-309080c6985e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:48:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3530cdd6-2526-418c-9461-a11f0e0d291b tempest-SnapshotsActionsTest-789273322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.b13ab7b3-0491-4423-9ad5-8a0eccc57869 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:38 devstack sudo[99140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.b13ab7b3-0491-4423-9ad5-8a0eccc57869
Jul 10 12:48:38 devstack sudo[99140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:38 devstack sudo[99128]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-bdd4d571-b6a4-43f1-8426-324fb3ee8220 tempest-GroupSnapshotsTest-1497579122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e 1073741824" returned: 0 in 1.000s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-bdd4d571-b6a4-43f1-8426-324fb3ee8220 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:38 devstack sudo[99142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e
Jul 10 12:48:38 devstack sudo[99142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:38 devstack sudo[99133]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f201aa53-8e56-4f8e-89e0-94ebe3b540ee tempest-TestInstancesWithCinderVolumes-1856690417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22def002-3e0c-4802-903b-1ec123510c2d" returned: 1 in 0.862s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f201aa53-8e56-4f8e-89e0-94ebe3b540ee tempest-TestInstancesWithCinderVolumes-1856690417 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22def002-3e0c-4802-903b-1ec123510c2d' failed. Not Retrying. {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 10 12:48:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f201aa53-8e56-4f8e-89e0-94ebe3b540ee tempest-TestInstancesWithCinderVolumes-1856690417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22def002-3e0c-4802-903b-1ec123510c2d {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:38 devstack sudo[99150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22def002-3e0c-4802-903b-1ec123510c2d
Jul 10 12:48:38 devstack sudo[99150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:39 devstack sudo[99140]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3530cdd6-2526-418c-9461-a11f0e0d291b tempest-SnapshotsActionsTest-789273322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.b13ab7b3-0491-4423-9ad5-8a0eccc57869" returned: 0 in 0.822s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3530cdd6-2526-418c-9461-a11f0e0d291b tempest-SnapshotsActionsTest-789273322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.b13ab7b3-0491-4423-9ad5-8a0eccc57869 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:39 devstack sudo[99153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.b13ab7b3-0491-4423-9ad5-8a0eccc57869
Jul 10 12:48:39 devstack sudo[99153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:39 devstack sudo[99142]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-bdd4d571-b6a4-43f1-8426-324fb3ee8220 tempest-GroupSnapshotsTest-1497579122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e" returned: 0 in 0.729s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-bdd4d571-b6a4-43f1-8426-324fb3ee8220 tempest-GroupSnapshotsTest-1497579122 None] <== create_volume: return (1781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:48:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-bdd4d571-b6a4-43f1-8426-324fb3ee8220 tempest-GroupSnapshotsTest-1497579122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.785s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:48:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-6276600c-2208-4d13-983d-14216dc9b91b tempest-CinderUnicodeTest-1254226005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.243s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:48:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-6276600c-2208-4d13-983d-14216dc9b91b tempest-CinderUnicodeTest-1254226005 None] Creating offline snapshot 02739150-2183-4d3d-aaf8-309a6f43011c of volume cf9f56e3-3b08-4217-a1f6-f617b64812f7 {{(pid=87378) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 10 12:48:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bdd4d571-b6a4-43f1-8426-324fb3ee8220 tempest-GroupSnapshotsTest-1497579122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (360d76cc-2f5c-4128-aacb-f675dd53a938) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:48:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bdd4d571-b6a4-43f1-8426-324fb3ee8220 tempest-GroupSnapshotsTest-1497579122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cff5e768-fe7f-4dce-a572-46cb24e493c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:39 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d01dfc-dc11-4bd1-b761-a2284083b5a4]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:48:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6276600c-2208-4d13-983d-14216dc9b91b tempest-CinderUnicodeTest-1254226005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:39 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-bdd4d571-b6a4-43f1-8426-324fb3ee8220 tempest-GroupSnapshotsTest-1497579122 None] Volume volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e (eaa22196-59d6-4ea0-af8b-199c442a5a4e): created successfully
Jul 10 12:48:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bdd4d571-b6a4-43f1-8426-324fb3ee8220 tempest-GroupSnapshotsTest-1497579122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cff5e768-fe7f-4dce-a572-46cb24e493c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:48:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bdd4d571-b6a4-43f1-8426-324fb3ee8220 tempest-GroupSnapshotsTest-1497579122 None] Flow 'volume_create_manager' (0e64050f-85a0-4ce7-9d83-ca9001e00f18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:48:39 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-bdd4d571-b6a4-43f1-8426-324fb3ee8220 tempest-GroupSnapshotsTest-1497579122 None] Created volume successfully.
Jul 10 12:48:39 devstack sudo[99156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7
Jul 10 12:48:39 devstack sudo[99156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:39 devstack sudo[99150]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f201aa53-8e56-4f8e-89e0-94ebe3b540ee tempest-TestInstancesWithCinderVolumes-1856690417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-22def002-3e0c-4802-903b-1ec123510c2d" returned: 0 in 0.762s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:39 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f201aa53-8e56-4f8e-89e0-94ebe3b540ee tempest-TestInstancesWithCinderVolumes-1856690417 None] Lock "cinder-quobyte-22def002-3e0c-4802-903b-1ec123510c2d" released by "delete_volume" :: held 2.713s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:48:39 devstack cinder-volume[87378]: WARNING cinder.quota [None req-f201aa53-8e56-4f8e-89e0-94ebe3b540ee tempest-TestInstancesWithCinderVolumes-1856690417 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-91272888-862228533 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-91272888-862228533, it is now deprecated. Please use the default quota class for default quota.
Jul 10 12:48:39 devstack cinder-volume[87378]: WARNING cinder.quota [None req-f201aa53-8e56-4f8e-89e0-94ebe3b540ee tempest-TestInstancesWithCinderVolumes-1856690417 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-91272888-862228533 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-91272888-862228533, it is now deprecated. Please use the default quota class for default quota.
Jul 10 12:48:39 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-f201aa53-8e56-4f8e-89e0-94ebe3b540ee tempest-TestInstancesWithCinderVolumes-1856690417 None] Created reservations ['f5e03cc1-ff8c-47f0-a02a-5a7ceed8d7b2', '47a90799-db71-4279-8b11-7b7d5ea7412d', '49f8e08a-a3a2-4980-9182-d5ab71c7b247', '0182fc84-0988-488a-ba1f-a6f0f98c5ace'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:48:39 devstack sudo[99153]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3530cdd6-2526-418c-9461-a11f0e0d291b tempest-SnapshotsActionsTest-789273322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.b13ab7b3-0491-4423-9ad5-8a0eccc57869" returned: 0 in 0.691s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:39 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3530cdd6-2526-418c-9461-a11f0e0d291b tempest-SnapshotsActionsTest-789273322 None] Lock "cinder-quobyte-b13ab7b3-0491-4423-9ad5-8a0eccc57869" released by "_delete_snapshot" :: held 3.446s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:48:39 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3530cdd6-2526-418c-9461-a11f0e0d291b tempest-SnapshotsActionsTest-789273322 None] Lock "cinder-quobyte-3e645700-a883-4de8-83a0-309080c6985e" released by "delete_snapshot" :: held 3.480s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:48:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f201aa53-8e56-4f8e-89e0-94ebe3b540ee tempest-TestInstancesWithCinderVolumes-1856690417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:48:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f201aa53-8e56-4f8e-89e0-94ebe3b540ee tempest-TestInstancesWithCinderVolumes-1856690417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:48:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-f201aa53-8e56-4f8e-89e0-94ebe3b540ee tempest-TestInstancesWithCinderVolumes-1856690417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:48:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-f201aa53-8e56-4f8e-89e0-94ebe3b540ee tempest-TestInstancesWithCinderVolumes-1856690417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:48:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f201aa53-8e56-4f8e-89e0-94ebe3b540ee tempest-TestInstancesWithCinderVolumes-1856690417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:48:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f201aa53-8e56-4f8e-89e0-94ebe3b540ee tempest-TestInstancesWithCinderVolumes-1856690417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:40 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-3530cdd6-2526-418c-9461-a11f0e0d291b tempest-SnapshotsActionsTest-789273322 None] Created reservations ['b68b08c8-f7f2-47a5-aad5-1063bd188125', '4d20bcc1-15af-4cba-8082-ee6bd7ac6435', '46c09afb-b90a-44fa-a431-7921499c0c16', '0aca7c38-be4f-491a-8fda-710f37358ce1'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:48:40 devstack sudo[99160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:48:40 devstack sudo[99160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:40 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-3530cdd6-2526-418c-9461-a11f0e0d291b tempest-SnapshotsActionsTest-789273322 None] Delete snapshot completed successfully.
Jul 10 12:48:40 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3530cdd6-2526-418c-9461-a11f0e0d291b tempest-SnapshotsActionsTest-789273322 None] Lock "cinder-b13ab7b3-0491-4423-9ad5-8a0eccc57869-delete_snapshot" released by "delete_snapshot" :: held 3.718s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:48:40 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c78df0b-1bc1-4617-b59f-56e9e08d3416 tempest-GroupSnapshotsTest-1497579122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:48:40 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7c78df0b-1bc1-4617-b59f-56e9e08d3416 tempest-GroupSnapshotsTest-1497579122 None] Flow 'volume_create_manager' (c7f91460-a156-4707-b5b9-43fdcc3561bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:48:40 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7c78df0b-1bc1-4617-b59f-56e9e08d3416 tempest-GroupSnapshotsTest-1497579122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6c288c9-7441-4b87-b815-07df1401424b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:40 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7c78df0b-1bc1-4617-b59f-56e9e08d3416 tempest-GroupSnapshotsTest-1497579122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6c288c9-7441-4b87-b815-07df1401424b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1657653507',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7470aaf4-5c3e-4308-a4ae-5bcd4ae50fc5,host='devstack@QuobyteHD#QuobyteHD',id=6d342976-9deb-44d7-b8b7-fdebfc3a89e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca795075de2f45bf8c75eaa6d162dc93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:48:40Z,use_quota=True,user_id='662d32fbb232435a8c88e72656348521',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(759dd9b6-061d-48d4-b172-3fc3a9ac37ff),volume_type_id=759dd9b6-061d-48d4-b172-3fc3a9ac37ff)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:48:40 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7c78df0b-1bc1-4617-b59f-56e9e08d3416 tempest-GroupSnapshotsTest-1497579122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a0bcac0-411d-4272-acfd-e1967205ec2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:40 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7c78df0b-1bc1-4617-b59f-56e9e08d3416 tempest-GroupSnapshotsTest-1497579122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a0bcac0-411d-4272-acfd-e1967205ec2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:48:40 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7c78df0b-1bc1-4617-b59f-56e9e08d3416 tempest-GroupSnapshotsTest-1497579122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bfbb522-5ec9-4b99-b278-ae519238708c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:40 devstack sudo[99156]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:40 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7c78df0b-1bc1-4617-b59f-56e9e08d3416 tempest-GroupSnapshotsTest-1497579122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bfbb522-5ec9-4b99-b278-ae519238708c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d342976-9deb-44d7-b8b7-fdebfc3a89e4', 'volume_name': 'volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:48:40 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7c78df0b-1bc1-4617-b59f-56e9e08d3416 tempest-GroupSnapshotsTest-1497579122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c779ad16-77c8-47bf-a765-ac8dd9166d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:40 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7c78df0b-1bc1-4617-b59f-56e9e08d3416 tempest-GroupSnapshotsTest-1497579122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c779ad16-77c8-47bf-a765-ac8dd9166d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:48:40 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7c78df0b-1bc1-4617-b59f-56e9e08d3416 tempest-GroupSnapshotsTest-1497579122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8958dcf5-cc39-460f-a4f9-02a4df21eab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:40 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-7c78df0b-1bc1-4617-b59f-56e9e08d3416 tempest-GroupSnapshotsTest-1497579122 None] Volume 6d342976-9deb-44d7-b8b7-fdebfc3a89e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4', 'volume_size': 1}
Jul 10 12:48:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-7c78df0b-1bc1-4617-b59f-56e9e08d3416 tempest-GroupSnapshotsTest-1497579122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:48:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6276600c-2208-4d13-983d-14216dc9b91b tempest-CinderUnicodeTest-1254226005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7" returned: 0 in 1.234s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6276600c-2208-4d13-983d-14216dc9b91b tempest-CinderUnicodeTest-1254226005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7.02739150-2183-4d3d-aaf8-309a6f43011c 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:40 devstack sudo[99166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7.02739150-2183-4d3d-aaf8-309a6f43011c 1G
Jul 10 12:48:40 devstack sudo[99166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:40 devstack sudo[99160]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f201aa53-8e56-4f8e-89e0-94ebe3b540ee tempest-TestInstancesWithCinderVolumes-1856690417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.865s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:40 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-f201aa53-8e56-4f8e-89e0-94ebe3b540ee tempest-TestInstancesWithCinderVolumes-1856690417 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:48:40 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-f201aa53-8e56-4f8e-89e0-94ebe3b540ee tempest-TestInstancesWithCinderVolumes-1856690417 None] Deleted volume successfully.
Jul 10 12:48:40 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f201aa53-8e56-4f8e-89e0-94ebe3b540ee tempest-TestInstancesWithCinderVolumes-1856690417 None] Lock "cinder-22def002-3e0c-4802-903b-1ec123510c2d-delete_volume" released by "delete_volume" :: held 3.959s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:48:41 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8247805e-b3ca-46c6-827e-05df1106d935 tempest-SnapshotsActionsTest-1562062894 None] Acquiring lock "cinder-0a5c42b6-f07a-4c65-99aa-d98aee036c23-delete_snapshot" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:48:41 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8247805e-b3ca-46c6-827e-05df1106d935 tempest-SnapshotsActionsTest-1562062894 None] Lock "cinder-0a5c42b6-f07a-4c65-99aa-d98aee036c23-delete_snapshot" acquired by "delete_snapshot" :: waited 0.075s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:48:41 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8247805e-b3ca-46c6-827e-05df1106d935 tempest-SnapshotsActionsTest-1562062894 None] Acquiring lock "cinder-quobyte-3e645700-a883-4de8-83a0-309080c6985e" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:48:41 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8247805e-b3ca-46c6-827e-05df1106d935 tempest-SnapshotsActionsTest-1562062894 None] Lock "cinder-quobyte-3e645700-a883-4de8-83a0-309080c6985e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:48:41 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8247805e-b3ca-46c6-827e-05df1106d935 tempest-SnapshotsActionsTest-1562062894 None] Acquiring lock "cinder-quobyte-0a5c42b6-f07a-4c65-99aa-d98aee036c23" by "_delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:48:41 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8247805e-b3ca-46c6-827e-05df1106d935 tempest-SnapshotsActionsTest-1562062894 None] Lock "cinder-quobyte-0a5c42b6-f07a-4c65-99aa-d98aee036c23" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:48:41 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-8247805e-b3ca-46c6-827e-05df1106d935 tempest-SnapshotsActionsTest-1562062894 None] Deleting offline snapshot 0a5c42b6-f07a-4c65-99aa-d98aee036c23 of volume 3e645700-a883-4de8-83a0-309080c6985e {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 10 12:48:41 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-8247805e-b3ca-46c6-827e-05df1106d935 tempest-SnapshotsActionsTest-1562062894 None] snapshot_file for this snap is: volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 10 12:48:41 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e754bbf3-73cf-49cc-80f1-6aaa386e1a91]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:48:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8247805e-b3ca-46c6-827e-05df1106d935 tempest-SnapshotsActionsTest-1562062894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:41 devstack sudo[99168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23
Jul 10 12:48:41 devstack sudo[99168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:41 devstack sudo[99166]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6276600c-2208-4d13-983d-14216dc9b91b tempest-CinderUnicodeTest-1254226005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7.02739150-2183-4d3d-aaf8-309a6f43011c 1G" returned: 0 in 0.955s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6276600c-2208-4d13-983d-14216dc9b91b tempest-CinderUnicodeTest-1254226005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7.02739150-2183-4d3d-aaf8-309a6f43011c {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:41 devstack sudo[99173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7.02739150-2183-4d3d-aaf8-309a6f43011c
Jul 10 12:48:41 devstack sudo[99173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:42 devstack sudo[99168]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8247805e-b3ca-46c6-827e-05df1106d935 tempest-SnapshotsActionsTest-1562062894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23" returned: 0 in 0.910s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:42 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-8247805e-b3ca-46c6-827e-05df1106d935 tempest-SnapshotsActionsTest-1562062894 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e645700-a883-4de8-83a0-309080c6985e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:48:42 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d47733-a81b-4e5d-acb1-a3998909aa68]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:48:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8247805e-b3ca-46c6-827e-05df1106d935 tempest-SnapshotsActionsTest-1562062894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:42 devstack sudo[99179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e
Jul 10 12:48:42 devstack sudo[99179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:42 devstack sudo[99173]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6276600c-2208-4d13-983d-14216dc9b91b tempest-CinderUnicodeTest-1254226005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7.02739150-2183-4d3d-aaf8-309a6f43011c" returned: 0 in 0.799s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:42 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-6276600c-2208-4d13-983d-14216dc9b91b tempest-CinderUnicodeTest-1254226005 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7.02739150-2183-4d3d-aaf8-309a6f43011c is being set with open permissions: ugo+rw
Jul 10 12:48:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6276600c-2208-4d13-983d-14216dc9b91b tempest-CinderUnicodeTest-1254226005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7.02739150-2183-4d3d-aaf8-309a6f43011c {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:42 devstack sudo[99185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7.02739150-2183-4d3d-aaf8-309a6f43011c
Jul 10 12:48:42 devstack sudo[99185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:43 devstack sudo[99179]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8247805e-b3ca-46c6-827e-05df1106d935 tempest-SnapshotsActionsTest-1562062894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e" returned: 0 in 0.894s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8247805e-b3ca-46c6-827e-05df1106d935 tempest-SnapshotsActionsTest-1562062894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:43 devstack sudo[99191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23
Jul 10 12:48:43 devstack sudo[99191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:43 devstack sudo[99185]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6276600c-2208-4d13-983d-14216dc9b91b tempest-CinderUnicodeTest-1254226005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7.02739150-2183-4d3d-aaf8-309a6f43011c" returned: 0 in 0.732s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6276600c-2208-4d13-983d-14216dc9b91b tempest-CinderUnicodeTest-1254226005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:43 devstack sudo[99193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7.info
Jul 10 12:48:43 devstack sudo[99193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:43 devstack sudo[99191]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8247805e-b3ca-46c6-827e-05df1106d935 tempest-SnapshotsActionsTest-1562062894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23" returned: 0 in 0.817s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8247805e-b3ca-46c6-827e-05df1106d935 tempest-SnapshotsActionsTest-1562062894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:43 devstack sudo[99200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23
Jul 10 12:48:43 devstack sudo[99200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:43 devstack sudo[99193]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6276600c-2208-4d13-983d-14216dc9b91b tempest-CinderUnicodeTest-1254226005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7.info" returned: 0 in 0.731s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:43 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-6276600c-2208-4d13-983d-14216dc9b91b tempest-CinderUnicodeTest-1254226005 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7.info is being set with open permissions: ugo+rw
Jul 10 12:48:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6276600c-2208-4d13-983d-14216dc9b91b tempest-CinderUnicodeTest-1254226005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:44 devstack sudo[99202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7.info
Jul 10 12:48:44 devstack sudo[99202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:44 devstack sudo[99200]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8247805e-b3ca-46c6-827e-05df1106d935 tempest-SnapshotsActionsTest-1562062894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e.0a5c42b6-f07a-4c65-99aa-d98aee036c23" returned: 0 in 0.691s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:44 devstack sudo[99202]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6276600c-2208-4d13-983d-14216dc9b91b tempest-CinderUnicodeTest-1254226005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7.info" returned: 0 in 0.740s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-6276600c-2208-4d13-983d-14216dc9b91b tempest-CinderUnicodeTest-1254226005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.311s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:48:44 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8247805e-b3ca-46c6-827e-05df1106d935 tempest-SnapshotsActionsTest-1562062894 None] Lock "cinder-quobyte-0a5c42b6-f07a-4c65-99aa-d98aee036c23" released by "_delete_snapshot" :: held 3.510s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:48:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-7c78df0b-1bc1-4617-b59f-56e9e08d3416 tempest-GroupSnapshotsTest-1497579122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.044s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:48:44 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-7c78df0b-1bc1-4617-b59f-56e9e08d3416 tempest-GroupSnapshotsTest-1497579122 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=7470aaf4-5c3e-4308-a4ae-5bcd4ae50fc5,created_at=2026-07-10T10:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1657653507',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7470aaf4-5c3e-4308-a4ae-5bcd4ae50fc5,host='devstack@QuobyteHD#QuobyteHD',id=6d342976-9deb-44d7-b8b7-fdebfc3a89e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca795075de2f45bf8c75eaa6d162dc93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:48:40Z,use_quota=True,user_id='662d32fbb232435a8c88e72656348521',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(759dd9b6-061d-48d4-b172-3fc3a9ac37ff),volume_type_id=759dd9b6-061d-48d4-b172-3fc3a9ac37ff)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:48:44 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-7c78df0b-1bc1-4617-b59f-56e9e08d3416 tempest-GroupSnapshotsTest-1497579122 None] Creating volume 6d342976-9deb-44d7-b8b7-fdebfc3a89e4 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:48:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-7c78df0b-1bc1-4617-b59f-56e9e08d3416 tempest-GroupSnapshotsTest-1497579122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:48:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-7c78df0b-1bc1-4617-b59f-56e9e08d3416 tempest-GroupSnapshotsTest-1497579122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:48:44 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-7c78df0b-1bc1-4617-b59f-56e9e08d3416 tempest-GroupSnapshotsTest-1497579122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:48:44 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-7c78df0b-1bc1-4617-b59f-56e9e08d3416 tempest-GroupSnapshotsTest-1497579122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:48:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-7c78df0b-1bc1-4617-b59f-56e9e08d3416 tempest-GroupSnapshotsTest-1497579122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:48:44 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-7c78df0b-1bc1-4617-b59f-56e9e08d3416 tempest-GroupSnapshotsTest-1497579122 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:48:44 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-7c78df0b-1bc1-4617-b59f-56e9e08d3416 tempest-GroupSnapshotsTest-1497579122 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:48:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7c78df0b-1bc1-4617-b59f-56e9e08d3416 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:44 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8247805e-b3ca-46c6-827e-05df1106d935 tempest-SnapshotsActionsTest-1562062894 None] Lock "cinder-quobyte-3e645700-a883-4de8-83a0-309080c6985e" released by "delete_snapshot" :: held 3.570s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:48:44 devstack sudo[99206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4 1073741824
Jul 10 12:48:44 devstack sudo[99206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:44 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-6276600c-2208-4d13-983d-14216dc9b91b tempest-CinderUnicodeTest-1254226005 None] Create snapshot completed successfully
Jul 10 12:48:44 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-8247805e-b3ca-46c6-827e-05df1106d935 tempest-SnapshotsActionsTest-1562062894 None] Created reservations ['f648a21a-dfd4-4c66-9886-12c874bd5cff', '9757ad59-8686-43af-81cb-fc7472e61bc6', 'd4668a89-ea72-412b-82e8-f0f35772de0d', '4203d5d4-30a1-493b-bee2-b48835b1d815'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:48:44 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-8247805e-b3ca-46c6-827e-05df1106d935 tempest-SnapshotsActionsTest-1562062894 None] Delete snapshot completed successfully.
Jul 10 12:48:44 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8247805e-b3ca-46c6-827e-05df1106d935 tempest-SnapshotsActionsTest-1562062894 None] Lock "cinder-0a5c42b6-f07a-4c65-99aa-d98aee036c23-delete_snapshot" released by "delete_snapshot" :: held 3.729s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:48:45 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-7a37cebf-3199-444a-b1ed-46b8978667da tempest-SnapshotsActionsTest-1562062894 None] Acquiring lock "cinder-3e645700-a883-4de8-83a0-309080c6985e-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:48:45 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-7a37cebf-3199-444a-b1ed-46b8978667da tempest-SnapshotsActionsTest-1562062894 None] Lock "cinder-3e645700-a883-4de8-83a0-309080c6985e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:48:45 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-7a37cebf-3199-444a-b1ed-46b8978667da tempest-SnapshotsActionsTest-1562062894 None] Acquiring lock "cinder-quobyte-3e645700-a883-4de8-83a0-309080c6985e" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:48:45 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-7a37cebf-3199-444a-b1ed-46b8978667da tempest-SnapshotsActionsTest-1562062894 None] Lock "cinder-quobyte-3e645700-a883-4de8-83a0-309080c6985e" acquired by "delete_volume" :: waited 0.021s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:48:45 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-ff24be7b-6054-4de9-b0af-57df375e3de3 tempest-CinderUnicodeTest-1254226005 None] Acquiring lock "cinder-02739150-2183-4d3d-aaf8-309a6f43011c-delete_snapshot" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:48:45 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[53973b7a-e456-4b61-808d-4a9669d72f4a]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:48:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7a37cebf-3199-444a-b1ed-46b8978667da tempest-SnapshotsActionsTest-1562062894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:45 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-ff24be7b-6054-4de9-b0af-57df375e3de3 tempest-CinderUnicodeTest-1254226005 None] Lock "cinder-02739150-2183-4d3d-aaf8-309a6f43011c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:48:45 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-ff24be7b-6054-4de9-b0af-57df375e3de3 tempest-CinderUnicodeTest-1254226005 None] Acquiring lock "cinder-quobyte-cf9f56e3-3b08-4217-a1f6-f617b64812f7" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:48:45 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-ff24be7b-6054-4de9-b0af-57df375e3de3 tempest-CinderUnicodeTest-1254226005 None] Lock "cinder-quobyte-cf9f56e3-3b08-4217-a1f6-f617b64812f7" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:48:45 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-ff24be7b-6054-4de9-b0af-57df375e3de3 tempest-CinderUnicodeTest-1254226005 None] Acquiring lock "cinder-quobyte-02739150-2183-4d3d-aaf8-309a6f43011c" by "_delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:48:45 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-ff24be7b-6054-4de9-b0af-57df375e3de3 tempest-CinderUnicodeTest-1254226005 None] Lock "cinder-quobyte-02739150-2183-4d3d-aaf8-309a6f43011c" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:48:45 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-ff24be7b-6054-4de9-b0af-57df375e3de3 tempest-CinderUnicodeTest-1254226005 None] Deleting offline snapshot 02739150-2183-4d3d-aaf8-309a6f43011c of volume cf9f56e3-3b08-4217-a1f6-f617b64812f7 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 10 12:48:45 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-ff24be7b-6054-4de9-b0af-57df375e3de3 tempest-CinderUnicodeTest-1254226005 None] snapshot_file for this snap is: volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7.02739150-2183-4d3d-aaf8-309a6f43011c {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 10 12:48:45 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c9f15e-2fc7-4d20-8955-f753ad2962a8]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:48:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ff24be7b-6054-4de9-b0af-57df375e3de3 tempest-CinderUnicodeTest-1254226005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7.02739150-2183-4d3d-aaf8-309a6f43011c {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:45 devstack sudo[99212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e
Jul 10 12:48:45 devstack sudo[99212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:45 devstack sudo[99206]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7c78df0b-1bc1-4617-b59f-56e9e08d3416 tempest-GroupSnapshotsTest-1497579122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4 1073741824" returned: 0 in 1.153s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:45 devstack sudo[99213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7.02739150-2183-4d3d-aaf8-309a6f43011c
Jul 10 12:48:45 devstack sudo[99213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7c78df0b-1bc1-4617-b59f-56e9e08d3416 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:45 devstack sudo[99216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4
Jul 10 12:48:46 devstack sudo[99216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:46 devstack sudo[99216]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7c78df0b-1bc1-4617-b59f-56e9e08d3416 tempest-GroupSnapshotsTest-1497579122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4" returned: 0 in 0.812s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:46 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-7c78df0b-1bc1-4617-b59f-56e9e08d3416 tempest-GroupSnapshotsTest-1497579122 None] <== create_volume: return (2013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:48:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-7c78df0b-1bc1-4617-b59f-56e9e08d3416 tempest-GroupSnapshotsTest-1497579122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.017s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:48:46 devstack sudo[99213]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ff24be7b-6054-4de9-b0af-57df375e3de3 tempest-CinderUnicodeTest-1254226005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7.02739150-2183-4d3d-aaf8-309a6f43011c" returned: 0 in 0.951s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:46 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-ff24be7b-6054-4de9-b0af-57df375e3de3 tempest-CinderUnicodeTest-1254226005 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:48:46 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61c9de5-a2e8-47b7-973c-f2c03aae4ca3]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:48:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ff24be7b-6054-4de9-b0af-57df375e3de3 tempest-CinderUnicodeTest-1254226005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:46 devstack sudo[99212]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:46 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7c78df0b-1bc1-4617-b59f-56e9e08d3416 tempest-GroupSnapshotsTest-1497579122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8958dcf5-cc39-460f-a4f9-02a4df21eab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:48:46 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7c78df0b-1bc1-4617-b59f-56e9e08d3416 tempest-GroupSnapshotsTest-1497579122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (183db698-c1ef-4ed8-b9d3-5844dadd96e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7a37cebf-3199-444a-b1ed-46b8978667da tempest-SnapshotsActionsTest-1562062894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e" returned: 0 in 1.197s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7a37cebf-3199-444a-b1ed-46b8978667da tempest-SnapshotsActionsTest-1562062894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:46 devstack sudo[99227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e
Jul 10 12:48:46 devstack sudo[99227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:46 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-7c78df0b-1bc1-4617-b59f-56e9e08d3416 tempest-GroupSnapshotsTest-1497579122 None] Volume volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4 (6d342976-9deb-44d7-b8b7-fdebfc3a89e4): created successfully
Jul 10 12:48:46 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7c78df0b-1bc1-4617-b59f-56e9e08d3416 tempest-GroupSnapshotsTest-1497579122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (183db698-c1ef-4ed8-b9d3-5844dadd96e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:48:46 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7c78df0b-1bc1-4617-b59f-56e9e08d3416 tempest-GroupSnapshotsTest-1497579122 None] Flow 'volume_create_manager' (c7f91460-a156-4707-b5b9-43fdcc3561bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:48:46 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-7c78df0b-1bc1-4617-b59f-56e9e08d3416 tempest-GroupSnapshotsTest-1497579122 None] Created volume successfully.
Jul 10 12:48:46 devstack sudo[99226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7
Jul 10 12:48:46 devstack sudo[99226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:47 devstack sudo[99227]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7a37cebf-3199-444a-b1ed-46b8978667da tempest-SnapshotsActionsTest-1562062894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3e645700-a883-4de8-83a0-309080c6985e" returned: 0 in 0.727s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:47 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-7a37cebf-3199-444a-b1ed-46b8978667da tempest-SnapshotsActionsTest-1562062894 None] Lock "cinder-quobyte-3e645700-a883-4de8-83a0-309080c6985e" released by "delete_volume" :: held 2.015s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:48:47 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-7a37cebf-3199-444a-b1ed-46b8978667da tempest-SnapshotsActionsTest-1562062894 None] Created reservations ['60e49709-33fc-4e40-9ce3-7f33949cc4ba', 'd227af21-0412-4969-b261-76757151295b', 'cf32a8d2-af7e-4e83-a40c-03b8af7e96a2', '88357361-b661-4120-8d15-3cdc0191659c'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:48:47 devstack sudo[99226]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ff24be7b-6054-4de9-b0af-57df375e3de3 tempest-CinderUnicodeTest-1254226005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7" returned: 0 in 0.932s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ff24be7b-6054-4de9-b0af-57df375e3de3 tempest-CinderUnicodeTest-1254226005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7.02739150-2183-4d3d-aaf8-309a6f43011c {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:47 devstack sudo[99236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7.02739150-2183-4d3d-aaf8-309a6f43011c
Jul 10 12:48:47 devstack sudo[99236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-7a37cebf-3199-444a-b1ed-46b8978667da tempest-SnapshotsActionsTest-1562062894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:48:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-7a37cebf-3199-444a-b1ed-46b8978667da tempest-SnapshotsActionsTest-1562062894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:48:47 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-7a37cebf-3199-444a-b1ed-46b8978667da tempest-SnapshotsActionsTest-1562062894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:48:47 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-7a37cebf-3199-444a-b1ed-46b8978667da tempest-SnapshotsActionsTest-1562062894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:48:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-7a37cebf-3199-444a-b1ed-46b8978667da tempest-SnapshotsActionsTest-1562062894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:48:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7a37cebf-3199-444a-b1ed-46b8978667da tempest-SnapshotsActionsTest-1562062894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:47 devstack sudo[99238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:48:47 devstack sudo[99238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:47 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-9501fec2-c938-425d-8fd8-4de1bfec46d9 tempest-GroupSnapshotsTest-1497579122 None] Update group completed successfully.
Jul 10 12:48:48 devstack sudo[99238]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7a37cebf-3199-444a-b1ed-46b8978667da tempest-SnapshotsActionsTest-1562062894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.753s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:48 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-7a37cebf-3199-444a-b1ed-46b8978667da tempest-SnapshotsActionsTest-1562062894 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:48:48 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-7a37cebf-3199-444a-b1ed-46b8978667da tempest-SnapshotsActionsTest-1562062894 None] Deleted volume successfully.
Jul 10 12:48:48 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-7a37cebf-3199-444a-b1ed-46b8978667da tempest-SnapshotsActionsTest-1562062894 None] Lock "cinder-3e645700-a883-4de8-83a0-309080c6985e-delete_volume" released by "delete_volume" :: held 3.074s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:48:48 devstack sudo[99236]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ff24be7b-6054-4de9-b0af-57df375e3de3 tempest-CinderUnicodeTest-1254226005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7.02739150-2183-4d3d-aaf8-309a6f43011c" returned: 0 in 0.847s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ff24be7b-6054-4de9-b0af-57df375e3de3 tempest-CinderUnicodeTest-1254226005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7.02739150-2183-4d3d-aaf8-309a6f43011c {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:48 devstack sudo[99244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7.02739150-2183-4d3d-aaf8-309a6f43011c
Jul 10 12:48:48 devstack sudo[99244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:49 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-c817bbe2-397e-46bb-913f-b7d09e221bef tempest-GroupSnapshotsTest-1497579122 None] Update group completed successfully.
Jul 10 12:48:49 devstack sudo[99244]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ff24be7b-6054-4de9-b0af-57df375e3de3 tempest-CinderUnicodeTest-1254226005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7.02739150-2183-4d3d-aaf8-309a6f43011c" returned: 0 in 0.840s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:49 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-ff24be7b-6054-4de9-b0af-57df375e3de3 tempest-CinderUnicodeTest-1254226005 None] Lock "cinder-quobyte-02739150-2183-4d3d-aaf8-309a6f43011c" released by "_delete_snapshot" :: held 3.729s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:48:49 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-ff24be7b-6054-4de9-b0af-57df375e3de3 tempest-CinderUnicodeTest-1254226005 None] Lock "cinder-quobyte-cf9f56e3-3b08-4217-a1f6-f617b64812f7" released by "delete_snapshot" :: held 3.772s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:48:49 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-ff24be7b-6054-4de9-b0af-57df375e3de3 tempest-CinderUnicodeTest-1254226005 None] Created reservations ['6417d1ca-3db3-4f7c-8f8a-1b753be46498', '11673d10-587f-49cf-acbe-3a788677bc5a', '2425b058-2f70-49ec-b708-2694bf2f4583', '9836ad62-3521-4b00-94d9-eabc70a1ff96'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:48:49 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-ff24be7b-6054-4de9-b0af-57df375e3de3 tempest-CinderUnicodeTest-1254226005 None] Delete snapshot completed successfully.
Jul 10 12:48:49 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-ff24be7b-6054-4de9-b0af-57df375e3de3 tempest-CinderUnicodeTest-1254226005 None] Lock "cinder-02739150-2183-4d3d-aaf8-309a6f43011c-delete_snapshot" released by "delete_snapshot" :: held 3.956s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:48:49 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-23d0155a-bdc1-4c86-9339-8d291ae5c261 tempest-CinderUnicodeTest-1254226005 None] Acquiring lock "cinder-cf9f56e3-3b08-4217-a1f6-f617b64812f7-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:48:49 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-23d0155a-bdc1-4c86-9339-8d291ae5c261 tempest-CinderUnicodeTest-1254226005 None] Lock "cinder-cf9f56e3-3b08-4217-a1f6-f617b64812f7-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:48:50 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-23d0155a-bdc1-4c86-9339-8d291ae5c261 tempest-CinderUnicodeTest-1254226005 None] Acquiring lock "cinder-quobyte-cf9f56e3-3b08-4217-a1f6-f617b64812f7" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:48:50 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-23d0155a-bdc1-4c86-9339-8d291ae5c261 tempest-CinderUnicodeTest-1254226005 None] Lock "cinder-quobyte-cf9f56e3-3b08-4217-a1f6-f617b64812f7" acquired by "delete_volume" :: waited 0.020s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:48:50 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad541b3-60bd-4d77-9956-44f1edba8397]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:48:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-23d0155a-bdc1-4c86-9339-8d291ae5c261 tempest-CinderUnicodeTest-1254226005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:50 devstack sudo[99249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7
Jul 10 12:48:50 devstack sudo[99249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:50 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-df79dcae-3c54-4d88-bc1e-25ca76eafbcc tempest-GroupSnapshotsTest-1497579122 None] Update group completed successfully.
Jul 10 12:48:51 devstack sudo[99249]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-23d0155a-bdc1-4c86-9339-8d291ae5c261 tempest-CinderUnicodeTest-1254226005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7" returned: 0 in 0.984s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-23d0155a-bdc1-4c86-9339-8d291ae5c261 tempest-CinderUnicodeTest-1254226005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:51 devstack sudo[99254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7
Jul 10 12:48:51 devstack sudo[99254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:51 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-fca235b9-602e-4cef-b4cb-274ad59e9bd1 tempest-GroupSnapshotsTest-1497579122 None] Update group completed successfully.
Jul 10 12:48:51 devstack sudo[99254]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-23d0155a-bdc1-4c86-9339-8d291ae5c261 tempest-CinderUnicodeTest-1254226005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-cf9f56e3-3b08-4217-a1f6-f617b64812f7" returned: 0 in 0.853s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:52 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-23d0155a-bdc1-4c86-9339-8d291ae5c261 tempest-CinderUnicodeTest-1254226005 None] Lock "cinder-quobyte-cf9f56e3-3b08-4217-a1f6-f617b64812f7" released by "delete_volume" :: held 1.931s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:48:52 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-23d0155a-bdc1-4c86-9339-8d291ae5c261 tempest-CinderUnicodeTest-1254226005 None] Created reservations ['76f2c661-e402-4190-ba8c-ef88bbcf3779', '3e52762c-8922-4fe3-8d46-000e291879fc', '12b54378-6bde-4129-b35b-b9cb13373d00', '27396daa-883d-4558-b349-beef2b29fadb'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:48:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-23d0155a-bdc1-4c86-9339-8d291ae5c261 tempest-CinderUnicodeTest-1254226005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:48:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-23d0155a-bdc1-4c86-9339-8d291ae5c261 tempest-CinderUnicodeTest-1254226005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:48:52 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-23d0155a-bdc1-4c86-9339-8d291ae5c261 tempest-CinderUnicodeTest-1254226005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:48:52 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-23d0155a-bdc1-4c86-9339-8d291ae5c261 tempest-CinderUnicodeTest-1254226005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:48:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-23d0155a-bdc1-4c86-9339-8d291ae5c261 tempest-CinderUnicodeTest-1254226005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:48:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-23d0155a-bdc1-4c86-9339-8d291ae5c261 tempest-CinderUnicodeTest-1254226005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:52 devstack sudo[99257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:48:52 devstack sudo[99257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:52 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-08dedc55-24da-4472-b658-e3c4b57ecb4f tempest-CinderUnicodeTest-1254226005 None] Acquiring lock "cinder-e4149450-cc9e-4c49-954d-e44091589089-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:48:52 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-08dedc55-24da-4472-b658-e3c4b57ecb4f tempest-CinderUnicodeTest-1254226005 None] Lock "cinder-e4149450-cc9e-4c49-954d-e44091589089-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:48:52 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-08dedc55-24da-4472-b658-e3c4b57ecb4f tempest-CinderUnicodeTest-1254226005 None] Acquiring lock "cinder-quobyte-e4149450-cc9e-4c49-954d-e44091589089" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:48:52 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-08dedc55-24da-4472-b658-e3c4b57ecb4f tempest-CinderUnicodeTest-1254226005 None] Lock "cinder-quobyte-e4149450-cc9e-4c49-954d-e44091589089" acquired by "delete_volume" :: waited 0.019s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:48:52 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b833a497-b127-4bf6-a865-0f25dcacafe3]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:48:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-08dedc55-24da-4472-b658-e3c4b57ecb4f tempest-CinderUnicodeTest-1254226005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e4149450-cc9e-4c49-954d-e44091589089 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:52 devstack sudo[99259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e4149450-cc9e-4c49-954d-e44091589089
Jul 10 12:48:52 devstack sudo[99259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:52 devstack sudo[99257]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-23d0155a-bdc1-4c86-9339-8d291ae5c261 tempest-CinderUnicodeTest-1254226005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.844s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:53 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-23d0155a-bdc1-4c86-9339-8d291ae5c261 tempest-CinderUnicodeTest-1254226005 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:48:53 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-23d0155a-bdc1-4c86-9339-8d291ae5c261 tempest-CinderUnicodeTest-1254226005 None] Deleted volume successfully.
Jul 10 12:48:53 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-23d0155a-bdc1-4c86-9339-8d291ae5c261 tempest-CinderUnicodeTest-1254226005 None] Lock "cinder-cf9f56e3-3b08-4217-a1f6-f617b64812f7-delete_volume" released by "delete_volume" :: held 3.047s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:48:53 devstack sudo[99259]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-08dedc55-24da-4472-b658-e3c4b57ecb4f tempest-CinderUnicodeTest-1254226005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e4149450-cc9e-4c49-954d-e44091589089" returned: 0 in 0.979s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-08dedc55-24da-4472-b658-e3c4b57ecb4f tempest-CinderUnicodeTest-1254226005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e4149450-cc9e-4c49-954d-e44091589089 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:53 devstack sudo[99266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e4149450-cc9e-4c49-954d-e44091589089
Jul 10 12:48:53 devstack sudo[99266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:53 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-a1166dfc-d623-4407-937f-50c20ff98d06 tempest-GroupSnapshotsTest-1497579122 None] GroupSnapshot 69c5d57d-1a25-41b8-93f4-dc03aec5cab7: creating.
Jul 10 12:48:53 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a1166dfc-d623-4407-937f-50c20ff98d06 tempest-GroupSnapshotsTest-1497579122 None] Group snapshot 69c5d57d-1a25-41b8-93f4-dc03aec5cab7: creating. {{(pid=87378) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 10 12:48:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a1166dfc-d623-4407-937f-50c20ff98d06 tempest-GroupSnapshotsTest-1497579122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:48:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a1166dfc-d623-4407-937f-50c20ff98d06 tempest-GroupSnapshotsTest-1497579122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:48:53 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-a1166dfc-d623-4407-937f-50c20ff98d06 tempest-GroupSnapshotsTest-1497579122 None] Creating offline snapshot 624096e7-323b-421a-9c26-5620665b61a3 of volume 6d342976-9deb-44d7-b8b7-fdebfc3a89e4 {{(pid=87378) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 10 12:48:53 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[34038d7d-126d-4127-94ce-7235a7f8e660]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:48:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a1166dfc-d623-4407-937f-50c20ff98d06 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:53 devstack sudo[99268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4
Jul 10 12:48:53 devstack sudo[99268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:54 devstack sudo[99266]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-08dedc55-24da-4472-b658-e3c4b57ecb4f tempest-CinderUnicodeTest-1254226005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e4149450-cc9e-4c49-954d-e44091589089" returned: 0 in 0.763s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:54 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-08dedc55-24da-4472-b658-e3c4b57ecb4f tempest-CinderUnicodeTest-1254226005 None] Lock "cinder-quobyte-e4149450-cc9e-4c49-954d-e44091589089" released by "delete_volume" :: held 1.806s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:48:54 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-08dedc55-24da-4472-b658-e3c4b57ecb4f tempest-CinderUnicodeTest-1254226005 None] Created reservations ['92cf7add-4b51-4199-9fd3-3322ac64d926', 'bec031ff-3327-4f95-ab34-122e67916e85', 'cd519342-333e-4436-a33a-4b3dad98a179', '912fe818-cd7d-4bba-aac8-18dfe957203a'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:48:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-08dedc55-24da-4472-b658-e3c4b57ecb4f tempest-CinderUnicodeTest-1254226005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:48:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-08dedc55-24da-4472-b658-e3c4b57ecb4f tempest-CinderUnicodeTest-1254226005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:48:54 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-08dedc55-24da-4472-b658-e3c4b57ecb4f tempest-CinderUnicodeTest-1254226005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:48:54 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-08dedc55-24da-4472-b658-e3c4b57ecb4f tempest-CinderUnicodeTest-1254226005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:48:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-08dedc55-24da-4472-b658-e3c4b57ecb4f tempest-CinderUnicodeTest-1254226005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:48:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-08dedc55-24da-4472-b658-e3c4b57ecb4f tempest-CinderUnicodeTest-1254226005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:54 devstack sudo[99274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:48:54 devstack sudo[99274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:54 devstack sudo[99268]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a1166dfc-d623-4407-937f-50c20ff98d06 tempest-GroupSnapshotsTest-1497579122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4" returned: 0 in 0.934s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a1166dfc-d623-4407-937f-50c20ff98d06 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4.624096e7-323b-421a-9c26-5620665b61a3 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:54 devstack sudo[99276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4.624096e7-323b-421a-9c26-5620665b61a3 1G
Jul 10 12:48:54 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-3be60d94-2eb8-4710-9373-95c1f1734ded tempest-CreateVolumesFromImageTest-967432040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:48:54 devstack sudo[99276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3be60d94-2eb8-4710-9373-95c1f1734ded tempest-CreateVolumesFromImageTest-967432040 None] Flow 'volume_create_manager' (fbbd78aa-98e8-4508-b2e5-2abd90bcdad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:48:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3be60d94-2eb8-4710-9373-95c1f1734ded tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa60566a-045d-4056-9764-0750f9500080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3be60d94-2eb8-4710-9373-95c1f1734ded tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa60566a-045d-4056-9764-0750f9500080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:48:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1037800229',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91ebe59a-90d5-4717-8813-d55dd0ee9efb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de734d647f8c44de94823035bae13e6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:48:54Z,use_quota=True,user_id='57020c11374b469aab0c5b09c0fab80a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:48:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3be60d94-2eb8-4710-9373-95c1f1734ded tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64aa7b6a-5b30-4ed4-ad1f-aa9ef2eab3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3be60d94-2eb8-4710-9373-95c1f1734ded tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64aa7b6a-5b30-4ed4-ad1f-aa9ef2eab3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:48:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3be60d94-2eb8-4710-9373-95c1f1734ded tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d0db732-1c98-4e25-bf6f-303a0e85097e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3be60d94-2eb8-4710-9373-95c1f1734ded tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d0db732-1c98-4e25-bf6f-303a0e85097e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91ebe59a-90d5-4717-8813-d55dd0ee9efb', 'volume_name': 'volume-91ebe59a-90d5-4717-8813-d55dd0ee9efb', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:48:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3be60d94-2eb8-4710-9373-95c1f1734ded tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8149884a-c430-40c0-9fdb-18468357fef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3be60d94-2eb8-4710-9373-95c1f1734ded tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8149884a-c430-40c0-9fdb-18468357fef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:48:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3be60d94-2eb8-4710-9373-95c1f1734ded tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2853ddf2-194b-4eae-a4ec-daee488f766b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:54 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-3be60d94-2eb8-4710-9373-95c1f1734ded tempest-CreateVolumesFromImageTest-967432040 None] Volume 91ebe59a-90d5-4717-8813-d55dd0ee9efb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91ebe59a-90d5-4717-8813-d55dd0ee9efb', 'volume_size': 1}
Jul 10 12:48:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3be60d94-2eb8-4710-9373-95c1f1734ded tempest-CreateVolumesFromImageTest-967432040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:48:55 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-f32b112a-3c7d-46af-902f-03b8b8cb4024 tempest-CreateVolumesFromImageTest-967432040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:48:55 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f32b112a-3c7d-46af-902f-03b8b8cb4024 tempest-CreateVolumesFromImageTest-967432040 None] Flow 'volume_create_manager' (ec84ba02-c8f7-46c5-b2ef-f7fa0455b0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:48:55 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f32b112a-3c7d-46af-902f-03b8b8cb4024 tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eb7de3d-4d77-4dd0-b39c-5d66d6332ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:55 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f32b112a-3c7d-46af-902f-03b8b8cb4024 tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eb7de3d-4d77-4dd0-b39c-5d66d6332ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1128940591',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e2cd746-0836-47cb-81c6-3ac85661de69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de734d647f8c44de94823035bae13e6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:48:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:48:55Z,use_quota=True,user_id='57020c11374b469aab0c5b09c0fab80a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:48:55 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f32b112a-3c7d-46af-902f-03b8b8cb4024 tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (785daba3-24db-4792-a9bc-1138db15e4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:55 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f32b112a-3c7d-46af-902f-03b8b8cb4024 tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (785daba3-24db-4792-a9bc-1138db15e4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:48:55 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f32b112a-3c7d-46af-902f-03b8b8cb4024 tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6535aca-f782-4ac8-992d-556a79f63f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:55 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f32b112a-3c7d-46af-902f-03b8b8cb4024 tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6535aca-f782-4ac8-992d-556a79f63f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e2cd746-0836-47cb-81c6-3ac85661de69', 'volume_name': 'volume-8e2cd746-0836-47cb-81c6-3ac85661de69', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:48:55 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f32b112a-3c7d-46af-902f-03b8b8cb4024 tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (628a1ca0-981b-4b86-9f22-6e08b73c0d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:55 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f32b112a-3c7d-46af-902f-03b8b8cb4024 tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (628a1ca0-981b-4b86-9f22-6e08b73c0d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:48:55 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f32b112a-3c7d-46af-902f-03b8b8cb4024 tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (764d4a86-66cb-4256-9c19-2e9fee99181c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:55 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-f32b112a-3c7d-46af-902f-03b8b8cb4024 tempest-CreateVolumesFromImageTest-967432040 None] Volume 8e2cd746-0836-47cb-81c6-3ac85661de69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e2cd746-0836-47cb-81c6-3ac85661de69', 'volume_size': 1}
Jul 10 12:48:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f32b112a-3c7d-46af-902f-03b8b8cb4024 tempest-CreateVolumesFromImageTest-967432040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:48:55 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-2977b03a-9f63-4ab4-b5d1-6a21be1b4bbf tempest-CreateVolumesFromImageTest-967432040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:48:55 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2977b03a-9f63-4ab4-b5d1-6a21be1b4bbf tempest-CreateVolumesFromImageTest-967432040 None] Flow 'volume_create_manager' (d6ef4952-f995-4b33-8489-1f833515704b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:48:55 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2977b03a-9f63-4ab4-b5d1-6a21be1b4bbf tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cda17349-ad04-4a19-9c01-14e3d5e3b152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:55 devstack sudo[99276]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:55 devstack sudo[99274]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a1166dfc-d623-4407-937f-50c20ff98d06 tempest-GroupSnapshotsTest-1497579122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4.624096e7-323b-421a-9c26-5620665b61a3 1G" returned: 0 in 1.063s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a1166dfc-d623-4407-937f-50c20ff98d06 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4.624096e7-323b-421a-9c26-5620665b61a3 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:55 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2977b03a-9f63-4ab4-b5d1-6a21be1b4bbf tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cda17349-ad04-4a19-9c01-14e3d5e3b152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-858979642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d083de1-a437-4d9c-ac8d-a05c7230681e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de734d647f8c44de94823035bae13e6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:48:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:48:55Z,use_quota=True,user_id='57020c11374b469aab0c5b09c0fab80a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:48:55 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2977b03a-9f63-4ab4-b5d1-6a21be1b4bbf tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bce11e12-363e-40ae-85a6-33d3b4d0a32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:55 devstack sudo[99284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4.624096e7-323b-421a-9c26-5620665b61a3
Jul 10 12:48:55 devstack sudo[99284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:55 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2977b03a-9f63-4ab4-b5d1-6a21be1b4bbf tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bce11e12-363e-40ae-85a6-33d3b4d0a32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:48:55 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2977b03a-9f63-4ab4-b5d1-6a21be1b4bbf tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a94337-45b2-4082-a881-1c1e80541586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:55 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2977b03a-9f63-4ab4-b5d1-6a21be1b4bbf tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a94337-45b2-4082-a881-1c1e80541586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d083de1-a437-4d9c-ac8d-a05c7230681e', 'volume_name': 'volume-3d083de1-a437-4d9c-ac8d-a05c7230681e', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:48:55 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2977b03a-9f63-4ab4-b5d1-6a21be1b4bbf tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b13e800-3a66-43f3-8c30-9064869718fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:55 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2977b03a-9f63-4ab4-b5d1-6a21be1b4bbf tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b13e800-3a66-43f3-8c30-9064869718fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:48:55 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2977b03a-9f63-4ab4-b5d1-6a21be1b4bbf tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3027624e-e572-4f44-b9b2-3e2942f3b7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:55 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-2977b03a-9f63-4ab4-b5d1-6a21be1b4bbf tempest-CreateVolumesFromImageTest-967432040 None] Volume 3d083de1-a437-4d9c-ac8d-a05c7230681e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d083de1-a437-4d9c-ac8d-a05c7230681e', 'volume_size': 1}
Jul 10 12:48:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2977b03a-9f63-4ab4-b5d1-6a21be1b4bbf tempest-CreateVolumesFromImageTest-967432040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:48:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-08dedc55-24da-4472-b658-e3c4b57ecb4f tempest-CinderUnicodeTest-1254226005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 1.275s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:55 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-08dedc55-24da-4472-b658-e3c4b57ecb4f tempest-CinderUnicodeTest-1254226005 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:48:55 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-08dedc55-24da-4472-b658-e3c4b57ecb4f tempest-CinderUnicodeTest-1254226005 None] Deleted volume successfully.
Jul 10 12:48:55 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-08dedc55-24da-4472-b658-e3c4b57ecb4f tempest-CinderUnicodeTest-1254226005 None] Lock "cinder-e4149450-cc9e-4c49-954d-e44091589089-delete_volume" released by "delete_volume" :: held 3.422s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:48:56 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-18f088b8-6d83-4b92-b16a-301ff6d31aac tempest-CreateVolumesFromImageTest-967432040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:48:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-18f088b8-6d83-4b92-b16a-301ff6d31aac tempest-CreateVolumesFromImageTest-967432040 None] Flow 'volume_create_manager' (18192a48-a133-4dd7-b476-4859556a4518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:48:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-18f088b8-6d83-4b92-b16a-301ff6d31aac tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ec3a161-ad39-4832-a902-815925b407a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-18f088b8-6d83-4b92-b16a-301ff6d31aac tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ec3a161-ad39-4832-a902-815925b407a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:48:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-553034455',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d619009-3881-4c8e-a00d-e28b9258d941,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de734d647f8c44de94823035bae13e6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:48:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:48:56Z,use_quota=True,user_id='57020c11374b469aab0c5b09c0fab80a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:48:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-18f088b8-6d83-4b92-b16a-301ff6d31aac tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba43cf51-aab1-425e-b43f-1b0c4cb71ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-18f088b8-6d83-4b92-b16a-301ff6d31aac tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba43cf51-aab1-425e-b43f-1b0c4cb71ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:48:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-18f088b8-6d83-4b92-b16a-301ff6d31aac tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50b12885-e26a-4b4a-bf6e-c8c0ae1e6b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-18f088b8-6d83-4b92-b16a-301ff6d31aac tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50b12885-e26a-4b4a-bf6e-c8c0ae1e6b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d619009-3881-4c8e-a00d-e28b9258d941', 'volume_name': 'volume-3d619009-3881-4c8e-a00d-e28b9258d941', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:48:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-18f088b8-6d83-4b92-b16a-301ff6d31aac tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (695a0bb5-e48a-4a99-abfb-ea5ab297eb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-18f088b8-6d83-4b92-b16a-301ff6d31aac tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (695a0bb5-e48a-4a99-abfb-ea5ab297eb25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:48:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-18f088b8-6d83-4b92-b16a-301ff6d31aac tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e9a44e7-f2ff-4acc-8715-fe5273323438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:56 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-18f088b8-6d83-4b92-b16a-301ff6d31aac tempest-CreateVolumesFromImageTest-967432040 None] Volume 3d619009-3881-4c8e-a00d-e28b9258d941: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d619009-3881-4c8e-a00d-e28b9258d941', 'volume_size': 1}
Jul 10 12:48:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-18f088b8-6d83-4b92-b16a-301ff6d31aac tempest-CreateVolumesFromImageTest-967432040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:48:56 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-10901ba9-bc61-4bd8-a393-e19185ce76f1 tempest-CreateVolumesFromImageTest-967432040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:48:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-10901ba9-bc61-4bd8-a393-e19185ce76f1 tempest-CreateVolumesFromImageTest-967432040 None] Flow 'volume_create_manager' (edf1f76b-728b-4f58-ae8e-1dcda0a80390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:48:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-10901ba9-bc61-4bd8-a393-e19185ce76f1 tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87f77d96-3501-41ca-ad38-57b5dc6780bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-10901ba9-bc61-4bd8-a393-e19185ce76f1 tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87f77d96-3501-41ca-ad38-57b5dc6780bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:48:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1648943824',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94e03b89-9a17-4d4f-96b2-dc48da005206,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de734d647f8c44de94823035bae13e6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:48:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:48:56Z,use_quota=True,user_id='57020c11374b469aab0c5b09c0fab80a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:48:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-10901ba9-bc61-4bd8-a393-e19185ce76f1 tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c22bfc8-f675-4d2a-8595-8b4615ab0d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-10901ba9-bc61-4bd8-a393-e19185ce76f1 tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c22bfc8-f675-4d2a-8595-8b4615ab0d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:48:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-10901ba9-bc61-4bd8-a393-e19185ce76f1 tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86003e1d-a1dd-4d3e-9a34-4b3e79600041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-10901ba9-bc61-4bd8-a393-e19185ce76f1 tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86003e1d-a1dd-4d3e-9a34-4b3e79600041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94e03b89-9a17-4d4f-96b2-dc48da005206', 'volume_name': 'volume-94e03b89-9a17-4d4f-96b2-dc48da005206', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:48:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-10901ba9-bc61-4bd8-a393-e19185ce76f1 tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a79b58e3-2c41-4fff-a821-86465af2a5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-10901ba9-bc61-4bd8-a393-e19185ce76f1 tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a79b58e3-2c41-4fff-a821-86465af2a5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:48:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-10901ba9-bc61-4bd8-a393-e19185ce76f1 tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce40c824-9de1-49b2-a907-5cab0db605da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:48:56 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-10901ba9-bc61-4bd8-a393-e19185ce76f1 tempest-CreateVolumesFromImageTest-967432040 None] Volume 94e03b89-9a17-4d4f-96b2-dc48da005206: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94e03b89-9a17-4d4f-96b2-dc48da005206', 'volume_size': 1}
Jul 10 12:48:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-10901ba9-bc61-4bd8-a393-e19185ce76f1 tempest-CreateVolumesFromImageTest-967432040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:48:56 devstack sudo[99284]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a1166dfc-d623-4407-937f-50c20ff98d06 tempest-GroupSnapshotsTest-1497579122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4.624096e7-323b-421a-9c26-5620665b61a3" returned: 0 in 1.031s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:56 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-a1166dfc-d623-4407-937f-50c20ff98d06 tempest-GroupSnapshotsTest-1497579122 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4.624096e7-323b-421a-9c26-5620665b61a3 is being set with open permissions: ugo+rw: NotImplementedError
Jul 10 12:48:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a1166dfc-d623-4407-937f-50c20ff98d06 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4.624096e7-323b-421a-9c26-5620665b61a3 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:56 devstack sudo[99293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4.624096e7-323b-421a-9c26-5620665b61a3
Jul 10 12:48:56 devstack sudo[99293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:57 devstack sudo[99293]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a1166dfc-d623-4407-937f-50c20ff98d06 tempest-GroupSnapshotsTest-1497579122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4.624096e7-323b-421a-9c26-5620665b61a3" returned: 0 in 0.695s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a1166dfc-d623-4407-937f-50c20ff98d06 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:57 devstack sudo[99296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4.info
Jul 10 12:48:57 devstack sudo[99296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:58 devstack sudo[99296]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a1166dfc-d623-4407-937f-50c20ff98d06 tempest-GroupSnapshotsTest-1497579122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4.info" returned: 0 in 0.710s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:58 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-a1166dfc-d623-4407-937f-50c20ff98d06 tempest-GroupSnapshotsTest-1497579122 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 10 12:48:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a1166dfc-d623-4407-937f-50c20ff98d06 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:58 devstack sudo[99299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4.info
Jul 10 12:48:58 devstack sudo[99299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:58 devstack sudo[99299]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a1166dfc-d623-4407-937f-50c20ff98d06 tempest-GroupSnapshotsTest-1497579122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4.info" returned: 0 in 0.660s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a1166dfc-d623-4407-937f-50c20ff98d06 tempest-GroupSnapshotsTest-1497579122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.218s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:48:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a1166dfc-d623-4407-937f-50c20ff98d06 tempest-GroupSnapshotsTest-1497579122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:48:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a1166dfc-d623-4407-937f-50c20ff98d06 tempest-GroupSnapshotsTest-1497579122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:48:58 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-a1166dfc-d623-4407-937f-50c20ff98d06 tempest-GroupSnapshotsTest-1497579122 None] Creating offline snapshot 73c546b7-ae78-405c-9e15-19e271e05599 of volume eaa22196-59d6-4ea0-af8b-199c442a5a4e {{(pid=87378) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 10 12:48:58 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d6e3d0-ece1-4843-9436-ceee4688a2f6]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:48:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a1166dfc-d623-4407-937f-50c20ff98d06 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:58 devstack sudo[99302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e
Jul 10 12:48:58 devstack sudo[99302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:48:59 devstack sudo[99302]: pam_unix(sudo:session): session closed for user root
Jul 10 12:48:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a1166dfc-d623-4407-937f-50c20ff98d06 tempest-GroupSnapshotsTest-1497579122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e" returned: 0 in 0.777s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:48:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a1166dfc-d623-4407-937f-50c20ff98d06 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e.73c546b7-ae78-405c-9e15-19e271e05599 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:48:59 devstack sudo[99310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e.73c546b7-ae78-405c-9e15-19e271e05599 1G
Jul 10 12:48:59 devstack sudo[99310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:00 devstack sudo[99310]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a1166dfc-d623-4407-937f-50c20ff98d06 tempest-GroupSnapshotsTest-1497579122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e.73c546b7-ae78-405c-9e15-19e271e05599 1G" returned: 0 in 0.863s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a1166dfc-d623-4407-937f-50c20ff98d06 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e.73c546b7-ae78-405c-9e15-19e271e05599 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:00 devstack sudo[99315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e.73c546b7-ae78-405c-9e15-19e271e05599
Jul 10 12:49:00 devstack sudo[99315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:01 devstack sudo[99315]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a1166dfc-d623-4407-937f-50c20ff98d06 tempest-GroupSnapshotsTest-1497579122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e.73c546b7-ae78-405c-9e15-19e271e05599" returned: 0 in 0.694s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:01 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-a1166dfc-d623-4407-937f-50c20ff98d06 tempest-GroupSnapshotsTest-1497579122 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e.73c546b7-ae78-405c-9e15-19e271e05599 is being set with open permissions: ugo+rw: NotImplementedError
Jul 10 12:49:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a1166dfc-d623-4407-937f-50c20ff98d06 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e.73c546b7-ae78-405c-9e15-19e271e05599 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:01 devstack sudo[99320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e.73c546b7-ae78-405c-9e15-19e271e05599
Jul 10 12:49:01 devstack sudo[99320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:01 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e8f9178-5a77-490f-822a-bcebd1d3df08 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:49:01 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5e8f9178-5a77-490f-822a-bcebd1d3df08 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Flow 'volume_create_manager' (460529ca-f7aa-4143-84ec-83f3ec94e0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:49:01 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5e8f9178-5a77-490f-822a-bcebd1d3df08 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (815ca285-3a6a-4084-b852-73e8a2b4ea15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:01 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5e8f9178-5a77-490f-822a-bcebd1d3df08 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (815ca285-3a6a-4084-b852-73e8a2b4ea15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:49:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-787156723',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad9058c7-2edc-4c02-bb7c-a0a0c8f39552,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b767fd10c944debb22b8dc4f32a2565',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:49:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:49:02Z,use_quota=True,user_id='e867907c3ad843f1baff4a7107d1358b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79990546-43ef-49be-9caa-b849ccd1bf32),volume_type_id=79990546-43ef-49be-9caa-b849ccd1bf32)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:01 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5e8f9178-5a77-490f-822a-bcebd1d3df08 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52e68aca-e26f-4ba6-904a-c55ba478cc17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:01 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5e8f9178-5a77-490f-822a-bcebd1d3df08 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52e68aca-e26f-4ba6-904a-c55ba478cc17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:01 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5e8f9178-5a77-490f-822a-bcebd1d3df08 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cac9dc05-62e0-4832-9a05-dc8e3f9dbc1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:01 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5e8f9178-5a77-490f-822a-bcebd1d3df08 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cac9dc05-62e0-4832-9a05-dc8e3f9dbc1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad9058c7-2edc-4c02-bb7c-a0a0c8f39552', 'volume_name': 'volume-ad9058c7-2edc-4c02-bb7c-a0a0c8f39552', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:01 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5e8f9178-5a77-490f-822a-bcebd1d3df08 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c57ae919-9701-4dad-bfd1-fff6c32fecea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:01 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5e8f9178-5a77-490f-822a-bcebd1d3df08 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c57ae919-9701-4dad-bfd1-fff6c32fecea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:01 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5e8f9178-5a77-490f-822a-bcebd1d3df08 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3082959a-55be-475f-aadd-a381d597f412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:01 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-5e8f9178-5a77-490f-822a-bcebd1d3df08 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Volume ad9058c7-2edc-4c02-bb7c-a0a0c8f39552: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad9058c7-2edc-4c02-bb7c-a0a0c8f39552', 'volume_size': 1}
Jul 10 12:49:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5e8f9178-5a77-490f-822a-bcebd1d3df08 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:49:01 devstack sudo[99320]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a1166dfc-d623-4407-937f-50c20ff98d06 tempest-GroupSnapshotsTest-1497579122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e.73c546b7-ae78-405c-9e15-19e271e05599" returned: 0 in 0.661s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a1166dfc-d623-4407-937f-50c20ff98d06 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:01 devstack sudo[99323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e.info
Jul 10 12:49:01 devstack sudo[99323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:02 devstack sudo[99323]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a1166dfc-d623-4407-937f-50c20ff98d06 tempest-GroupSnapshotsTest-1497579122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e.info" returned: 0 in 0.643s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:02 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-a1166dfc-d623-4407-937f-50c20ff98d06 tempest-GroupSnapshotsTest-1497579122 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 10 12:49:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a1166dfc-d623-4407-937f-50c20ff98d06 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:02 devstack sudo[99326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e.info
Jul 10 12:49:02 devstack sudo[99326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:03 devstack sudo[99326]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a1166dfc-d623-4407-937f-50c20ff98d06 tempest-GroupSnapshotsTest-1497579122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e.info" returned: 0 in 0.640s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a1166dfc-d623-4407-937f-50c20ff98d06 tempest-GroupSnapshotsTest-1497579122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.366s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f32b112a-3c7d-46af-902f-03b8b8cb4024 tempest-CreateVolumesFromImageTest-967432040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.889s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:03 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-f32b112a-3c7d-46af-902f-03b8b8cb4024 tempest-CreateVolumesFromImageTest-967432040 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1128940591',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e2cd746-0836-47cb-81c6-3ac85661de69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de734d647f8c44de94823035bae13e6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:48:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:48:55Z,use_quota=True,user_id='57020c11374b469aab0c5b09c0fab80a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:49:03 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-f32b112a-3c7d-46af-902f-03b8b8cb4024 tempest-CreateVolumesFromImageTest-967432040 None] Creating volume 8e2cd746-0836-47cb-81c6-3ac85661de69 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:49:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f32b112a-3c7d-46af-902f-03b8b8cb4024 tempest-CreateVolumesFromImageTest-967432040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:49:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f32b112a-3c7d-46af-902f-03b8b8cb4024 tempest-CreateVolumesFromImageTest-967432040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:03 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-f32b112a-3c7d-46af-902f-03b8b8cb4024 tempest-CreateVolumesFromImageTest-967432040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:49:03 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-f32b112a-3c7d-46af-902f-03b8b8cb4024 tempest-CreateVolumesFromImageTest-967432040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:49:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f32b112a-3c7d-46af-902f-03b8b8cb4024 tempest-CreateVolumesFromImageTest-967432040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:03 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-f32b112a-3c7d-46af-902f-03b8b8cb4024 tempest-CreateVolumesFromImageTest-967432040 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:49:03 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-f32b112a-3c7d-46af-902f-03b8b8cb4024 tempest-CreateVolumesFromImageTest-967432040 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:49:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f32b112a-3c7d-46af-902f-03b8b8cb4024 tempest-CreateVolumesFromImageTest-967432040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8e2cd746-0836-47cb-81c6-3ac85661de69 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:03 devstack sudo[99329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8e2cd746-0836-47cb-81c6-3ac85661de69 1073741824
Jul 10 12:49:03 devstack sudo[99329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:03 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-a1166dfc-d623-4407-937f-50c20ff98d06 tempest-GroupSnapshotsTest-1497579122 None] group_snapshot 69c5d57d-1a25-41b8-93f4-dc03aec5cab7: created successfully
Jul 10 12:49:04 devstack sudo[99329]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f32b112a-3c7d-46af-902f-03b8b8cb4024 tempest-CreateVolumesFromImageTest-967432040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8e2cd746-0836-47cb-81c6-3ac85661de69 1073741824" returned: 0 in 0.873s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f32b112a-3c7d-46af-902f-03b8b8cb4024 tempest-CreateVolumesFromImageTest-967432040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8e2cd746-0836-47cb-81c6-3ac85661de69 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:04 devstack sudo[99335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8e2cd746-0836-47cb-81c6-3ac85661de69
Jul 10 12:49:04 devstack sudo[99335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:04 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-fba488dc-9bf9-4a2d-9bee-5e11ce762da8 tempest-GroupSnapshotsTest-1497579122 None] group_snapshot 69c5d57d-1a25-41b8-93f4-dc03aec5cab7: deleting
Jul 10 12:49:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fba488dc-9bf9-4a2d-9bee-5e11ce762da8 tempest-GroupSnapshotsTest-1497579122 None] group_snapshot 69c5d57d-1a25-41b8-93f4-dc03aec5cab7: deleting {{(pid=87378) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 10 12:49:04 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fba488dc-9bf9-4a2d-9bee-5e11ce762da8 tempest-GroupSnapshotsTest-1497579122 None] Acquiring lock "cinder-quobyte-6d342976-9deb-44d7-b8b7-fdebfc3a89e4" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:49:04 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fba488dc-9bf9-4a2d-9bee-5e11ce762da8 tempest-GroupSnapshotsTest-1497579122 None] Lock "cinder-quobyte-6d342976-9deb-44d7-b8b7-fdebfc3a89e4" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:49:04 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fba488dc-9bf9-4a2d-9bee-5e11ce762da8 tempest-GroupSnapshotsTest-1497579122 None] Acquiring lock "cinder-quobyte-624096e7-323b-421a-9c26-5620665b61a3" by "_delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:49:04 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fba488dc-9bf9-4a2d-9bee-5e11ce762da8 tempest-GroupSnapshotsTest-1497579122 None] Lock "cinder-quobyte-624096e7-323b-421a-9c26-5620665b61a3" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:49:04 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-fba488dc-9bf9-4a2d-9bee-5e11ce762da8 tempest-GroupSnapshotsTest-1497579122 None] Deleting offline snapshot 624096e7-323b-421a-9c26-5620665b61a3 of volume 6d342976-9deb-44d7-b8b7-fdebfc3a89e4 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 10 12:49:04 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-fba488dc-9bf9-4a2d-9bee-5e11ce762da8 tempest-GroupSnapshotsTest-1497579122 None] snapshot_file for this snap is: volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4.624096e7-323b-421a-9c26-5620665b61a3 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 10 12:49:04 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[efde2bb0-e7cb-4927-8251-bee9df621136]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:49:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fba488dc-9bf9-4a2d-9bee-5e11ce762da8 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4.624096e7-323b-421a-9c26-5620665b61a3 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:04 devstack sudo[99337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4.624096e7-323b-421a-9c26-5620665b61a3
Jul 10 12:49:04 devstack sudo[99337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:04 devstack sudo[99335]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f32b112a-3c7d-46af-902f-03b8b8cb4024 tempest-CreateVolumesFromImageTest-967432040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8e2cd746-0836-47cb-81c6-3ac85661de69" returned: 0 in 0.687s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:04 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-f32b112a-3c7d-46af-902f-03b8b8cb4024 tempest-CreateVolumesFromImageTest-967432040 None] <== create_volume: return (1606ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:49:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f32b112a-3c7d-46af-902f-03b8b8cb4024 tempest-CreateVolumesFromImageTest-967432040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.609s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2977b03a-9f63-4ab4-b5d1-6a21be1b4bbf tempest-CreateVolumesFromImageTest-967432040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.056s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:04 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-2977b03a-9f63-4ab4-b5d1-6a21be1b4bbf tempest-CreateVolumesFromImageTest-967432040 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-858979642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d083de1-a437-4d9c-ac8d-a05c7230681e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de734d647f8c44de94823035bae13e6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:48:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:48:55Z,use_quota=True,user_id='57020c11374b469aab0c5b09c0fab80a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:49:04 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-2977b03a-9f63-4ab4-b5d1-6a21be1b4bbf tempest-CreateVolumesFromImageTest-967432040 None] Creating volume 3d083de1-a437-4d9c-ac8d-a05c7230681e {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:49:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2977b03a-9f63-4ab4-b5d1-6a21be1b4bbf tempest-CreateVolumesFromImageTest-967432040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:49:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2977b03a-9f63-4ab4-b5d1-6a21be1b4bbf tempest-CreateVolumesFromImageTest-967432040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:04 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-2977b03a-9f63-4ab4-b5d1-6a21be1b4bbf tempest-CreateVolumesFromImageTest-967432040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:49:04 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-2977b03a-9f63-4ab4-b5d1-6a21be1b4bbf tempest-CreateVolumesFromImageTest-967432040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:49:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2977b03a-9f63-4ab4-b5d1-6a21be1b4bbf tempest-CreateVolumesFromImageTest-967432040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:04 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-2977b03a-9f63-4ab4-b5d1-6a21be1b4bbf tempest-CreateVolumesFromImageTest-967432040 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:49:04 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-2977b03a-9f63-4ab4-b5d1-6a21be1b4bbf tempest-CreateVolumesFromImageTest-967432040 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:49:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2977b03a-9f63-4ab4-b5d1-6a21be1b4bbf tempest-CreateVolumesFromImageTest-967432040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3d083de1-a437-4d9c-ac8d-a05c7230681e 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f32b112a-3c7d-46af-902f-03b8b8cb4024 tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (764d4a86-66cb-4256-9c19-2e9fee99181c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e2cd746-0836-47cb-81c6-3ac85661de69', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:04 devstack sudo[99340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3d083de1-a437-4d9c-ac8d-a05c7230681e 1073741824
Jul 10 12:49:04 devstack sudo[99340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f32b112a-3c7d-46af-902f-03b8b8cb4024 tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (608f08bf-73dc-4a38-9675-8d77f523e6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:04 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-f32b112a-3c7d-46af-902f-03b8b8cb4024 tempest-CreateVolumesFromImageTest-967432040 None] Volume volume-8e2cd746-0836-47cb-81c6-3ac85661de69 (8e2cd746-0836-47cb-81c6-3ac85661de69): created successfully
Jul 10 12:49:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f32b112a-3c7d-46af-902f-03b8b8cb4024 tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (608f08bf-73dc-4a38-9675-8d77f523e6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f32b112a-3c7d-46af-902f-03b8b8cb4024 tempest-CreateVolumesFromImageTest-967432040 None] Flow 'volume_create_manager' (ec84ba02-c8f7-46c5-b2ef-f7fa0455b0dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:49:04 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-f32b112a-3c7d-46af-902f-03b8b8cb4024 tempest-CreateVolumesFromImageTest-967432040 None] Created volume successfully.
Jul 10 12:49:05 devstack sudo[99337]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fba488dc-9bf9-4a2d-9bee-5e11ce762da8 tempest-GroupSnapshotsTest-1497579122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4.624096e7-323b-421a-9c26-5620665b61a3" returned: 0 in 0.793s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:05 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-fba488dc-9bf9-4a2d-9bee-5e11ce762da8 tempest-GroupSnapshotsTest-1497579122 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:49:05 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6f802e-4d22-451a-8709-e4fd6738ed08]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:49:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fba488dc-9bf9-4a2d-9bee-5e11ce762da8 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:05 devstack sudo[99345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4
Jul 10 12:49:05 devstack sudo[99345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:05 devstack sudo[99340]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2977b03a-9f63-4ab4-b5d1-6a21be1b4bbf tempest-CreateVolumesFromImageTest-967432040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3d083de1-a437-4d9c-ac8d-a05c7230681e 1073741824" returned: 0 in 0.852s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2977b03a-9f63-4ab4-b5d1-6a21be1b4bbf tempest-CreateVolumesFromImageTest-967432040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3d083de1-a437-4d9c-ac8d-a05c7230681e {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:05 devstack sudo[99351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3d083de1-a437-4d9c-ac8d-a05c7230681e
Jul 10 12:49:05 devstack sudo[99351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:05 devstack sudo[99345]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fba488dc-9bf9-4a2d-9bee-5e11ce762da8 tempest-GroupSnapshotsTest-1497579122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4" returned: 0 in 0.812s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fba488dc-9bf9-4a2d-9bee-5e11ce762da8 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4.624096e7-323b-421a-9c26-5620665b61a3 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:05 devstack sudo[99356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4.624096e7-323b-421a-9c26-5620665b61a3
Jul 10 12:49:05 devstack sudo[99356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:06 devstack sudo[99351]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2977b03a-9f63-4ab4-b5d1-6a21be1b4bbf tempest-CreateVolumesFromImageTest-967432040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3d083de1-a437-4d9c-ac8d-a05c7230681e" returned: 0 in 0.698s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:06 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-2977b03a-9f63-4ab4-b5d1-6a21be1b4bbf tempest-CreateVolumesFromImageTest-967432040 None] <== create_volume: return (1590ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:49:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2977b03a-9f63-4ab4-b5d1-6a21be1b4bbf tempest-CreateVolumesFromImageTest-967432040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.593s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-18f088b8-6d83-4b92-b16a-301ff6d31aac tempest-CreateVolumesFromImageTest-967432040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.174s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:06 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-18f088b8-6d83-4b92-b16a-301ff6d31aac tempest-CreateVolumesFromImageTest-967432040 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:48:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-553034455',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d619009-3881-4c8e-a00d-e28b9258d941,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de734d647f8c44de94823035bae13e6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:48:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:48:56Z,use_quota=True,user_id='57020c11374b469aab0c5b09c0fab80a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:49:06 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-18f088b8-6d83-4b92-b16a-301ff6d31aac tempest-CreateVolumesFromImageTest-967432040 None] Creating volume 3d619009-3881-4c8e-a00d-e28b9258d941 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:49:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-18f088b8-6d83-4b92-b16a-301ff6d31aac tempest-CreateVolumesFromImageTest-967432040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:49:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-18f088b8-6d83-4b92-b16a-301ff6d31aac tempest-CreateVolumesFromImageTest-967432040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:06 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-18f088b8-6d83-4b92-b16a-301ff6d31aac tempest-CreateVolumesFromImageTest-967432040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:49:06 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-18f088b8-6d83-4b92-b16a-301ff6d31aac tempest-CreateVolumesFromImageTest-967432040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:49:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-18f088b8-6d83-4b92-b16a-301ff6d31aac tempest-CreateVolumesFromImageTest-967432040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:06 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-18f088b8-6d83-4b92-b16a-301ff6d31aac tempest-CreateVolumesFromImageTest-967432040 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:49:06 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-18f088b8-6d83-4b92-b16a-301ff6d31aac tempest-CreateVolumesFromImageTest-967432040 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:49:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-18f088b8-6d83-4b92-b16a-301ff6d31aac tempest-CreateVolumesFromImageTest-967432040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3d619009-3881-4c8e-a00d-e28b9258d941 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:06 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2977b03a-9f63-4ab4-b5d1-6a21be1b4bbf tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3027624e-e572-4f44-b9b2-3e2942f3b7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d083de1-a437-4d9c-ac8d-a05c7230681e', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:06 devstack sudo[99359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3d619009-3881-4c8e-a00d-e28b9258d941 1073741824
Jul 10 12:49:06 devstack sudo[99359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:06 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2977b03a-9f63-4ab4-b5d1-6a21be1b4bbf tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acec432a-b5b9-4709-a03b-b769b79ce725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:06 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-2977b03a-9f63-4ab4-b5d1-6a21be1b4bbf tempest-CreateVolumesFromImageTest-967432040 None] Volume volume-3d083de1-a437-4d9c-ac8d-a05c7230681e (3d083de1-a437-4d9c-ac8d-a05c7230681e): created successfully
Jul 10 12:49:06 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2977b03a-9f63-4ab4-b5d1-6a21be1b4bbf tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acec432a-b5b9-4709-a03b-b769b79ce725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:06 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2977b03a-9f63-4ab4-b5d1-6a21be1b4bbf tempest-CreateVolumesFromImageTest-967432040 None] Flow 'volume_create_manager' (d6ef4952-f995-4b33-8489-1f833515704b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:49:06 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-2977b03a-9f63-4ab4-b5d1-6a21be1b4bbf tempest-CreateVolumesFromImageTest-967432040 None] Created volume successfully.
Jul 10 12:49:06 devstack sudo[99356]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fba488dc-9bf9-4a2d-9bee-5e11ce762da8 tempest-GroupSnapshotsTest-1497579122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4.624096e7-323b-421a-9c26-5620665b61a3" returned: 0 in 0.759s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fba488dc-9bf9-4a2d-9bee-5e11ce762da8 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4.624096e7-323b-421a-9c26-5620665b61a3 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:06 devstack sudo[99365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4.624096e7-323b-421a-9c26-5620665b61a3
Jul 10 12:49:06 devstack sudo[99365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:07 devstack sudo[99359]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-18f088b8-6d83-4b92-b16a-301ff6d31aac tempest-CreateVolumesFromImageTest-967432040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3d619009-3881-4c8e-a00d-e28b9258d941 1073741824" returned: 0 in 0.844s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-18f088b8-6d83-4b92-b16a-301ff6d31aac tempest-CreateVolumesFromImageTest-967432040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3d619009-3881-4c8e-a00d-e28b9258d941 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:07 devstack sudo[99370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3d619009-3881-4c8e-a00d-e28b9258d941
Jul 10 12:49:07 devstack sudo[99370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:07 devstack sudo[99365]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fba488dc-9bf9-4a2d-9bee-5e11ce762da8 tempest-GroupSnapshotsTest-1497579122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4.624096e7-323b-421a-9c26-5620665b61a3" returned: 0 in 0.665s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:07 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fba488dc-9bf9-4a2d-9bee-5e11ce762da8 tempest-GroupSnapshotsTest-1497579122 None] Lock "cinder-quobyte-624096e7-323b-421a-9c26-5620665b61a3" released by "_delete_snapshot" :: held 3.125s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:49:07 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fba488dc-9bf9-4a2d-9bee-5e11ce762da8 tempest-GroupSnapshotsTest-1497579122 None] Lock "cinder-quobyte-6d342976-9deb-44d7-b8b7-fdebfc3a89e4" released by "delete_snapshot" :: held 3.149s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:49:07 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fba488dc-9bf9-4a2d-9bee-5e11ce762da8 tempest-GroupSnapshotsTest-1497579122 None] Acquiring lock "cinder-quobyte-eaa22196-59d6-4ea0-af8b-199c442a5a4e" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:49:07 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fba488dc-9bf9-4a2d-9bee-5e11ce762da8 tempest-GroupSnapshotsTest-1497579122 None] Lock "cinder-quobyte-eaa22196-59d6-4ea0-af8b-199c442a5a4e" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:49:07 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fba488dc-9bf9-4a2d-9bee-5e11ce762da8 tempest-GroupSnapshotsTest-1497579122 None] Acquiring lock "cinder-quobyte-73c546b7-ae78-405c-9e15-19e271e05599" by "_delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:49:07 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fba488dc-9bf9-4a2d-9bee-5e11ce762da8 tempest-GroupSnapshotsTest-1497579122 None] Lock "cinder-quobyte-73c546b7-ae78-405c-9e15-19e271e05599" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:49:07 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-fba488dc-9bf9-4a2d-9bee-5e11ce762da8 tempest-GroupSnapshotsTest-1497579122 None] Deleting offline snapshot 73c546b7-ae78-405c-9e15-19e271e05599 of volume eaa22196-59d6-4ea0-af8b-199c442a5a4e {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 10 12:49:07 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-fba488dc-9bf9-4a2d-9bee-5e11ce762da8 tempest-GroupSnapshotsTest-1497579122 None] snapshot_file for this snap is: volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e.73c546b7-ae78-405c-9e15-19e271e05599 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 10 12:49:07 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[74034a08-68ab-4511-a264-10f696197888]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:49:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fba488dc-9bf9-4a2d-9bee-5e11ce762da8 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e.73c546b7-ae78-405c-9e15-19e271e05599 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:07 devstack sudo[99373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e.73c546b7-ae78-405c-9e15-19e271e05599
Jul 10 12:49:07 devstack sudo[99373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:07 devstack sudo[99370]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-18f088b8-6d83-4b92-b16a-301ff6d31aac tempest-CreateVolumesFromImageTest-967432040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3d619009-3881-4c8e-a00d-e28b9258d941" returned: 0 in 0.641s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:07 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-18f088b8-6d83-4b92-b16a-301ff6d31aac tempest-CreateVolumesFromImageTest-967432040 None] <== create_volume: return (1528ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:49:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-18f088b8-6d83-4b92-b16a-301ff6d31aac tempest-CreateVolumesFromImageTest-967432040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.531s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-10901ba9-bc61-4bd8-a393-e19185ce76f1 tempest-CreateVolumesFromImageTest-967432040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.373s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:07 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-10901ba9-bc61-4bd8-a393-e19185ce76f1 tempest-CreateVolumesFromImageTest-967432040 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:48:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1648943824',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94e03b89-9a17-4d4f-96b2-dc48da005206,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de734d647f8c44de94823035bae13e6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:48:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:48:56Z,use_quota=True,user_id='57020c11374b469aab0c5b09c0fab80a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:49:07 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-10901ba9-bc61-4bd8-a393-e19185ce76f1 tempest-CreateVolumesFromImageTest-967432040 None] Creating volume 94e03b89-9a17-4d4f-96b2-dc48da005206 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:49:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-10901ba9-bc61-4bd8-a393-e19185ce76f1 tempest-CreateVolumesFromImageTest-967432040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:49:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-10901ba9-bc61-4bd8-a393-e19185ce76f1 tempest-CreateVolumesFromImageTest-967432040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:07 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-10901ba9-bc61-4bd8-a393-e19185ce76f1 tempest-CreateVolumesFromImageTest-967432040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:49:07 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-10901ba9-bc61-4bd8-a393-e19185ce76f1 tempest-CreateVolumesFromImageTest-967432040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:49:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-10901ba9-bc61-4bd8-a393-e19185ce76f1 tempest-CreateVolumesFromImageTest-967432040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:07 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-10901ba9-bc61-4bd8-a393-e19185ce76f1 tempest-CreateVolumesFromImageTest-967432040 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:49:07 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-10901ba9-bc61-4bd8-a393-e19185ce76f1 tempest-CreateVolumesFromImageTest-967432040 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:49:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-10901ba9-bc61-4bd8-a393-e19185ce76f1 tempest-CreateVolumesFromImageTest-967432040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-94e03b89-9a17-4d4f-96b2-dc48da005206 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:07 devstack sudo[99376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-94e03b89-9a17-4d4f-96b2-dc48da005206 1073741824
Jul 10 12:49:07 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-18f088b8-6d83-4b92-b16a-301ff6d31aac tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e9a44e7-f2ff-4acc-8715-fe5273323438) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d619009-3881-4c8e-a00d-e28b9258d941', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:07 devstack sudo[99376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:07 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-18f088b8-6d83-4b92-b16a-301ff6d31aac tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c094a631-6f30-486c-8fa5-b128d10e0652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:07 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-18f088b8-6d83-4b92-b16a-301ff6d31aac tempest-CreateVolumesFromImageTest-967432040 None] Volume volume-3d619009-3881-4c8e-a00d-e28b9258d941 (3d619009-3881-4c8e-a00d-e28b9258d941): created successfully
Jul 10 12:49:07 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-18f088b8-6d83-4b92-b16a-301ff6d31aac tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c094a631-6f30-486c-8fa5-b128d10e0652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:07 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-18f088b8-6d83-4b92-b16a-301ff6d31aac tempest-CreateVolumesFromImageTest-967432040 None] Flow 'volume_create_manager' (18192a48-a133-4dd7-b476-4859556a4518) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:49:07 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-18f088b8-6d83-4b92-b16a-301ff6d31aac tempest-CreateVolumesFromImageTest-967432040 None] Created volume successfully.
Jul 10 12:49:08 devstack sudo[99373]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fba488dc-9bf9-4a2d-9bee-5e11ce762da8 tempest-GroupSnapshotsTest-1497579122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e.73c546b7-ae78-405c-9e15-19e271e05599" returned: 0 in 0.796s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:08 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-fba488dc-9bf9-4a2d-9bee-5e11ce762da8 tempest-GroupSnapshotsTest-1497579122 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:49:08 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e776a1-2f56-4706-83f8-61ccd6e41e08]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:49:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fba488dc-9bf9-4a2d-9bee-5e11ce762da8 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:08 devstack sudo[99381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e
Jul 10 12:49:08 devstack sudo[99381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:08 devstack sudo[99376]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-10901ba9-bc61-4bd8-a393-e19185ce76f1 tempest-CreateVolumesFromImageTest-967432040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-94e03b89-9a17-4d4f-96b2-dc48da005206 1073741824" returned: 0 in 0.870s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-10901ba9-bc61-4bd8-a393-e19185ce76f1 tempest-CreateVolumesFromImageTest-967432040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-94e03b89-9a17-4d4f-96b2-dc48da005206 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:08 devstack sudo[99386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-94e03b89-9a17-4d4f-96b2-dc48da005206
Jul 10 12:49:08 devstack sudo[99386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:09 devstack sudo[99381]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fba488dc-9bf9-4a2d-9bee-5e11ce762da8 tempest-GroupSnapshotsTest-1497579122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e" returned: 0 in 0.790s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fba488dc-9bf9-4a2d-9bee-5e11ce762da8 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e.73c546b7-ae78-405c-9e15-19e271e05599 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:09 devstack sudo[99392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e.73c546b7-ae78-405c-9e15-19e271e05599
Jul 10 12:49:09 devstack sudo[99392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:09 devstack sudo[99386]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-10901ba9-bc61-4bd8-a393-e19185ce76f1 tempest-CreateVolumesFromImageTest-967432040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-94e03b89-9a17-4d4f-96b2-dc48da005206" returned: 0 in 0.679s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:09 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-10901ba9-bc61-4bd8-a393-e19185ce76f1 tempest-CreateVolumesFromImageTest-967432040 None] <== create_volume: return (1593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:49:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-10901ba9-bc61-4bd8-a393-e19185ce76f1 tempest-CreateVolumesFromImageTest-967432040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3be60d94-2eb8-4710-9373-95c1f1734ded tempest-CreateVolumesFromImageTest-967432040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.691s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:09 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3be60d94-2eb8-4710-9373-95c1f1734ded tempest-CreateVolumesFromImageTest-967432040 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:48:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1037800229',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91ebe59a-90d5-4717-8813-d55dd0ee9efb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de734d647f8c44de94823035bae13e6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:48:54Z,use_quota=True,user_id='57020c11374b469aab0c5b09c0fab80a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:49:09 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-3be60d94-2eb8-4710-9373-95c1f1734ded tempest-CreateVolumesFromImageTest-967432040 None] Creating volume 91ebe59a-90d5-4717-8813-d55dd0ee9efb {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:49:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3be60d94-2eb8-4710-9373-95c1f1734ded tempest-CreateVolumesFromImageTest-967432040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:49:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3be60d94-2eb8-4710-9373-95c1f1734ded tempest-CreateVolumesFromImageTest-967432040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:09 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3be60d94-2eb8-4710-9373-95c1f1734ded tempest-CreateVolumesFromImageTest-967432040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:49:09 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3be60d94-2eb8-4710-9373-95c1f1734ded tempest-CreateVolumesFromImageTest-967432040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:49:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3be60d94-2eb8-4710-9373-95c1f1734ded tempest-CreateVolumesFromImageTest-967432040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:09 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3be60d94-2eb8-4710-9373-95c1f1734ded tempest-CreateVolumesFromImageTest-967432040 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:49:09 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-3be60d94-2eb8-4710-9373-95c1f1734ded tempest-CreateVolumesFromImageTest-967432040 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:49:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3be60d94-2eb8-4710-9373-95c1f1734ded tempest-CreateVolumesFromImageTest-967432040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-91ebe59a-90d5-4717-8813-d55dd0ee9efb 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:09 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-10901ba9-bc61-4bd8-a393-e19185ce76f1 tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce40c824-9de1-49b2-a907-5cab0db605da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94e03b89-9a17-4d4f-96b2-dc48da005206', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:09 devstack sudo[99395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-91ebe59a-90d5-4717-8813-d55dd0ee9efb 1073741824
Jul 10 12:49:09 devstack sudo[99395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:09 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-10901ba9-bc61-4bd8-a393-e19185ce76f1 tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3da7bb4c-6369-4356-9409-5b2a721ee419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:09 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-10901ba9-bc61-4bd8-a393-e19185ce76f1 tempest-CreateVolumesFromImageTest-967432040 None] Volume volume-94e03b89-9a17-4d4f-96b2-dc48da005206 (94e03b89-9a17-4d4f-96b2-dc48da005206): created successfully
Jul 10 12:49:09 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-10901ba9-bc61-4bd8-a393-e19185ce76f1 tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3da7bb4c-6369-4356-9409-5b2a721ee419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:09 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-10901ba9-bc61-4bd8-a393-e19185ce76f1 tempest-CreateVolumesFromImageTest-967432040 None] Flow 'volume_create_manager' (edf1f76b-728b-4f58-ae8e-1dcda0a80390) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:49:09 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-10901ba9-bc61-4bd8-a393-e19185ce76f1 tempest-CreateVolumesFromImageTest-967432040 None] Created volume successfully.
Jul 10 12:49:09 devstack sudo[99392]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fba488dc-9bf9-4a2d-9bee-5e11ce762da8 tempest-GroupSnapshotsTest-1497579122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e.73c546b7-ae78-405c-9e15-19e271e05599" returned: 0 in 0.753s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fba488dc-9bf9-4a2d-9bee-5e11ce762da8 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e.73c546b7-ae78-405c-9e15-19e271e05599 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:09 devstack sudo[99400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e.73c546b7-ae78-405c-9e15-19e271e05599
Jul 10 12:49:09 devstack sudo[99400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:10 devstack sudo[99395]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3be60d94-2eb8-4710-9373-95c1f1734ded tempest-CreateVolumesFromImageTest-967432040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-91ebe59a-90d5-4717-8813-d55dd0ee9efb 1073741824" returned: 0 in 0.842s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3be60d94-2eb8-4710-9373-95c1f1734ded tempest-CreateVolumesFromImageTest-967432040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-91ebe59a-90d5-4717-8813-d55dd0ee9efb {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:10 devstack sudo[99405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-91ebe59a-90d5-4717-8813-d55dd0ee9efb
Jul 10 12:49:10 devstack sudo[99405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:10 devstack sudo[99400]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fba488dc-9bf9-4a2d-9bee-5e11ce762da8 tempest-GroupSnapshotsTest-1497579122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e.73c546b7-ae78-405c-9e15-19e271e05599" returned: 0 in 0.669s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:10 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fba488dc-9bf9-4a2d-9bee-5e11ce762da8 tempest-GroupSnapshotsTest-1497579122 None] Lock "cinder-quobyte-73c546b7-ae78-405c-9e15-19e271e05599" released by "_delete_snapshot" :: held 3.115s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:49:10 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fba488dc-9bf9-4a2d-9bee-5e11ce762da8 tempest-GroupSnapshotsTest-1497579122 None] Lock "cinder-quobyte-eaa22196-59d6-4ea0-af8b-199c442a5a4e" released by "delete_snapshot" :: held 3.140s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:49:10 devstack cinder-volume[87378]: WARNING cinder.quota [None req-fba488dc-9bf9-4a2d-9bee-5e11ce762da8 tempest-GroupSnapshotsTest-1497579122 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1990541158 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1990541158, it is now deprecated. Please use the default quota class for default quota.
Jul 10 12:49:10 devstack cinder-volume[87378]: WARNING cinder.quota [None req-fba488dc-9bf9-4a2d-9bee-5e11ce762da8 tempest-GroupSnapshotsTest-1497579122 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1990541158 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1990541158, it is now deprecated. Please use the default quota class for default quota.
Jul 10 12:49:10 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-fba488dc-9bf9-4a2d-9bee-5e11ce762da8 tempest-GroupSnapshotsTest-1497579122 None] Created reservations ['764f37e7-065a-45b6-9e8a-75314498995d', '0388ee55-bee2-462d-b3ff-a6c422362801', '939ebfd4-1377-42de-9270-fc92de63856e', 'dfcc0cde-eed2-45bb-84a1-7f719e5cadec'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:49:10 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-fba488dc-9bf9-4a2d-9bee-5e11ce762da8 tempest-GroupSnapshotsTest-1497579122 None] Created reservations ['8673c094-3327-41cd-acd6-3bc5e7ddc558', '664244d0-eb22-4d71-b6cd-4bf034259a30', '5f6f337c-5900-46e4-aa76-9e2a2e5a16fd', 'd8ac0116-3b57-4798-a91d-2e4f23465966'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:49:10 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-fba488dc-9bf9-4a2d-9bee-5e11ce762da8 tempest-GroupSnapshotsTest-1497579122 None] group_snapshot 69c5d57d-1a25-41b8-93f4-dc03aec5cab7: deleted successfully
Jul 10 12:49:11 devstack sudo[99405]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3be60d94-2eb8-4710-9373-95c1f1734ded tempest-CreateVolumesFromImageTest-967432040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-91ebe59a-90d5-4717-8813-d55dd0ee9efb" returned: 0 in 0.693s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:11 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3be60d94-2eb8-4710-9373-95c1f1734ded tempest-CreateVolumesFromImageTest-967432040 None] <== create_volume: return (1589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:49:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3be60d94-2eb8-4710-9373-95c1f1734ded tempest-CreateVolumesFromImageTest-967432040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5e8f9178-5a77-490f-822a-bcebd1d3df08 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.374s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:11 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5e8f9178-5a77-490f-822a-bcebd1d3df08 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:49:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-787156723',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad9058c7-2edc-4c02-bb7c-a0a0c8f39552,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b767fd10c944debb22b8dc4f32a2565',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:49:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:49:02Z,use_quota=True,user_id='e867907c3ad843f1baff4a7107d1358b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79990546-43ef-49be-9caa-b849ccd1bf32),volume_type_id=79990546-43ef-49be-9caa-b849ccd1bf32)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:49:11 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-5e8f9178-5a77-490f-822a-bcebd1d3df08 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Creating volume ad9058c7-2edc-4c02-bb7c-a0a0c8f39552 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:49:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5e8f9178-5a77-490f-822a-bcebd1d3df08 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:49:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5e8f9178-5a77-490f-822a-bcebd1d3df08 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:11 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5e8f9178-5a77-490f-822a-bcebd1d3df08 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:49:11 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5e8f9178-5a77-490f-822a-bcebd1d3df08 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:49:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5e8f9178-5a77-490f-822a-bcebd1d3df08 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:11 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5e8f9178-5a77-490f-822a-bcebd1d3df08 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:49:11 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-5e8f9178-5a77-490f-822a-bcebd1d3df08 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:49:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5e8f9178-5a77-490f-822a-bcebd1d3df08 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ad9058c7-2edc-4c02-bb7c-a0a0c8f39552 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:11 devstack sudo[99409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ad9058c7-2edc-4c02-bb7c-a0a0c8f39552 1073741824
Jul 10 12:49:11 devstack sudo[99409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:11 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3be60d94-2eb8-4710-9373-95c1f1734ded tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2853ddf2-194b-4eae-a4ec-daee488f766b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91ebe59a-90d5-4717-8813-d55dd0ee9efb', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:11 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3be60d94-2eb8-4710-9373-95c1f1734ded tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e23b0f19-ff4a-465a-a1cc-76e800258750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:11 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-3be60d94-2eb8-4710-9373-95c1f1734ded tempest-CreateVolumesFromImageTest-967432040 None] Volume volume-91ebe59a-90d5-4717-8813-d55dd0ee9efb (91ebe59a-90d5-4717-8813-d55dd0ee9efb): created successfully
Jul 10 12:49:11 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3be60d94-2eb8-4710-9373-95c1f1734ded tempest-CreateVolumesFromImageTest-967432040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e23b0f19-ff4a-465a-a1cc-76e800258750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:11 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3be60d94-2eb8-4710-9373-95c1f1734ded tempest-CreateVolumesFromImageTest-967432040 None] Flow 'volume_create_manager' (fbbd78aa-98e8-4508-b2e5-2abd90bcdad0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:49:11 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-3be60d94-2eb8-4710-9373-95c1f1734ded tempest-CreateVolumesFromImageTest-967432040 None] Created volume successfully.
Jul 10 12:49:11 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3c8195d0-783e-48d7-9002-9f684cfe75c8 tempest-CreateVolumesFromImageTest-967432040 None] Acquiring lock "cinder-94e03b89-9a17-4d4f-96b2-dc48da005206-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:49:11 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3c8195d0-783e-48d7-9002-9f684cfe75c8 tempest-CreateVolumesFromImageTest-967432040 None] Lock "cinder-94e03b89-9a17-4d4f-96b2-dc48da005206-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:49:11 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3c8195d0-783e-48d7-9002-9f684cfe75c8 tempest-CreateVolumesFromImageTest-967432040 None] Acquiring lock "cinder-quobyte-94e03b89-9a17-4d4f-96b2-dc48da005206" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:49:11 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3c8195d0-783e-48d7-9002-9f684cfe75c8 tempest-CreateVolumesFromImageTest-967432040 None] Lock "cinder-quobyte-94e03b89-9a17-4d4f-96b2-dc48da005206" acquired by "delete_volume" :: waited 0.016s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:49:11 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b02c81-0ad3-438c-bea9-583baeb849b9]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:49:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3c8195d0-783e-48d7-9002-9f684cfe75c8 tempest-CreateVolumesFromImageTest-967432040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-94e03b89-9a17-4d4f-96b2-dc48da005206 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:12 devstack sudo[99415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-94e03b89-9a17-4d4f-96b2-dc48da005206
Jul 10 12:49:12 devstack sudo[99415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:12 devstack sudo[99409]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5e8f9178-5a77-490f-822a-bcebd1d3df08 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ad9058c7-2edc-4c02-bb7c-a0a0c8f39552 1073741824" returned: 0 in 0.938s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5e8f9178-5a77-490f-822a-bcebd1d3df08 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ad9058c7-2edc-4c02-bb7c-a0a0c8f39552 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:12 devstack sudo[99417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ad9058c7-2edc-4c02-bb7c-a0a0c8f39552
Jul 10 12:49:12 devstack sudo[99417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:12 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-be6dac5e-f66e-4d7d-bd2f-2d00daca9194 tempest-GroupSnapshotsTest-1497579122 None] Acquiring lock "cinder-quobyte-6d342976-9deb-44d7-b8b7-fdebfc3a89e4" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:49:12 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-be6dac5e-f66e-4d7d-bd2f-2d00daca9194 tempest-GroupSnapshotsTest-1497579122 None] Lock "cinder-quobyte-6d342976-9deb-44d7-b8b7-fdebfc3a89e4" acquired by "delete_volume" :: waited 0.020s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:49:12 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e02013-2654-41c7-8ab2-6fbb50270ad6]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:49:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-be6dac5e-f66e-4d7d-bd2f-2d00daca9194 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:12 devstack sudo[99419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4
Jul 10 12:49:12 devstack sudo[99419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:12 devstack sudo[99415]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3c8195d0-783e-48d7-9002-9f684cfe75c8 tempest-CreateVolumesFromImageTest-967432040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-94e03b89-9a17-4d4f-96b2-dc48da005206" returned: 0 in 0.801s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3c8195d0-783e-48d7-9002-9f684cfe75c8 tempest-CreateVolumesFromImageTest-967432040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-94e03b89-9a17-4d4f-96b2-dc48da005206 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:12 devstack sudo[99425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-94e03b89-9a17-4d4f-96b2-dc48da005206
Jul 10 12:49:12 devstack sudo[99425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:12 devstack sudo[99417]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5e8f9178-5a77-490f-822a-bcebd1d3df08 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ad9058c7-2edc-4c02-bb7c-a0a0c8f39552" returned: 0 in 0.718s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5e8f9178-5a77-490f-822a-bcebd1d3df08 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] <== create_volume: return (1717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:49:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5e8f9178-5a77-490f-822a-bcebd1d3df08 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.721s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5e8f9178-5a77-490f-822a-bcebd1d3df08 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3082959a-55be-475f-aadd-a381d597f412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad9058c7-2edc-4c02-bb7c-a0a0c8f39552', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5e8f9178-5a77-490f-822a-bcebd1d3df08 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26a3be38-00de-44e4-87ce-979547a7743b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:12 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-5e8f9178-5a77-490f-822a-bcebd1d3df08 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Volume volume-ad9058c7-2edc-4c02-bb7c-a0a0c8f39552 (ad9058c7-2edc-4c02-bb7c-a0a0c8f39552): created successfully
Jul 10 12:49:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5e8f9178-5a77-490f-822a-bcebd1d3df08 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26a3be38-00de-44e4-87ce-979547a7743b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5e8f9178-5a77-490f-822a-bcebd1d3df08 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Flow 'volume_create_manager' (460529ca-f7aa-4143-84ec-83f3ec94e0fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:49:12 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-5e8f9178-5a77-490f-822a-bcebd1d3df08 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Created volume successfully.
Jul 10 12:49:12 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:49:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:49:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:49:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:49:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:12 devstack sudo[99430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:49:12 devstack sudo[99430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:13 devstack sudo[99419]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-be6dac5e-f66e-4d7d-bd2f-2d00daca9194 tempest-GroupSnapshotsTest-1497579122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4" returned: 0 in 0.781s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-be6dac5e-f66e-4d7d-bd2f-2d00daca9194 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:13 devstack sudo[99432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4
Jul 10 12:49:13 devstack sudo[99432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:13 devstack sudo[99425]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3c8195d0-783e-48d7-9002-9f684cfe75c8 tempest-CreateVolumesFromImageTest-967432040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-94e03b89-9a17-4d4f-96b2-dc48da005206" returned: 0 in 0.774s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:13 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3c8195d0-783e-48d7-9002-9f684cfe75c8 tempest-CreateVolumesFromImageTest-967432040 None] Lock "cinder-quobyte-94e03b89-9a17-4d4f-96b2-dc48da005206" released by "delete_volume" :: held 1.632s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:49:13 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-3c8195d0-783e-48d7-9002-9f684cfe75c8 tempest-CreateVolumesFromImageTest-967432040 None] Created reservations ['3b6595ef-053b-4dfb-a22f-576ea008a954', '70045bc4-08ec-4bc6-8590-bf65fc731a7e', '5209b941-6fbc-4dcb-9cf6-0325abe4164a', 'a89800af-3999-442c-aa2d-cbf7f9fb9133'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:49:13 devstack sudo[99430]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.737s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:13 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:49:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3c8195d0-783e-48d7-9002-9f684cfe75c8 tempest-CreateVolumesFromImageTest-967432040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:49:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3c8195d0-783e-48d7-9002-9f684cfe75c8 tempest-CreateVolumesFromImageTest-967432040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:13 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3c8195d0-783e-48d7-9002-9f684cfe75c8 tempest-CreateVolumesFromImageTest-967432040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:49:13 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3c8195d0-783e-48d7-9002-9f684cfe75c8 tempest-CreateVolumesFromImageTest-967432040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:49:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3c8195d0-783e-48d7-9002-9f684cfe75c8 tempest-CreateVolumesFromImageTest-967432040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3c8195d0-783e-48d7-9002-9f684cfe75c8 tempest-CreateVolumesFromImageTest-967432040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:13 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager._thread_info {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:49:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread count: 28 {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 10 12:49:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread info: [<_MainThread(MainThread, started 128233544536192)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128233445424704)>, <Thread(Thread-3 (stat_writer), started daemon 128233435118528)>, <Thread(Rabbit-heartbeat, started daemon 128233435718016)>, <Thread(Thread-5 (_runner), started daemon 128233432624448)>, <Thread(Thread-7 (_runner), started daemon 128233432674688)>, <Thread(fd_logger, started daemon 128233428569472)>, <Thread(privsep_reader, started daemon 128233429417088)>, <Thread(tpool_thread_0, started daemon 128233421182656)>, <Thread(tpool_thread_1, started daemon 128233412789952)>, <Thread(tpool_thread_2, started daemon 128233404397248)>, <Thread(tpool_thread_3, started daemon 128233396004544)>, <Thread(tpool_thread_4, started daemon 128233387611840)>, <Thread(tpool_thread_5, started daemon 128233379219136)>, <Thread(tpool_thread_6, started daemon 128233370826432)>, <Thread(tpool_thread_7, started daemon 128233362433728)>, <Thread(tpool_thread_8, started daemon 128233354041024)>, <Thread(tpool_thread_9, started daemon 128233345631936)>, <Thread(tpool_thread_10, started daemon 128233337222848)>, <Thread(tpool_thread_11, started daemon 128233328813760)>, <Thread(tpool_thread_12, started daemon 128233320404672)>, <Thread(tpool_thread_13, started daemon 128233311995584)>, <Thread(tpool_thread_14, started daemon 128233303586496)>, <Thread(tpool_thread_15, started daemon 128233295177408)>, <Thread(tpool_thread_16, started daemon 128233286768320)>, <Thread(tpool_thread_17, started daemon 128233278359232)>, <Thread(tpool_thread_18, started daemon 128233269950144)>, <Thread(tpool_thread_19, started daemon 128233261541056)>] {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 10 12:49:13 devstack sudo[99437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:49:13 devstack sudo[99437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-cc11f208-ee8f-4216-9aa7-fe77d7ffbc71 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:49:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-cc11f208-ee8f-4216-9aa7-fe77d7ffbc71 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:13 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-cc11f208-ee8f-4216-9aa7-fe77d7ffbc71 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:49:13 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-cc11f208-ee8f-4216-9aa7-fe77d7ffbc71 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:49:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-cc11f208-ee8f-4216-9aa7-fe77d7ffbc71 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cc11f208-ee8f-4216-9aa7-fe77d7ffbc71 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:13 devstack sudo[99432]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-be6dac5e-f66e-4d7d-bd2f-2d00daca9194 tempest-GroupSnapshotsTest-1497579122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6d342976-9deb-44d7-b8b7-fdebfc3a89e4" returned: 0 in 0.785s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:13 devstack sudo[99439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:49:13 devstack sudo[99439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:13 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-be6dac5e-f66e-4d7d-bd2f-2d00daca9194 tempest-GroupSnapshotsTest-1497579122 None] Lock "cinder-quobyte-6d342976-9deb-44d7-b8b7-fdebfc3a89e4" released by "delete_volume" :: held 1.649s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:49:13 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-be6dac5e-f66e-4d7d-bd2f-2d00daca9194 tempest-GroupSnapshotsTest-1497579122 None] Acquiring lock "cinder-quobyte-eaa22196-59d6-4ea0-af8b-199c442a5a4e" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:49:13 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-be6dac5e-f66e-4d7d-bd2f-2d00daca9194 tempest-GroupSnapshotsTest-1497579122 None] Lock "cinder-quobyte-eaa22196-59d6-4ea0-af8b-199c442a5a4e" acquired by "delete_volume" :: waited 0.015s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:49:13 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14b2ca6-c052-41b8-83e4-6abf24f828c3]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:49:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-be6dac5e-f66e-4d7d-bd2f-2d00daca9194 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:14 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-7a2dd9fc-1185-42ba-bd44-3eb62ea57ee4 tempest-CreateVolumesFromImageTest-967432040 None] Acquiring lock "cinder-3d619009-3881-4c8e-a00d-e28b9258d941-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:49:14 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-7a2dd9fc-1185-42ba-bd44-3eb62ea57ee4 tempest-CreateVolumesFromImageTest-967432040 None] Lock "cinder-3d619009-3881-4c8e-a00d-e28b9258d941-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:49:14 devstack sudo[99441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e
Jul 10 12:49:14 devstack sudo[99441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:14 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-7a2dd9fc-1185-42ba-bd44-3eb62ea57ee4 tempest-CreateVolumesFromImageTest-967432040 None] Acquiring lock "cinder-quobyte-3d619009-3881-4c8e-a00d-e28b9258d941" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:49:14 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-7a2dd9fc-1185-42ba-bd44-3eb62ea57ee4 tempest-CreateVolumesFromImageTest-967432040 None] Lock "cinder-quobyte-3d619009-3881-4c8e-a00d-e28b9258d941" acquired by "delete_volume" :: waited 0.019s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:49:14 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[551d72d0-bbed-46cf-b2dc-bc5e86f6f41e]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:49:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7a2dd9fc-1185-42ba-bd44-3eb62ea57ee4 tempest-CreateVolumesFromImageTest-967432040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3d619009-3881-4c8e-a00d-e28b9258d941 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:14 devstack sudo[99443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3d619009-3881-4c8e-a00d-e28b9258d941
Jul 10 12:49:14 devstack sudo[99443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:14 devstack sudo[99437]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3c8195d0-783e-48d7-9002-9f684cfe75c8 tempest-CreateVolumesFromImageTest-967432040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.752s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:14 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-3c8195d0-783e-48d7-9002-9f684cfe75c8 tempest-CreateVolumesFromImageTest-967432040 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:49:14 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-3c8195d0-783e-48d7-9002-9f684cfe75c8 tempest-CreateVolumesFromImageTest-967432040 None] Deleted volume successfully.
Jul 10 12:49:14 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3c8195d0-783e-48d7-9002-9f684cfe75c8 tempest-CreateVolumesFromImageTest-967432040 None] Lock "cinder-94e03b89-9a17-4d4f-96b2-dc48da005206-delete_volume" released by "delete_volume" :: held 2.709s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:49:14 devstack sudo[99439]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cc11f208-ee8f-4216-9aa7-fe77d7ffbc71 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.762s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:14 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-cc11f208-ee8f-4216-9aa7-fe77d7ffbc71 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:49:14 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-cc11f208-ee8f-4216-9aa7-fe77d7ffbc71 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Retype volume completed successfully.
Jul 10 12:49:14 devstack sudo[99441]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-be6dac5e-f66e-4d7d-bd2f-2d00daca9194 tempest-GroupSnapshotsTest-1497579122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e" returned: 0 in 0.947s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-be6dac5e-f66e-4d7d-bd2f-2d00daca9194 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:14 devstack sudo[99452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e
Jul 10 12:49:14 devstack sudo[99452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:15 devstack sudo[99443]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7a2dd9fc-1185-42ba-bd44-3eb62ea57ee4 tempest-CreateVolumesFromImageTest-967432040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3d619009-3881-4c8e-a00d-e28b9258d941" returned: 0 in 0.856s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7a2dd9fc-1185-42ba-bd44-3eb62ea57ee4 tempest-CreateVolumesFromImageTest-967432040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3d619009-3881-4c8e-a00d-e28b9258d941 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:15 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-12224826-7cdc-4fe5-96a4-42416fe78963 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Acquiring lock "cinder-ad9058c7-2edc-4c02-bb7c-a0a0c8f39552-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:49:15 devstack sudo[99455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3d619009-3881-4c8e-a00d-e28b9258d941
Jul 10 12:49:15 devstack sudo[99455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:15 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-12224826-7cdc-4fe5-96a4-42416fe78963 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Lock "cinder-ad9058c7-2edc-4c02-bb7c-a0a0c8f39552-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:49:15 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-12224826-7cdc-4fe5-96a4-42416fe78963 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Acquiring lock "cinder-quobyte-ad9058c7-2edc-4c02-bb7c-a0a0c8f39552" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:49:15 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-12224826-7cdc-4fe5-96a4-42416fe78963 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Lock "cinder-quobyte-ad9058c7-2edc-4c02-bb7c-a0a0c8f39552" acquired by "delete_volume" :: waited 0.017s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:49:15 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c90ef7-36db-400c-97bd-c5b05e5e5fce]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:49:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-12224826-7cdc-4fe5-96a4-42416fe78963 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ad9058c7-2edc-4c02-bb7c-a0a0c8f39552 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:15 devstack sudo[99457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ad9058c7-2edc-4c02-bb7c-a0a0c8f39552
Jul 10 12:49:15 devstack sudo[99457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:15 devstack sudo[99452]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-be6dac5e-f66e-4d7d-bd2f-2d00daca9194 tempest-GroupSnapshotsTest-1497579122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-eaa22196-59d6-4ea0-af8b-199c442a5a4e" returned: 0 in 0.706s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:15 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-be6dac5e-f66e-4d7d-bd2f-2d00daca9194 tempest-GroupSnapshotsTest-1497579122 None] Lock "cinder-quobyte-eaa22196-59d6-4ea0-af8b-199c442a5a4e" released by "delete_volume" :: held 1.727s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:49:15 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-be6dac5e-f66e-4d7d-bd2f-2d00daca9194 tempest-GroupSnapshotsTest-1497579122 None] Created reservations ['c91001b9-9855-47b8-bfff-7f6dbfa3f7b3'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:49:15 devstack cinder-volume[87378]: WARNING cinder.quota [None req-be6dac5e-f66e-4d7d-bd2f-2d00daca9194 tempest-GroupSnapshotsTest-1497579122 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1990541158 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1990541158, it is now deprecated. Please use the default quota class for default quota.
Jul 10 12:49:15 devstack sudo[99455]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7a2dd9fc-1185-42ba-bd44-3eb62ea57ee4 tempest-CreateVolumesFromImageTest-967432040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3d619009-3881-4c8e-a00d-e28b9258d941" returned: 0 in 0.725s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:15 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-be6dac5e-f66e-4d7d-bd2f-2d00daca9194 tempest-GroupSnapshotsTest-1497579122 None] Created reservations ['20d8aaed-7818-416d-b36e-909a6d7d133d', 'e20cef76-d113-40ac-800c-c821630c2323', '5b97b5ef-076f-4882-9c9c-778acf06aa4c', 'c7b88f5e-5fcc-469c-adf1-44041bee9801'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:49:15 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-7a2dd9fc-1185-42ba-bd44-3eb62ea57ee4 tempest-CreateVolumesFromImageTest-967432040 None] Lock "cinder-quobyte-3d619009-3881-4c8e-a00d-e28b9258d941" released by "delete_volume" :: held 1.632s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:49:15 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-7a2dd9fc-1185-42ba-bd44-3eb62ea57ee4 tempest-CreateVolumesFromImageTest-967432040 None] Created reservations ['ef7a5fbe-c46e-4e2a-b117-0c85ec0a3b55', '6b6b369e-1d42-4624-8a00-7882eb9bfde4', 'c61393e4-3c0e-4a89-96bd-398ae264ee8f', 'f785a1da-f03e-4730-a999-7078cb509b19'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:49:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-7a2dd9fc-1185-42ba-bd44-3eb62ea57ee4 tempest-CreateVolumesFromImageTest-967432040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:49:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-7a2dd9fc-1185-42ba-bd44-3eb62ea57ee4 tempest-CreateVolumesFromImageTest-967432040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:15 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-7a2dd9fc-1185-42ba-bd44-3eb62ea57ee4 tempest-CreateVolumesFromImageTest-967432040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:49:15 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-7a2dd9fc-1185-42ba-bd44-3eb62ea57ee4 tempest-CreateVolumesFromImageTest-967432040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:49:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-7a2dd9fc-1185-42ba-bd44-3eb62ea57ee4 tempest-CreateVolumesFromImageTest-967432040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7a2dd9fc-1185-42ba-bd44-3eb62ea57ee4 tempest-CreateVolumesFromImageTest-967432040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:15 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-be6dac5e-f66e-4d7d-bd2f-2d00daca9194 tempest-GroupSnapshotsTest-1497579122 None] Created reservations ['a70054ca-e393-4ac7-9041-b525ee45b522', 'c5326e77-49e0-40ce-bcc3-e4c86de02cc4', '7ec54e9b-cc65-4cd5-a1d2-f470bad25038', '9839391b-2765-448f-bbe2-e60b2374d048'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:49:15 devstack sudo[99465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:49:15 devstack sudo[99465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:16 devstack sudo[99457]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-12224826-7cdc-4fe5-96a4-42416fe78963 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ad9058c7-2edc-4c02-bb7c-a0a0c8f39552" returned: 0 in 0.818s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-12224826-7cdc-4fe5-96a4-42416fe78963 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ad9058c7-2edc-4c02-bb7c-a0a0c8f39552 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:16 devstack sudo[99467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ad9058c7-2edc-4c02-bb7c-a0a0c8f39552
Jul 10 12:49:16 devstack sudo[99467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-be6dac5e-f66e-4d7d-bd2f-2d00daca9194 tempest-GroupSnapshotsTest-1497579122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:49:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-be6dac5e-f66e-4d7d-bd2f-2d00daca9194 tempest-GroupSnapshotsTest-1497579122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:16 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-be6dac5e-f66e-4d7d-bd2f-2d00daca9194 tempest-GroupSnapshotsTest-1497579122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:49:16 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-be6dac5e-f66e-4d7d-bd2f-2d00daca9194 tempest-GroupSnapshotsTest-1497579122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:49:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-be6dac5e-f66e-4d7d-bd2f-2d00daca9194 tempest-GroupSnapshotsTest-1497579122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-be6dac5e-f66e-4d7d-bd2f-2d00daca9194 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:16 devstack sudo[99469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:49:16 devstack sudo[99469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:16 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e366b53e-e342-4a9d-8794-27a7d40591f0 tempest-CreateVolumesFromImageTest-967432040 None] Acquiring lock "cinder-3d083de1-a437-4d9c-ac8d-a05c7230681e-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:49:16 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e366b53e-e342-4a9d-8794-27a7d40591f0 tempest-CreateVolumesFromImageTest-967432040 None] Lock "cinder-3d083de1-a437-4d9c-ac8d-a05c7230681e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:49:16 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e366b53e-e342-4a9d-8794-27a7d40591f0 tempest-CreateVolumesFromImageTest-967432040 None] Acquiring lock "cinder-quobyte-3d083de1-a437-4d9c-ac8d-a05c7230681e" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:49:16 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e366b53e-e342-4a9d-8794-27a7d40591f0 tempest-CreateVolumesFromImageTest-967432040 None] Lock "cinder-quobyte-3d083de1-a437-4d9c-ac8d-a05c7230681e" acquired by "delete_volume" :: waited 0.027s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:49:16 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5c7920-3060-4b19-99d9-b13890abaa0e]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:49:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e366b53e-e342-4a9d-8794-27a7d40591f0 tempest-CreateVolumesFromImageTest-967432040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3d083de1-a437-4d9c-ac8d-a05c7230681e {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:16 devstack sudo[99471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3d083de1-a437-4d9c-ac8d-a05c7230681e
Jul 10 12:49:16 devstack sudo[99471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:16 devstack sudo[99465]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7a2dd9fc-1185-42ba-bd44-3eb62ea57ee4 tempest-CreateVolumesFromImageTest-967432040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.772s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:16 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-7a2dd9fc-1185-42ba-bd44-3eb62ea57ee4 tempest-CreateVolumesFromImageTest-967432040 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:49:16 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-7a2dd9fc-1185-42ba-bd44-3eb62ea57ee4 tempest-CreateVolumesFromImageTest-967432040 None] Deleted volume successfully.
Jul 10 12:49:16 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-7a2dd9fc-1185-42ba-bd44-3eb62ea57ee4 tempest-CreateVolumesFromImageTest-967432040 None] Lock "cinder-3d619009-3881-4c8e-a00d-e28b9258d941-delete_volume" released by "delete_volume" :: held 2.717s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:49:16 devstack sudo[99467]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-12224826-7cdc-4fe5-96a4-42416fe78963 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ad9058c7-2edc-4c02-bb7c-a0a0c8f39552" returned: 0 in 0.781s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:16 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-12224826-7cdc-4fe5-96a4-42416fe78963 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Lock "cinder-quobyte-ad9058c7-2edc-4c02-bb7c-a0a0c8f39552" released by "delete_volume" :: held 1.645s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:49:16 devstack cinder-volume[87378]: WARNING cinder.quota [None req-12224826-7cdc-4fe5-96a4-42416fe78963 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jul 10 12:49:16 devstack cinder-volume[87378]: WARNING cinder.quota [None req-12224826-7cdc-4fe5-96a4-42416fe78963 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jul 10 12:49:16 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-12224826-7cdc-4fe5-96a4-42416fe78963 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Created reservations ['776e0b2e-b3af-4202-a8e7-b22fd4366994', '2c062ff2-5780-46b4-b274-d60db4dfeda5', 'fa7dd10f-8adf-49ff-9c6f-319b974cc283', '315b72fe-6edd-471a-8825-05fb4ea59f45'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:49:16 devstack sudo[99469]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-be6dac5e-f66e-4d7d-bd2f-2d00daca9194 tempest-GroupSnapshotsTest-1497579122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.752s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:16 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-be6dac5e-f66e-4d7d-bd2f-2d00daca9194 tempest-GroupSnapshotsTest-1497579122 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:49:16 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-be6dac5e-f66e-4d7d-bd2f-2d00daca9194 tempest-GroupSnapshotsTest-1497579122 None] Delete group completed successfully.
Jul 10 12:49:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-12224826-7cdc-4fe5-96a4-42416fe78963 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:49:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-12224826-7cdc-4fe5-96a4-42416fe78963 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:16 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-12224826-7cdc-4fe5-96a4-42416fe78963 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:49:16 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-12224826-7cdc-4fe5-96a4-42416fe78963 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:49:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-12224826-7cdc-4fe5-96a4-42416fe78963 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-12224826-7cdc-4fe5-96a4-42416fe78963 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:16 devstack sudo[99476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:49:16 devstack sudo[99476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:17 devstack sudo[99471]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e366b53e-e342-4a9d-8794-27a7d40591f0 tempest-CreateVolumesFromImageTest-967432040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3d083de1-a437-4d9c-ac8d-a05c7230681e" returned: 0 in 0.845s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e366b53e-e342-4a9d-8794-27a7d40591f0 tempest-CreateVolumesFromImageTest-967432040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3d083de1-a437-4d9c-ac8d-a05c7230681e {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:17 devstack sudo[99482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3d083de1-a437-4d9c-ac8d-a05c7230681e
Jul 10 12:49:17 devstack sudo[99482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:17 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-d65b0569-9204-4470-ad15-e6fbf36f5e35 tempest-GroupSnapshotsTest-1497579122 None] Group tempest-GroupSnapshotsTest-Group-1515234716: creating
Jul 10 12:49:17 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-d65b0569-9204-4470-ad15-e6fbf36f5e35 tempest-GroupSnapshotsTest-1497579122 None] Group tempest-GroupSnapshotsTest-Group-1515234716: created successfully
Jul 10 12:49:17 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-d65b0569-9204-4470-ad15-e6fbf36f5e35 tempest-GroupSnapshotsTest-1497579122 None] Create group completed successfully.
Jul 10 12:49:17 devstack sudo[99476]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-12224826-7cdc-4fe5-96a4-42416fe78963 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.727s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:17 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-12224826-7cdc-4fe5-96a4-42416fe78963 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:49:17 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-12224826-7cdc-4fe5-96a4-42416fe78963 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Deleted volume successfully.
Jul 10 12:49:17 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-12224826-7cdc-4fe5-96a4-42416fe78963 tempest-VolumeRetypeWithoutMigrationTest-1174212086 None] Lock "cinder-ad9058c7-2edc-4c02-bb7c-a0a0c8f39552-delete_volume" released by "delete_volume" :: held 2.614s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:49:18 devstack sudo[99482]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e366b53e-e342-4a9d-8794-27a7d40591f0 tempest-CreateVolumesFromImageTest-967432040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3d083de1-a437-4d9c-ac8d-a05c7230681e" returned: 0 in 0.758s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:18 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e366b53e-e342-4a9d-8794-27a7d40591f0 tempest-CreateVolumesFromImageTest-967432040 None] Lock "cinder-quobyte-3d083de1-a437-4d9c-ac8d-a05c7230681e" released by "delete_volume" :: held 1.659s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:49:18 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-e366b53e-e342-4a9d-8794-27a7d40591f0 tempest-CreateVolumesFromImageTest-967432040 None] Created reservations ['05167134-ab55-4c87-a8b9-4576eeb70cb3', '9ea523ba-7bd2-4303-90ce-102942cd9564', '1643c70c-906f-4a61-b4e5-e8a78a4b967a', 'bee5c914-b8e7-4175-afbd-2e56b694b7e1'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:49:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e366b53e-e342-4a9d-8794-27a7d40591f0 tempest-CreateVolumesFromImageTest-967432040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:49:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e366b53e-e342-4a9d-8794-27a7d40591f0 tempest-CreateVolumesFromImageTest-967432040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:18 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-e366b53e-e342-4a9d-8794-27a7d40591f0 tempest-CreateVolumesFromImageTest-967432040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:49:18 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-e366b53e-e342-4a9d-8794-27a7d40591f0 tempest-CreateVolumesFromImageTest-967432040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:49:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e366b53e-e342-4a9d-8794-27a7d40591f0 tempest-CreateVolumesFromImageTest-967432040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e366b53e-e342-4a9d-8794-27a7d40591f0 tempest-CreateVolumesFromImageTest-967432040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:18 devstack sudo[99486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:49:18 devstack sudo[99486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:18 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b8b731f3-10ed-44a0-bfc5-d6f1e50a8eb7 tempest-CreateVolumesFromImageTest-967432040 None] Acquiring lock "cinder-8e2cd746-0836-47cb-81c6-3ac85661de69-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:49:18 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b8b731f3-10ed-44a0-bfc5-d6f1e50a8eb7 tempest-CreateVolumesFromImageTest-967432040 None] Lock "cinder-8e2cd746-0836-47cb-81c6-3ac85661de69-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:49:18 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b8b731f3-10ed-44a0-bfc5-d6f1e50a8eb7 tempest-CreateVolumesFromImageTest-967432040 None] Acquiring lock "cinder-quobyte-8e2cd746-0836-47cb-81c6-3ac85661de69" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:49:18 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b8b731f3-10ed-44a0-bfc5-d6f1e50a8eb7 tempest-CreateVolumesFromImageTest-967432040 None] Lock "cinder-quobyte-8e2cd746-0836-47cb-81c6-3ac85661de69" acquired by "delete_volume" :: waited 0.024s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:49:18 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c61bb0-d78f-4966-b944-284001977419]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:49:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b8b731f3-10ed-44a0-bfc5-d6f1e50a8eb7 tempest-CreateVolumesFromImageTest-967432040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8e2cd746-0836-47cb-81c6-3ac85661de69 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:18 devstack sudo[99488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8e2cd746-0836-47cb-81c6-3ac85661de69
Jul 10 12:49:18 devstack sudo[99488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:18 devstack sudo[99486]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e366b53e-e342-4a9d-8794-27a7d40591f0 tempest-CreateVolumesFromImageTest-967432040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.757s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:18 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-e366b53e-e342-4a9d-8794-27a7d40591f0 tempest-CreateVolumesFromImageTest-967432040 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:49:18 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-e366b53e-e342-4a9d-8794-27a7d40591f0 tempest-CreateVolumesFromImageTest-967432040 None] Deleted volume successfully.
Jul 10 12:49:18 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e366b53e-e342-4a9d-8794-27a7d40591f0 tempest-CreateVolumesFromImageTest-967432040 None] Lock "cinder-3d083de1-a437-4d9c-ac8d-a05c7230681e-delete_volume" released by "delete_volume" :: held 2.671s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:49:19 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-25783750-a79a-466f-b288-e137314c23b6 tempest-GroupSnapshotsTest-1497579122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:49:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-25783750-a79a-466f-b288-e137314c23b6 tempest-GroupSnapshotsTest-1497579122 None] Flow 'volume_create_manager' (8a54fb48-98da-461b-ba37-fb3543ca6e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:49:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-25783750-a79a-466f-b288-e137314c23b6 tempest-GroupSnapshotsTest-1497579122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bdd0c3c-50ff-4461-b9bd-3b1ab48530a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-25783750-a79a-466f-b288-e137314c23b6 tempest-GroupSnapshotsTest-1497579122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bdd0c3c-50ff-4461-b9bd-3b1ab48530a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:49:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1847388810',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=57c098bd-a562-4fc7-a27a-39bb0f4c4ed2,host='devstack@QuobyteHD#QuobyteHD',id=41922a08-db15-4086-9dcb-6b7da6e956a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca795075de2f45bf8c75eaa6d162dc93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:49:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:49:19Z,use_quota=True,user_id='662d32fbb232435a8c88e72656348521',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eddec362-4805-49b8-a33f-ef3a5fffcbca),volume_type_id=eddec362-4805-49b8-a33f-ef3a5fffcbca)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-25783750-a79a-466f-b288-e137314c23b6 tempest-GroupSnapshotsTest-1497579122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (918595b8-f1d3-4781-b99f-ebc21c07256d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-25783750-a79a-466f-b288-e137314c23b6 tempest-GroupSnapshotsTest-1497579122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (918595b8-f1d3-4781-b99f-ebc21c07256d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-25783750-a79a-466f-b288-e137314c23b6 tempest-GroupSnapshotsTest-1497579122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d291beed-f001-421a-a6c4-4c360ebf524e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-25783750-a79a-466f-b288-e137314c23b6 tempest-GroupSnapshotsTest-1497579122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d291beed-f001-421a-a6c4-4c360ebf524e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41922a08-db15-4086-9dcb-6b7da6e956a8', 'volume_name': 'volume-41922a08-db15-4086-9dcb-6b7da6e956a8', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-25783750-a79a-466f-b288-e137314c23b6 tempest-GroupSnapshotsTest-1497579122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31e4873e-dd58-4704-9afb-1bcde5d9dd41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-25783750-a79a-466f-b288-e137314c23b6 tempest-GroupSnapshotsTest-1497579122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31e4873e-dd58-4704-9afb-1bcde5d9dd41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-25783750-a79a-466f-b288-e137314c23b6 tempest-GroupSnapshotsTest-1497579122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d8d0f34-3285-4c0b-96de-a4ab651105a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:19 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-25783750-a79a-466f-b288-e137314c23b6 tempest-GroupSnapshotsTest-1497579122 None] Volume 41922a08-db15-4086-9dcb-6b7da6e956a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41922a08-db15-4086-9dcb-6b7da6e956a8', 'volume_size': 1}
Jul 10 12:49:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-25783750-a79a-466f-b288-e137314c23b6 tempest-GroupSnapshotsTest-1497579122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:49:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-25783750-a79a-466f-b288-e137314c23b6 tempest-GroupSnapshotsTest-1497579122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:19 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-25783750-a79a-466f-b288-e137314c23b6 tempest-GroupSnapshotsTest-1497579122 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=57c098bd-a562-4fc7-a27a-39bb0f4c4ed2,created_at=2026-07-10T10:49:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1847388810',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=57c098bd-a562-4fc7-a27a-39bb0f4c4ed2,host='devstack@QuobyteHD#QuobyteHD',id=41922a08-db15-4086-9dcb-6b7da6e956a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca795075de2f45bf8c75eaa6d162dc93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:49:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:49:19Z,use_quota=True,user_id='662d32fbb232435a8c88e72656348521',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eddec362-4805-49b8-a33f-ef3a5fffcbca),volume_type_id=eddec362-4805-49b8-a33f-ef3a5fffcbca)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:49:19 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-25783750-a79a-466f-b288-e137314c23b6 tempest-GroupSnapshotsTest-1497579122 None] Creating volume 41922a08-db15-4086-9dcb-6b7da6e956a8 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:49:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-25783750-a79a-466f-b288-e137314c23b6 tempest-GroupSnapshotsTest-1497579122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:49:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-25783750-a79a-466f-b288-e137314c23b6 tempest-GroupSnapshotsTest-1497579122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:19 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-25783750-a79a-466f-b288-e137314c23b6 tempest-GroupSnapshotsTest-1497579122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:49:19 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-25783750-a79a-466f-b288-e137314c23b6 tempest-GroupSnapshotsTest-1497579122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:49:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-25783750-a79a-466f-b288-e137314c23b6 tempest-GroupSnapshotsTest-1497579122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:19 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-25783750-a79a-466f-b288-e137314c23b6 tempest-GroupSnapshotsTest-1497579122 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:49:19 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-25783750-a79a-466f-b288-e137314c23b6 tempest-GroupSnapshotsTest-1497579122 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:49:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-25783750-a79a-466f-b288-e137314c23b6 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-41922a08-db15-4086-9dcb-6b7da6e956a8 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:19 devstack sudo[99492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-41922a08-db15-4086-9dcb-6b7da6e956a8 1073741824
Jul 10 12:49:19 devstack sudo[99492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:19 devstack sudo[99488]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b8b731f3-10ed-44a0-bfc5-d6f1e50a8eb7 tempest-CreateVolumesFromImageTest-967432040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8e2cd746-0836-47cb-81c6-3ac85661de69" returned: 0 in 0.923s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b8b731f3-10ed-44a0-bfc5-d6f1e50a8eb7 tempest-CreateVolumesFromImageTest-967432040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8e2cd746-0836-47cb-81c6-3ac85661de69 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:19 devstack sudo[99498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8e2cd746-0836-47cb-81c6-3ac85661de69
Jul 10 12:49:19 devstack sudo[99498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:20 devstack sudo[99492]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-25783750-a79a-466f-b288-e137314c23b6 tempest-GroupSnapshotsTest-1497579122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-41922a08-db15-4086-9dcb-6b7da6e956a8 1073741824" returned: 0 in 1.043s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:20 devstack sudo[99498]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b8b731f3-10ed-44a0-bfc5-d6f1e50a8eb7 tempest-CreateVolumesFromImageTest-967432040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8e2cd746-0836-47cb-81c6-3ac85661de69" returned: 0 in 0.781s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:20 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b8b731f3-10ed-44a0-bfc5-d6f1e50a8eb7 tempest-CreateVolumesFromImageTest-967432040 None] Lock "cinder-quobyte-8e2cd746-0836-47cb-81c6-3ac85661de69" released by "delete_volume" :: held 1.767s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:49:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-25783750-a79a-466f-b288-e137314c23b6 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-41922a08-db15-4086-9dcb-6b7da6e956a8 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:20 devstack sudo[99507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-41922a08-db15-4086-9dcb-6b7da6e956a8
Jul 10 12:49:20 devstack sudo[99507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:20 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-b8b731f3-10ed-44a0-bfc5-d6f1e50a8eb7 tempest-CreateVolumesFromImageTest-967432040 None] Created reservations ['795a81b9-1414-4517-add6-e2fedf1d7ed7', '51ac8e93-cf34-47f3-87ed-b917fcd5b7dc', 'c778caf7-48d4-4c89-aabe-e8b1b5ad0b91', 'ea180a52-6d21-4ff2-88a9-fad8c7574f62'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:49:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-b8b731f3-10ed-44a0-bfc5-d6f1e50a8eb7 tempest-CreateVolumesFromImageTest-967432040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:49:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-b8b731f3-10ed-44a0-bfc5-d6f1e50a8eb7 tempest-CreateVolumesFromImageTest-967432040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:20 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-b8b731f3-10ed-44a0-bfc5-d6f1e50a8eb7 tempest-CreateVolumesFromImageTest-967432040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:49:20 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-b8b731f3-10ed-44a0-bfc5-d6f1e50a8eb7 tempest-CreateVolumesFromImageTest-967432040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:49:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-b8b731f3-10ed-44a0-bfc5-d6f1e50a8eb7 tempest-CreateVolumesFromImageTest-967432040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b8b731f3-10ed-44a0-bfc5-d6f1e50a8eb7 tempest-CreateVolumesFromImageTest-967432040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:20 devstack sudo[99509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:49:20 devstack sudo[99509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:20 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-6c7610fb-5ce2-4920-98ef-20b1a691f93a tempest-CreateVolumesFromImageTest-967432040 None] Acquiring lock "cinder-91ebe59a-90d5-4717-8813-d55dd0ee9efb-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:49:20 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-6c7610fb-5ce2-4920-98ef-20b1a691f93a tempest-CreateVolumesFromImageTest-967432040 None] Lock "cinder-91ebe59a-90d5-4717-8813-d55dd0ee9efb-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:49:20 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-6c7610fb-5ce2-4920-98ef-20b1a691f93a tempest-CreateVolumesFromImageTest-967432040 None] Acquiring lock "cinder-quobyte-91ebe59a-90d5-4717-8813-d55dd0ee9efb" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:49:20 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-6c7610fb-5ce2-4920-98ef-20b1a691f93a tempest-CreateVolumesFromImageTest-967432040 None] Lock "cinder-quobyte-91ebe59a-90d5-4717-8813-d55dd0ee9efb" acquired by "delete_volume" :: waited 0.021s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:49:21 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e085799f-988b-4789-be1e-a3af93e18feb]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:49:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6c7610fb-5ce2-4920-98ef-20b1a691f93a tempest-CreateVolumesFromImageTest-967432040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-91ebe59a-90d5-4717-8813-d55dd0ee9efb {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:21 devstack sudo[99511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-91ebe59a-90d5-4717-8813-d55dd0ee9efb
Jul 10 12:49:21 devstack sudo[99511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:21 devstack sudo[99507]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-25783750-a79a-466f-b288-e137314c23b6 tempest-GroupSnapshotsTest-1497579122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-41922a08-db15-4086-9dcb-6b7da6e956a8" returned: 0 in 0.823s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:21 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-25783750-a79a-466f-b288-e137314c23b6 tempest-GroupSnapshotsTest-1497579122 None] <== create_volume: return (1932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:49:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-25783750-a79a-466f-b288-e137314c23b6 tempest-GroupSnapshotsTest-1497579122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.934s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:21 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-25783750-a79a-466f-b288-e137314c23b6 tempest-GroupSnapshotsTest-1497579122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d8d0f34-3285-4c0b-96de-a4ab651105a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41922a08-db15-4086-9dcb-6b7da6e956a8', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:21 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-25783750-a79a-466f-b288-e137314c23b6 tempest-GroupSnapshotsTest-1497579122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (350a8885-5088-4142-b7b7-f7d63dc55ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:21 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-25783750-a79a-466f-b288-e137314c23b6 tempest-GroupSnapshotsTest-1497579122 None] Volume volume-41922a08-db15-4086-9dcb-6b7da6e956a8 (41922a08-db15-4086-9dcb-6b7da6e956a8): created successfully
Jul 10 12:49:21 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-25783750-a79a-466f-b288-e137314c23b6 tempest-GroupSnapshotsTest-1497579122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (350a8885-5088-4142-b7b7-f7d63dc55ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:21 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-25783750-a79a-466f-b288-e137314c23b6 tempest-GroupSnapshotsTest-1497579122 None] Flow 'volume_create_manager' (8a54fb48-98da-461b-ba37-fb3543ca6e8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:49:21 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-25783750-a79a-466f-b288-e137314c23b6 tempest-GroupSnapshotsTest-1497579122 None] Created volume successfully.
Jul 10 12:49:21 devstack sudo[99509]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b8b731f3-10ed-44a0-bfc5-d6f1e50a8eb7 tempest-CreateVolumesFromImageTest-967432040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.777s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:21 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-b8b731f3-10ed-44a0-bfc5-d6f1e50a8eb7 tempest-CreateVolumesFromImageTest-967432040 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:49:21 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-b8b731f3-10ed-44a0-bfc5-d6f1e50a8eb7 tempest-CreateVolumesFromImageTest-967432040 None] Deleted volume successfully.
Jul 10 12:49:21 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b8b731f3-10ed-44a0-bfc5-d6f1e50a8eb7 tempest-CreateVolumesFromImageTest-967432040 None] Lock "cinder-8e2cd746-0836-47cb-81c6-3ac85661de69-delete_volume" released by "delete_volume" :: held 2.840s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:49:21 devstack sudo[99511]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6c7610fb-5ce2-4920-98ef-20b1a691f93a tempest-CreateVolumesFromImageTest-967432040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-91ebe59a-90d5-4717-8813-d55dd0ee9efb" returned: 0 in 0.895s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6c7610fb-5ce2-4920-98ef-20b1a691f93a tempest-CreateVolumesFromImageTest-967432040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-91ebe59a-90d5-4717-8813-d55dd0ee9efb {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:21 devstack sudo[99552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-91ebe59a-90d5-4717-8813-d55dd0ee9efb
Jul 10 12:49:21 devstack sudo[99552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:21 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-5b244d13-2a5b-4c00-961a-e52ecccc8a9f tempest-GroupSnapshotsTest-1497579122 None] GroupSnapshot 55407a66-27f0-48fb-8298-e03d19874150: creating.
Jul 10 12:49:22 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5b244d13-2a5b-4c00-961a-e52ecccc8a9f tempest-GroupSnapshotsTest-1497579122 None] Group snapshot 55407a66-27f0-48fb-8298-e03d19874150: creating. {{(pid=87378) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 10 12:49:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5b244d13-2a5b-4c00-961a-e52ecccc8a9f tempest-GroupSnapshotsTest-1497579122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:49:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5b244d13-2a5b-4c00-961a-e52ecccc8a9f tempest-GroupSnapshotsTest-1497579122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:22 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-5b244d13-2a5b-4c00-961a-e52ecccc8a9f tempest-GroupSnapshotsTest-1497579122 None] Creating offline snapshot 122da914-95ac-45a5-8142-6eb567e35eab of volume 41922a08-db15-4086-9dcb-6b7da6e956a8 {{(pid=87378) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 10 12:49:22 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11a4758-3853-4267-99b3-3e9b22eaf3dc]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:49:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5b244d13-2a5b-4c00-961a-e52ecccc8a9f tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-41922a08-db15-4086-9dcb-6b7da6e956a8 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:22 devstack sudo[99556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-41922a08-db15-4086-9dcb-6b7da6e956a8
Jul 10 12:49:22 devstack sudo[99556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:22 devstack sudo[99552]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6c7610fb-5ce2-4920-98ef-20b1a691f93a tempest-CreateVolumesFromImageTest-967432040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-91ebe59a-90d5-4717-8813-d55dd0ee9efb" returned: 0 in 0.770s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:22 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-6c7610fb-5ce2-4920-98ef-20b1a691f93a tempest-CreateVolumesFromImageTest-967432040 None] Lock "cinder-quobyte-91ebe59a-90d5-4717-8813-d55dd0ee9efb" released by "delete_volume" :: held 1.717s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:49:22 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-6c7610fb-5ce2-4920-98ef-20b1a691f93a tempest-CreateVolumesFromImageTest-967432040 None] Created reservations ['10c554b5-f2f0-4e60-ac68-fb7ac6b145ed', '02d37590-3705-4d30-9746-944661c73124', 'd8a87c52-e82a-4ba9-abc1-680349811aaf', 'ef553bcc-0fae-4883-b60a-523deaa58d4f'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:49:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-6c7610fb-5ce2-4920-98ef-20b1a691f93a tempest-CreateVolumesFromImageTest-967432040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:49:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-6c7610fb-5ce2-4920-98ef-20b1a691f93a tempest-CreateVolumesFromImageTest-967432040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:22 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-6c7610fb-5ce2-4920-98ef-20b1a691f93a tempest-CreateVolumesFromImageTest-967432040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:49:22 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-6c7610fb-5ce2-4920-98ef-20b1a691f93a tempest-CreateVolumesFromImageTest-967432040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:49:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-6c7610fb-5ce2-4920-98ef-20b1a691f93a tempest-CreateVolumesFromImageTest-967432040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6c7610fb-5ce2-4920-98ef-20b1a691f93a tempest-CreateVolumesFromImageTest-967432040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:22 devstack sudo[99562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:49:22 devstack sudo[99562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:23 devstack sudo[99556]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5b244d13-2a5b-4c00-961a-e52ecccc8a9f tempest-GroupSnapshotsTest-1497579122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-41922a08-db15-4086-9dcb-6b7da6e956a8" returned: 0 in 0.919s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5b244d13-2a5b-4c00-961a-e52ecccc8a9f tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-41922a08-db15-4086-9dcb-6b7da6e956a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-41922a08-db15-4086-9dcb-6b7da6e956a8.122da914-95ac-45a5-8142-6eb567e35eab 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:23 devstack sudo[99564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-41922a08-db15-4086-9dcb-6b7da6e956a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-41922a08-db15-4086-9dcb-6b7da6e956a8.122da914-95ac-45a5-8142-6eb567e35eab 1G
Jul 10 12:49:23 devstack sudo[99564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:23 devstack sudo[99562]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6c7610fb-5ce2-4920-98ef-20b1a691f93a tempest-CreateVolumesFromImageTest-967432040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.782s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:23 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-6c7610fb-5ce2-4920-98ef-20b1a691f93a tempest-CreateVolumesFromImageTest-967432040 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:49:23 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-6c7610fb-5ce2-4920-98ef-20b1a691f93a tempest-CreateVolumesFromImageTest-967432040 None] Deleted volume successfully.
Jul 10 12:49:23 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-6c7610fb-5ce2-4920-98ef-20b1a691f93a tempest-CreateVolumesFromImageTest-967432040 None] Lock "cinder-91ebe59a-90d5-4717-8813-d55dd0ee9efb-delete_volume" released by "delete_volume" :: held 2.788s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:49:24 devstack sudo[99564]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5b244d13-2a5b-4c00-961a-e52ecccc8a9f tempest-GroupSnapshotsTest-1497579122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-41922a08-db15-4086-9dcb-6b7da6e956a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-41922a08-db15-4086-9dcb-6b7da6e956a8.122da914-95ac-45a5-8142-6eb567e35eab 1G" returned: 0 in 1.026s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5b244d13-2a5b-4c00-961a-e52ecccc8a9f tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41922a08-db15-4086-9dcb-6b7da6e956a8 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-41922a08-db15-4086-9dcb-6b7da6e956a8.122da914-95ac-45a5-8142-6eb567e35eab {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:24 devstack sudo[99571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41922a08-db15-4086-9dcb-6b7da6e956a8 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-41922a08-db15-4086-9dcb-6b7da6e956a8.122da914-95ac-45a5-8142-6eb567e35eab
Jul 10 12:49:24 devstack sudo[99571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:24 devstack sudo[99571]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5b244d13-2a5b-4c00-961a-e52ecccc8a9f tempest-GroupSnapshotsTest-1497579122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41922a08-db15-4086-9dcb-6b7da6e956a8 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-41922a08-db15-4086-9dcb-6b7da6e956a8.122da914-95ac-45a5-8142-6eb567e35eab" returned: 0 in 0.833s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:24 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-5b244d13-2a5b-4c00-961a-e52ecccc8a9f tempest-GroupSnapshotsTest-1497579122 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-41922a08-db15-4086-9dcb-6b7da6e956a8.122da914-95ac-45a5-8142-6eb567e35eab is being set with open permissions: ugo+rw: NotImplementedError
Jul 10 12:49:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5b244d13-2a5b-4c00-961a-e52ecccc8a9f tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-41922a08-db15-4086-9dcb-6b7da6e956a8.122da914-95ac-45a5-8142-6eb567e35eab {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:24 devstack sudo[99576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-41922a08-db15-4086-9dcb-6b7da6e956a8.122da914-95ac-45a5-8142-6eb567e35eab
Jul 10 12:49:24 devstack sudo[99576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:25 devstack sudo[99576]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5b244d13-2a5b-4c00-961a-e52ecccc8a9f tempest-GroupSnapshotsTest-1497579122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-41922a08-db15-4086-9dcb-6b7da6e956a8.122da914-95ac-45a5-8142-6eb567e35eab" returned: 0 in 0.749s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5b244d13-2a5b-4c00-961a-e52ecccc8a9f tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-41922a08-db15-4086-9dcb-6b7da6e956a8.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:25 devstack sudo[99579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-41922a08-db15-4086-9dcb-6b7da6e956a8.info
Jul 10 12:49:25 devstack sudo[99579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:26 devstack sudo[99579]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5b244d13-2a5b-4c00-961a-e52ecccc8a9f tempest-GroupSnapshotsTest-1497579122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-41922a08-db15-4086-9dcb-6b7da6e956a8.info" returned: 0 in 0.757s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:26 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-5b244d13-2a5b-4c00-961a-e52ecccc8a9f tempest-GroupSnapshotsTest-1497579122 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-41922a08-db15-4086-9dcb-6b7da6e956a8.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 10 12:49:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5b244d13-2a5b-4c00-961a-e52ecccc8a9f tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-41922a08-db15-4086-9dcb-6b7da6e956a8.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:26 devstack sudo[99584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-41922a08-db15-4086-9dcb-6b7da6e956a8.info
Jul 10 12:49:26 devstack sudo[99584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:26 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dbfa0e6-1591-4705-92a9-b25a62464b2e tempest-CreateVolumesFromSnapshotTest-1687039053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:49:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5dbfa0e6-1591-4705-92a9-b25a62464b2e tempest-CreateVolumesFromSnapshotTest-1687039053 None] Flow 'volume_create_manager' (e64f8d05-c80c-4d00-923b-e11ec507d746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:49:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5dbfa0e6-1591-4705-92a9-b25a62464b2e tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (063a4cd4-6e94-4ea9-bb86-ed58b96ed799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5dbfa0e6-1591-4705-92a9-b25a62464b2e tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (063a4cd4-6e94-4ea9-bb86-ed58b96ed799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:49:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1225438670',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b672e8fc6a4745d8a981a4b3bfc5ccdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:49:27Z,use_quota=True,user_id='c639dd0a31794446b044a5425a4a6882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5dbfa0e6-1591-4705-92a9-b25a62464b2e tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f787305-851b-4b8e-9ade-2776e0317597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5dbfa0e6-1591-4705-92a9-b25a62464b2e tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f787305-851b-4b8e-9ade-2776e0317597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5dbfa0e6-1591-4705-92a9-b25a62464b2e tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e7723eb-fdee-4da2-9feb-cb7e8fefa89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5dbfa0e6-1591-4705-92a9-b25a62464b2e tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e7723eb-fdee-4da2-9feb-cb7e8fefa89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760', 'volume_name': 'volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5dbfa0e6-1591-4705-92a9-b25a62464b2e tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db34f01d-4476-4c2e-8f8a-70282e48f4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5dbfa0e6-1591-4705-92a9-b25a62464b2e tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db34f01d-4476-4c2e-8f8a-70282e48f4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5dbfa0e6-1591-4705-92a9-b25a62464b2e tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5509d3a-6d9b-40ce-a293-2f87be6cc9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:26 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-5dbfa0e6-1591-4705-92a9-b25a62464b2e tempest-CreateVolumesFromSnapshotTest-1687039053 None] Volume 0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760', 'volume_size': 1}
Jul 10 12:49:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5dbfa0e6-1591-4705-92a9-b25a62464b2e tempest-CreateVolumesFromSnapshotTest-1687039053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:49:27 devstack sudo[99584]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5b244d13-2a5b-4c00-961a-e52ecccc8a9f tempest-GroupSnapshotsTest-1497579122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-41922a08-db15-4086-9dcb-6b7da6e956a8.info" returned: 0 in 0.771s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5b244d13-2a5b-4c00-961a-e52ecccc8a9f tempest-GroupSnapshotsTest-1497579122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.177s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5dbfa0e6-1591-4705-92a9-b25a62464b2e tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.469s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:27 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5dbfa0e6-1591-4705-92a9-b25a62464b2e tempest-CreateVolumesFromSnapshotTest-1687039053 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:49:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1225438670',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b672e8fc6a4745d8a981a4b3bfc5ccdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:49:27Z,use_quota=True,user_id='c639dd0a31794446b044a5425a4a6882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:49:27 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-5dbfa0e6-1591-4705-92a9-b25a62464b2e tempest-CreateVolumesFromSnapshotTest-1687039053 None] Creating volume 0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:49:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5dbfa0e6-1591-4705-92a9-b25a62464b2e tempest-CreateVolumesFromSnapshotTest-1687039053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:49:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5dbfa0e6-1591-4705-92a9-b25a62464b2e tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:27 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5dbfa0e6-1591-4705-92a9-b25a62464b2e tempest-CreateVolumesFromSnapshotTest-1687039053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:49:27 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5dbfa0e6-1591-4705-92a9-b25a62464b2e tempest-CreateVolumesFromSnapshotTest-1687039053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:49:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5dbfa0e6-1591-4705-92a9-b25a62464b2e tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:27 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5dbfa0e6-1591-4705-92a9-b25a62464b2e tempest-CreateVolumesFromSnapshotTest-1687039053 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:49:27 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-5dbfa0e6-1591-4705-92a9-b25a62464b2e tempest-CreateVolumesFromSnapshotTest-1687039053 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:49:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5dbfa0e6-1591-4705-92a9-b25a62464b2e tempest-CreateVolumesFromSnapshotTest-1687039053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:27 devstack sudo[99588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760 1073741824
Jul 10 12:49:27 devstack sudo[99588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:27 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-5b244d13-2a5b-4c00-961a-e52ecccc8a9f tempest-GroupSnapshotsTest-1497579122 None] group_snapshot 55407a66-27f0-48fb-8298-e03d19874150: created successfully
Jul 10 12:49:27 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-bd3afef3-e628-4ca0-b3cd-65ce381168f4 tempest-GroupSnapshotsTest-1497579122 None] group_snapshot 55407a66-27f0-48fb-8298-e03d19874150: deleting
Jul 10 12:49:27 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bd3afef3-e628-4ca0-b3cd-65ce381168f4 tempest-GroupSnapshotsTest-1497579122 None] group_snapshot 55407a66-27f0-48fb-8298-e03d19874150: deleting {{(pid=87378) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 10 12:49:27 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-bd3afef3-e628-4ca0-b3cd-65ce381168f4 tempest-GroupSnapshotsTest-1497579122 None] Acquiring lock "cinder-quobyte-41922a08-db15-4086-9dcb-6b7da6e956a8" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:49:27 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-bd3afef3-e628-4ca0-b3cd-65ce381168f4 tempest-GroupSnapshotsTest-1497579122 None] Lock "cinder-quobyte-41922a08-db15-4086-9dcb-6b7da6e956a8" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:49:27 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-bd3afef3-e628-4ca0-b3cd-65ce381168f4 tempest-GroupSnapshotsTest-1497579122 None] Acquiring lock "cinder-quobyte-122da914-95ac-45a5-8142-6eb567e35eab" by "_delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:49:27 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-bd3afef3-e628-4ca0-b3cd-65ce381168f4 tempest-GroupSnapshotsTest-1497579122 None] Lock "cinder-quobyte-122da914-95ac-45a5-8142-6eb567e35eab" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:49:27 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-bd3afef3-e628-4ca0-b3cd-65ce381168f4 tempest-GroupSnapshotsTest-1497579122 None] Deleting offline snapshot 122da914-95ac-45a5-8142-6eb567e35eab of volume 41922a08-db15-4086-9dcb-6b7da6e956a8 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 10 12:49:27 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-bd3afef3-e628-4ca0-b3cd-65ce381168f4 tempest-GroupSnapshotsTest-1497579122 None] snapshot_file for this snap is: volume-41922a08-db15-4086-9dcb-6b7da6e956a8.122da914-95ac-45a5-8142-6eb567e35eab {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 10 12:49:27 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[65083ead-b2c3-49b6-9bf6-b8de5432cd7b]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:49:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-bd3afef3-e628-4ca0-b3cd-65ce381168f4 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-41922a08-db15-4086-9dcb-6b7da6e956a8.122da914-95ac-45a5-8142-6eb567e35eab {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:27 devstack sudo[99590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-41922a08-db15-4086-9dcb-6b7da6e956a8.122da914-95ac-45a5-8142-6eb567e35eab
Jul 10 12:49:27 devstack sudo[99590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:28 devstack sudo[99588]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5dbfa0e6-1591-4705-92a9-b25a62464b2e tempest-CreateVolumesFromSnapshotTest-1687039053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760 1073741824" returned: 0 in 1.052s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5dbfa0e6-1591-4705-92a9-b25a62464b2e tempest-CreateVolumesFromSnapshotTest-1687039053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:28 devstack sudo[99596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760
Jul 10 12:49:28 devstack sudo[99596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:28 devstack sudo[99590]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-bd3afef3-e628-4ca0-b3cd-65ce381168f4 tempest-GroupSnapshotsTest-1497579122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-41922a08-db15-4086-9dcb-6b7da6e956a8.122da914-95ac-45a5-8142-6eb567e35eab" returned: 0 in 0.892s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:28 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-bd3afef3-e628-4ca0-b3cd-65ce381168f4 tempest-GroupSnapshotsTest-1497579122 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41922a08-db15-4086-9dcb-6b7da6e956a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:49:28 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04ddac5-6634-48e5-a061-26a0e53fc99f]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:49:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-bd3afef3-e628-4ca0-b3cd-65ce381168f4 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-41922a08-db15-4086-9dcb-6b7da6e956a8 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:28 devstack sudo[99601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-41922a08-db15-4086-9dcb-6b7da6e956a8
Jul 10 12:49:28 devstack sudo[99601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:29 devstack sudo[99596]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5dbfa0e6-1591-4705-92a9-b25a62464b2e tempest-CreateVolumesFromSnapshotTest-1687039053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760" returned: 0 in 0.750s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:29 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5dbfa0e6-1591-4705-92a9-b25a62464b2e tempest-CreateVolumesFromSnapshotTest-1687039053 None] <== create_volume: return (1858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:49:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5dbfa0e6-1591-4705-92a9-b25a62464b2e tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.861s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:29 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5dbfa0e6-1591-4705-92a9-b25a62464b2e tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5509d3a-6d9b-40ce-a293-2f87be6cc9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:29 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5dbfa0e6-1591-4705-92a9-b25a62464b2e tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c221faf6-b8aa-4122-a183-19ff559934dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:29 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-5dbfa0e6-1591-4705-92a9-b25a62464b2e tempest-CreateVolumesFromSnapshotTest-1687039053 None] Volume volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760 (0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760): created successfully
Jul 10 12:49:29 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5dbfa0e6-1591-4705-92a9-b25a62464b2e tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c221faf6-b8aa-4122-a183-19ff559934dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:29 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5dbfa0e6-1591-4705-92a9-b25a62464b2e tempest-CreateVolumesFromSnapshotTest-1687039053 None] Flow 'volume_create_manager' (e64f8d05-c80c-4d00-923b-e11ec507d746) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:49:29 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-5dbfa0e6-1591-4705-92a9-b25a62464b2e tempest-CreateVolumesFromSnapshotTest-1687039053 None] Created volume successfully.
Jul 10 12:49:29 devstack sudo[99601]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-bd3afef3-e628-4ca0-b3cd-65ce381168f4 tempest-GroupSnapshotsTest-1497579122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-41922a08-db15-4086-9dcb-6b7da6e956a8" returned: 0 in 0.838s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-bd3afef3-e628-4ca0-b3cd-65ce381168f4 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-41922a08-db15-4086-9dcb-6b7da6e956a8.122da914-95ac-45a5-8142-6eb567e35eab {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:29 devstack sudo[99608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-41922a08-db15-4086-9dcb-6b7da6e956a8.122da914-95ac-45a5-8142-6eb567e35eab
Jul 10 12:49:29 devstack sudo[99608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:30 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f6097795-831a-48f6-99f3-f657c6858733 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:49:30 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f6097795-831a-48f6-99f3-f657c6858733 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:30 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-f6097795-831a-48f6-99f3-f657c6858733 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Creating offline snapshot 78215143-e1ea-4e15-8575-866d7ecc7c0d of volume 0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760 {{(pid=87378) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 10 12:49:30 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[903b372d-e905-4cf6-86b4-0259148bd000]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:49:30 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f6097795-831a-48f6-99f3-f657c6858733 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:30 devstack sudo[99611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760
Jul 10 12:49:30 devstack sudo[99611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:30 devstack sudo[99608]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:30 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-bd3afef3-e628-4ca0-b3cd-65ce381168f4 tempest-GroupSnapshotsTest-1497579122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-41922a08-db15-4086-9dcb-6b7da6e956a8.122da914-95ac-45a5-8142-6eb567e35eab" returned: 0 in 0.827s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:30 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-bd3afef3-e628-4ca0-b3cd-65ce381168f4 tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-41922a08-db15-4086-9dcb-6b7da6e956a8.122da914-95ac-45a5-8142-6eb567e35eab {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:30 devstack sudo[99615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-41922a08-db15-4086-9dcb-6b7da6e956a8.122da914-95ac-45a5-8142-6eb567e35eab
Jul 10 12:49:30 devstack sudo[99615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:30 devstack sudo[99611]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:30 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f6097795-831a-48f6-99f3-f657c6858733 tempest-CreateVolumesFromSnapshotTest-1687039053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760" returned: 0 in 0.814s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:30 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f6097795-831a-48f6-99f3-f657c6858733 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760.78215143-e1ea-4e15-8575-866d7ecc7c0d 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:30 devstack sudo[99621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760.78215143-e1ea-4e15-8575-866d7ecc7c0d 1G
Jul 10 12:49:30 devstack sudo[99621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:30 devstack sudo[99615]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-bd3afef3-e628-4ca0-b3cd-65ce381168f4 tempest-GroupSnapshotsTest-1497579122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-41922a08-db15-4086-9dcb-6b7da6e956a8.122da914-95ac-45a5-8142-6eb567e35eab" returned: 0 in 0.704s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:31 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-bd3afef3-e628-4ca0-b3cd-65ce381168f4 tempest-GroupSnapshotsTest-1497579122 None] Lock "cinder-quobyte-122da914-95ac-45a5-8142-6eb567e35eab" released by "_delete_snapshot" :: held 3.387s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:49:31 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-bd3afef3-e628-4ca0-b3cd-65ce381168f4 tempest-GroupSnapshotsTest-1497579122 None] Lock "cinder-quobyte-41922a08-db15-4086-9dcb-6b7da6e956a8" released by "delete_snapshot" :: held 3.415s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:49:31 devstack cinder-volume[87378]: WARNING cinder.quota [None req-bd3afef3-e628-4ca0-b3cd-65ce381168f4 tempest-GroupSnapshotsTest-1497579122 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-98434019 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-98434019, it is now deprecated. Please use the default quota class for default quota.
Jul 10 12:49:31 devstack cinder-volume[87378]: WARNING cinder.quota [None req-bd3afef3-e628-4ca0-b3cd-65ce381168f4 tempest-GroupSnapshotsTest-1497579122 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-98434019 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-98434019, it is now deprecated. Please use the default quota class for default quota.
Jul 10 12:49:31 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-bd3afef3-e628-4ca0-b3cd-65ce381168f4 tempest-GroupSnapshotsTest-1497579122 None] Created reservations ['60b8237d-59ad-41c4-810e-defbde76fccb', '561c52b8-936b-4579-a14b-a7ca1454ba00', '54c949f1-cb31-4f80-b7f6-d99d4423ff1b', '0f5780aa-11df-4340-a900-e794a1e1754a'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:49:31 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-bd3afef3-e628-4ca0-b3cd-65ce381168f4 tempest-GroupSnapshotsTest-1497579122 None] group_snapshot 55407a66-27f0-48fb-8298-e03d19874150: deleted successfully
Jul 10 12:49:31 devstack sudo[99621]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f6097795-831a-48f6-99f3-f657c6858733 tempest-CreateVolumesFromSnapshotTest-1687039053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760.78215143-e1ea-4e15-8575-866d7ecc7c0d 1G" returned: 0 in 0.895s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f6097795-831a-48f6-99f3-f657c6858733 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760.78215143-e1ea-4e15-8575-866d7ecc7c0d {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:31 devstack sudo[99627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760.78215143-e1ea-4e15-8575-866d7ecc7c0d
Jul 10 12:49:31 devstack sudo[99627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:32 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-67f094b0-e581-458c-aefd-a20336b0e8da tempest-GroupSnapshotsTest-1497579122 None] Acquiring lock "cinder-quobyte-41922a08-db15-4086-9dcb-6b7da6e956a8" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:49:32 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-67f094b0-e581-458c-aefd-a20336b0e8da tempest-GroupSnapshotsTest-1497579122 None] Lock "cinder-quobyte-41922a08-db15-4086-9dcb-6b7da6e956a8" acquired by "delete_volume" :: waited 0.025s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:49:32 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b1a856-57c6-499d-8604-8ef1064f8bcf]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:49:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-67f094b0-e581-458c-aefd-a20336b0e8da tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-41922a08-db15-4086-9dcb-6b7da6e956a8 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:32 devstack sudo[99632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-41922a08-db15-4086-9dcb-6b7da6e956a8
Jul 10 12:49:32 devstack sudo[99632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:32 devstack sudo[99627]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f6097795-831a-48f6-99f3-f657c6858733 tempest-CreateVolumesFromSnapshotTest-1687039053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760.78215143-e1ea-4e15-8575-866d7ecc7c0d" returned: 0 in 0.789s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:32 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-f6097795-831a-48f6-99f3-f657c6858733 tempest-CreateVolumesFromSnapshotTest-1687039053 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760.78215143-e1ea-4e15-8575-866d7ecc7c0d is being set with open permissions: ugo+rw
Jul 10 12:49:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f6097795-831a-48f6-99f3-f657c6858733 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760.78215143-e1ea-4e15-8575-866d7ecc7c0d {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:32 devstack sudo[99634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760.78215143-e1ea-4e15-8575-866d7ecc7c0d
Jul 10 12:49:32 devstack sudo[99634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:33 devstack sudo[99632]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-67f094b0-e581-458c-aefd-a20336b0e8da tempest-GroupSnapshotsTest-1497579122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-41922a08-db15-4086-9dcb-6b7da6e956a8" returned: 0 in 0.814s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-67f094b0-e581-458c-aefd-a20336b0e8da tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-41922a08-db15-4086-9dcb-6b7da6e956a8 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:33 devstack sudo[99640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-41922a08-db15-4086-9dcb-6b7da6e956a8
Jul 10 12:49:33 devstack sudo[99640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:33 devstack sudo[99634]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f6097795-831a-48f6-99f3-f657c6858733 tempest-CreateVolumesFromSnapshotTest-1687039053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760.78215143-e1ea-4e15-8575-866d7ecc7c0d" returned: 0 in 0.726s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f6097795-831a-48f6-99f3-f657c6858733 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:33 devstack sudo[99642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760.info
Jul 10 12:49:33 devstack sudo[99642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:33 devstack sudo[99640]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-67f094b0-e581-458c-aefd-a20336b0e8da tempest-GroupSnapshotsTest-1497579122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-41922a08-db15-4086-9dcb-6b7da6e956a8" returned: 0 in 0.679s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:33 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-67f094b0-e581-458c-aefd-a20336b0e8da tempest-GroupSnapshotsTest-1497579122 None] Lock "cinder-quobyte-41922a08-db15-4086-9dcb-6b7da6e956a8" released by "delete_volume" :: held 1.570s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:49:33 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:SELECT=162,cinder:UPDATE=196,cinder:INSERT=53,cinder:DELETE=13 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:49:33 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:SELECT=174,cinder:INSERT=41,cinder:UPDATE=196,cinder:DELETE=10 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:49:34 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-67f094b0-e581-458c-aefd-a20336b0e8da tempest-GroupSnapshotsTest-1497579122 None] Created reservations ['e1177a07-35af-41f6-b68d-f8ce2ebd8d71'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:49:34 devstack sudo[99642]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f6097795-831a-48f6-99f3-f657c6858733 tempest-CreateVolumesFromSnapshotTest-1687039053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760.info" returned: 0 in 0.711s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:34 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-f6097795-831a-48f6-99f3-f657c6858733 tempest-CreateVolumesFromSnapshotTest-1687039053 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760.info is being set with open permissions: ugo+rw
Jul 10 12:49:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f6097795-831a-48f6-99f3-f657c6858733 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:34 devstack sudo[99646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760.info
Jul 10 12:49:34 devstack sudo[99646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:34 devstack cinder-volume[87378]: WARNING cinder.quota [None req-67f094b0-e581-458c-aefd-a20336b0e8da tempest-GroupSnapshotsTest-1497579122 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-98434019 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-98434019, it is now deprecated. Please use the default quota class for default quota.
Jul 10 12:49:34 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-67f094b0-e581-458c-aefd-a20336b0e8da tempest-GroupSnapshotsTest-1497579122 None] Created reservations ['ec971973-fa2b-4be0-af87-c55cfccaacf7', '65527009-1662-4d0c-8014-9df999e70644', '5ee03b13-46ea-46ce-8dee-53a7c20d29b7', '02c2ea81-6db3-43ae-9210-366b31fb1c6c'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:49:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-67f094b0-e581-458c-aefd-a20336b0e8da tempest-GroupSnapshotsTest-1497579122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:49:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-67f094b0-e581-458c-aefd-a20336b0e8da tempest-GroupSnapshotsTest-1497579122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:34 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-67f094b0-e581-458c-aefd-a20336b0e8da tempest-GroupSnapshotsTest-1497579122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:49:34 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-67f094b0-e581-458c-aefd-a20336b0e8da tempest-GroupSnapshotsTest-1497579122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:49:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-67f094b0-e581-458c-aefd-a20336b0e8da tempest-GroupSnapshotsTest-1497579122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-67f094b0-e581-458c-aefd-a20336b0e8da tempest-GroupSnapshotsTest-1497579122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:34 devstack sudo[99648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:49:34 devstack sudo[99648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:34 devstack sudo[99646]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f6097795-831a-48f6-99f3-f657c6858733 tempest-CreateVolumesFromSnapshotTest-1687039053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760.info" returned: 0 in 0.696s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f6097795-831a-48f6-99f3-f657c6858733 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.742s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:34 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-f6097795-831a-48f6-99f3-f657c6858733 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Create snapshot completed successfully
Jul 10 12:49:35 devstack sudo[99648]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-67f094b0-e581-458c-aefd-a20336b0e8da tempest-GroupSnapshotsTest-1497579122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.799s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:35 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-67f094b0-e581-458c-aefd-a20336b0e8da tempest-GroupSnapshotsTest-1497579122 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:49:35 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-67f094b0-e581-458c-aefd-a20336b0e8da tempest-GroupSnapshotsTest-1497579122 None] Delete group completed successfully.
Jul 10 12:49:35 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-d30af76a-92d2-4b33-9edf-7a384a3f06bd tempest-AbsoluteLimitsTests-652774683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:49:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d30af76a-92d2-4b33-9edf-7a384a3f06bd tempest-AbsoluteLimitsTests-652774683 None] Flow 'volume_create_manager' (431acc55-9718-464b-97ce-aa4da61c9b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:49:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d30af76a-92d2-4b33-9edf-7a384a3f06bd tempest-AbsoluteLimitsTests-652774683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a9256f5-902f-4101-891f-56cb04074e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d30af76a-92d2-4b33-9edf-7a384a3f06bd tempest-AbsoluteLimitsTests-652774683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a9256f5-902f-4101-891f-56cb04074e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-468755898',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db46f7f5-f24a-411d-8003-6eeccfda0a17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d172dcf06cc146a19e45ef74db5115e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:49:35Z,use_quota=True,user_id='2bf7926ae01d4488810bb30e994a5836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d30af76a-92d2-4b33-9edf-7a384a3f06bd tempest-AbsoluteLimitsTests-652774683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (014fd866-1cea-4bed-9ab9-5267810b9d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d30af76a-92d2-4b33-9edf-7a384a3f06bd tempest-AbsoluteLimitsTests-652774683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (014fd866-1cea-4bed-9ab9-5267810b9d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d30af76a-92d2-4b33-9edf-7a384a3f06bd tempest-AbsoluteLimitsTests-652774683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9f56ded-5116-410b-a739-880f5d8a21f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d30af76a-92d2-4b33-9edf-7a384a3f06bd tempest-AbsoluteLimitsTests-652774683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9f56ded-5116-410b-a739-880f5d8a21f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db46f7f5-f24a-411d-8003-6eeccfda0a17', 'volume_name': 'volume-db46f7f5-f24a-411d-8003-6eeccfda0a17', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d30af76a-92d2-4b33-9edf-7a384a3f06bd tempest-AbsoluteLimitsTests-652774683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cebc3dd2-7b77-474b-8bc0-b6efb5e6982e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d30af76a-92d2-4b33-9edf-7a384a3f06bd tempest-AbsoluteLimitsTests-652774683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cebc3dd2-7b77-474b-8bc0-b6efb5e6982e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d30af76a-92d2-4b33-9edf-7a384a3f06bd tempest-AbsoluteLimitsTests-652774683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d78dfef8-62c6-4daa-ae43-a40e3cf958b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:35 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-d30af76a-92d2-4b33-9edf-7a384a3f06bd tempest-AbsoluteLimitsTests-652774683 None] Volume db46f7f5-f24a-411d-8003-6eeccfda0a17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db46f7f5-f24a-411d-8003-6eeccfda0a17', 'volume_size': 1}
Jul 10 12:49:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d30af76a-92d2-4b33-9edf-7a384a3f06bd tempest-AbsoluteLimitsTests-652774683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:49:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d30af76a-92d2-4b33-9edf-7a384a3f06bd tempest-AbsoluteLimitsTests-652774683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:35 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-d30af76a-92d2-4b33-9edf-7a384a3f06bd tempest-AbsoluteLimitsTests-652774683 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-468755898',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db46f7f5-f24a-411d-8003-6eeccfda0a17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d172dcf06cc146a19e45ef74db5115e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:49:35Z,use_quota=True,user_id='2bf7926ae01d4488810bb30e994a5836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:49:35 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-d30af76a-92d2-4b33-9edf-7a384a3f06bd tempest-AbsoluteLimitsTests-652774683 None] Creating volume db46f7f5-f24a-411d-8003-6eeccfda0a17 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:49:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d30af76a-92d2-4b33-9edf-7a384a3f06bd tempest-AbsoluteLimitsTests-652774683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:49:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d30af76a-92d2-4b33-9edf-7a384a3f06bd tempest-AbsoluteLimitsTests-652774683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:35 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-d30af76a-92d2-4b33-9edf-7a384a3f06bd tempest-AbsoluteLimitsTests-652774683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:49:35 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-d30af76a-92d2-4b33-9edf-7a384a3f06bd tempest-AbsoluteLimitsTests-652774683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:49:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d30af76a-92d2-4b33-9edf-7a384a3f06bd tempest-AbsoluteLimitsTests-652774683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:35 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-d30af76a-92d2-4b33-9edf-7a384a3f06bd tempest-AbsoluteLimitsTests-652774683 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:49:35 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-d30af76a-92d2-4b33-9edf-7a384a3f06bd tempest-AbsoluteLimitsTests-652774683 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:49:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d30af76a-92d2-4b33-9edf-7a384a3f06bd tempest-AbsoluteLimitsTests-652774683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-db46f7f5-f24a-411d-8003-6eeccfda0a17 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:35 devstack sudo[99658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-db46f7f5-f24a-411d-8003-6eeccfda0a17 1073741824
Jul 10 12:49:35 devstack sudo[99658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:35 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-e24686c7-6c21-4b5d-bf01-a513075fc6f7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:49:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e24686c7-6c21-4b5d-bf01-a513075fc6f7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Flow 'volume_create_manager' (388595ac-71fb-4e3a-afa3-62cb7984facd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:49:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e24686c7-6c21-4b5d-bf01-a513075fc6f7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb7df26f-af40-4257-bb1c-d6dba76915cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e24686c7-6c21-4b5d-bf01-a513075fc6f7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb7df26f-af40-4257-bb1c-d6dba76915cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1190957231',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb1cc7e4-de10-44be-a1e6-6ebad2305d3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b672e8fc6a4745d8a981a4b3bfc5ccdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:49:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:49:36Z,use_quota=True,user_id='c639dd0a31794446b044a5425a4a6882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e24686c7-6c21-4b5d-bf01-a513075fc6f7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b3a333b-5bec-4007-93e9-04aa76f2b80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e24686c7-6c21-4b5d-bf01-a513075fc6f7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b3a333b-5bec-4007-93e9-04aa76f2b80f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e24686c7-6c21-4b5d-bf01-a513075fc6f7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06f495d1-0f37-450b-b867-23321d31d9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e24686c7-6c21-4b5d-bf01-a513075fc6f7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06f495d1-0f37-450b-b867-23321d31d9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb1cc7e4-de10-44be-a1e6-6ebad2305d3a', 'volume_name': 'volume-fb1cc7e4-de10-44be-a1e6-6ebad2305d3a', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e24686c7-6c21-4b5d-bf01-a513075fc6f7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (646d6b57-04e0-4a5c-9c06-35555db335c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e24686c7-6c21-4b5d-bf01-a513075fc6f7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (646d6b57-04e0-4a5c-9c06-35555db335c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e24686c7-6c21-4b5d-bf01-a513075fc6f7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61a05966-a628-4064-990d-f4f5b1f06761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:35 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-e24686c7-6c21-4b5d-bf01-a513075fc6f7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Volume fb1cc7e4-de10-44be-a1e6-6ebad2305d3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb1cc7e4-de10-44be-a1e6-6ebad2305d3a', 'volume_size': 1}
Jul 10 12:49:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e24686c7-6c21-4b5d-bf01-a513075fc6f7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:49:36 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-c73f6c6e-3808-44ef-88a8-0de6681d4f2d tempest-CreateVolumesFromSnapshotTest-1687039053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:49:36 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c73f6c6e-3808-44ef-88a8-0de6681d4f2d tempest-CreateVolumesFromSnapshotTest-1687039053 None] Flow 'volume_create_manager' (ee82b806-55c6-47d7-b0cd-3aaf16d84d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:49:36 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c73f6c6e-3808-44ef-88a8-0de6681d4f2d tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a366b826-d020-40c6-950d-3e78c33c1582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:36 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c73f6c6e-3808-44ef-88a8-0de6681d4f2d tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a366b826-d020-40c6-950d-3e78c33c1582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-186609931',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e358bdb7-d257-4c4e-8985-698d601c2305,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b672e8fc6a4745d8a981a4b3bfc5ccdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:49:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:49:36Z,use_quota=True,user_id='c639dd0a31794446b044a5425a4a6882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:36 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c73f6c6e-3808-44ef-88a8-0de6681d4f2d tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc1325d4-67f1-4749-9ef1-0ae94d39f5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:36 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c73f6c6e-3808-44ef-88a8-0de6681d4f2d tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc1325d4-67f1-4749-9ef1-0ae94d39f5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:36 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c73f6c6e-3808-44ef-88a8-0de6681d4f2d tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ea79693-35e0-4730-94f9-c9dbf6d31989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:36 devstack sudo[99658]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:36 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c73f6c6e-3808-44ef-88a8-0de6681d4f2d tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ea79693-35e0-4730-94f9-c9dbf6d31989) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e358bdb7-d257-4c4e-8985-698d601c2305', 'volume_name': 'volume-e358bdb7-d257-4c4e-8985-698d601c2305', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:36 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c73f6c6e-3808-44ef-88a8-0de6681d4f2d tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cb0169e-398e-460e-aae0-b993811e1a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:36 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c73f6c6e-3808-44ef-88a8-0de6681d4f2d tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cb0169e-398e-460e-aae0-b993811e1a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:36 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c73f6c6e-3808-44ef-88a8-0de6681d4f2d tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fc4e985-c606-40e3-9574-ac94a95fe6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:36 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-c73f6c6e-3808-44ef-88a8-0de6681d4f2d tempest-CreateVolumesFromSnapshotTest-1687039053 None] Volume e358bdb7-d257-4c4e-8985-698d601c2305: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e358bdb7-d257-4c4e-8985-698d601c2305', 'volume_size': 1}
Jul 10 12:49:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c73f6c6e-3808-44ef-88a8-0de6681d4f2d tempest-CreateVolumesFromSnapshotTest-1687039053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:49:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d30af76a-92d2-4b33-9edf-7a384a3f06bd tempest-AbsoluteLimitsTests-652774683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-db46f7f5-f24a-411d-8003-6eeccfda0a17 1073741824" returned: 0 in 1.079s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d30af76a-92d2-4b33-9edf-7a384a3f06bd tempest-AbsoluteLimitsTests-652774683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-db46f7f5-f24a-411d-8003-6eeccfda0a17 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:36 devstack sudo[99663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-db46f7f5-f24a-411d-8003-6eeccfda0a17
Jul 10 12:49:36 devstack sudo[99663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:36 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-634bfe59-0156-47ec-83b9-2c2a6a573eb7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:49:36 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-634bfe59-0156-47ec-83b9-2c2a6a573eb7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Flow 'volume_create_manager' (c59b1332-d020-4536-a219-29d42c55c525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:49:36 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-634bfe59-0156-47ec-83b9-2c2a6a573eb7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f114ebb5-290c-44e8-a443-4d7cff0e30a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:36 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-634bfe59-0156-47ec-83b9-2c2a6a573eb7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f114ebb5-290c-44e8-a443-4d7cff0e30a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1612091570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11b79f6c-faa4-440e-ae00-23310441d505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b672e8fc6a4745d8a981a4b3bfc5ccdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:49:37Z,use_quota=True,user_id='c639dd0a31794446b044a5425a4a6882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:36 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-634bfe59-0156-47ec-83b9-2c2a6a573eb7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75e4b8a3-cfd7-4bc6-b536-099410b0630c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:36 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-634bfe59-0156-47ec-83b9-2c2a6a573eb7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75e4b8a3-cfd7-4bc6-b536-099410b0630c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:36 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-634bfe59-0156-47ec-83b9-2c2a6a573eb7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e47c14cf-7a46-489e-b784-f9651d8b460f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:36 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-634bfe59-0156-47ec-83b9-2c2a6a573eb7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e47c14cf-7a46-489e-b784-f9651d8b460f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11b79f6c-faa4-440e-ae00-23310441d505', 'volume_name': 'volume-11b79f6c-faa4-440e-ae00-23310441d505', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:36 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-634bfe59-0156-47ec-83b9-2c2a6a573eb7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee80f618-b425-4983-a2bf-690e95fd7f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:36 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-634bfe59-0156-47ec-83b9-2c2a6a573eb7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee80f618-b425-4983-a2bf-690e95fd7f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:36 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-634bfe59-0156-47ec-83b9-2c2a6a573eb7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9018e86f-cd17-41f7-bc83-0635f520cdc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:36 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-634bfe59-0156-47ec-83b9-2c2a6a573eb7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Volume 11b79f6c-faa4-440e-ae00-23310441d505: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11b79f6c-faa4-440e-ae00-23310441d505', 'volume_size': 1}
Jul 10 12:49:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-634bfe59-0156-47ec-83b9-2c2a6a573eb7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:49:37 devstack sudo[99663]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d30af76a-92d2-4b33-9edf-7a384a3f06bd tempest-AbsoluteLimitsTests-652774683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-db46f7f5-f24a-411d-8003-6eeccfda0a17" returned: 0 in 0.875s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:37 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-d30af76a-92d2-4b33-9edf-7a384a3f06bd tempest-AbsoluteLimitsTests-652774683 None] <== create_volume: return (1995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:49:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d30af76a-92d2-4b33-9edf-7a384a3f06bd tempest-AbsoluteLimitsTests-652774683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.998s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e24686c7-6c21-4b5d-bf01-a513075fc6f7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.296s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:37 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-e24686c7-6c21-4b5d-bf01-a513075fc6f7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1190957231',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb1cc7e4-de10-44be-a1e6-6ebad2305d3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b672e8fc6a4745d8a981a4b3bfc5ccdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:49:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:49:36Z,use_quota=True,user_id='c639dd0a31794446b044a5425a4a6882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:49:37 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-e24686c7-6c21-4b5d-bf01-a513075fc6f7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Creating volume fb1cc7e4-de10-44be-a1e6-6ebad2305d3a {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:49:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e24686c7-6c21-4b5d-bf01-a513075fc6f7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:49:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e24686c7-6c21-4b5d-bf01-a513075fc6f7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:37 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-e24686c7-6c21-4b5d-bf01-a513075fc6f7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:49:37 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-e24686c7-6c21-4b5d-bf01-a513075fc6f7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:49:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e24686c7-6c21-4b5d-bf01-a513075fc6f7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:37 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-e24686c7-6c21-4b5d-bf01-a513075fc6f7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:49:37 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-e24686c7-6c21-4b5d-bf01-a513075fc6f7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:49:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e24686c7-6c21-4b5d-bf01-a513075fc6f7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fb1cc7e4-de10-44be-a1e6-6ebad2305d3a 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:37 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb4e2929-7258-45eb-873c-8c4e1d1c5c54 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:49:37 devstack sudo[99666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fb1cc7e4-de10-44be-a1e6-6ebad2305d3a 1073741824
Jul 10 12:49:37 devstack sudo[99666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-eb4e2929-7258-45eb-873c-8c4e1d1c5c54 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Flow 'volume_create_manager' (d1608260-8c3a-4c6f-b9ef-028c02dda571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:49:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-eb4e2929-7258-45eb-873c-8c4e1d1c5c54 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d775730-115d-466d-b887-25ea2c6d3ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-eb4e2929-7258-45eb-873c-8c4e1d1c5c54 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d775730-115d-466d-b887-25ea2c6d3ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-654930948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=020505d6-d37e-46b8-98b7-38cb7fdd27f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b672e8fc6a4745d8a981a4b3bfc5ccdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:49:37Z,use_quota=True,user_id='c639dd0a31794446b044a5425a4a6882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-eb4e2929-7258-45eb-873c-8c4e1d1c5c54 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52f382c4-6963-4ff3-a6d2-12257b782d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-eb4e2929-7258-45eb-873c-8c4e1d1c5c54 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52f382c4-6963-4ff3-a6d2-12257b782d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-eb4e2929-7258-45eb-873c-8c4e1d1c5c54 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4503d8e9-b5ea-4e1a-a06e-c156a933eb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-eb4e2929-7258-45eb-873c-8c4e1d1c5c54 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4503d8e9-b5ea-4e1a-a06e-c156a933eb4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '020505d6-d37e-46b8-98b7-38cb7fdd27f6', 'volume_name': 'volume-020505d6-d37e-46b8-98b7-38cb7fdd27f6', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-eb4e2929-7258-45eb-873c-8c4e1d1c5c54 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f40fe2a-f702-4866-8f36-2f84daaa58ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-eb4e2929-7258-45eb-873c-8c4e1d1c5c54 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f40fe2a-f702-4866-8f36-2f84daaa58ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-eb4e2929-7258-45eb-873c-8c4e1d1c5c54 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59095450-e9a0-409d-941d-43aa1fba998d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:37 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-eb4e2929-7258-45eb-873c-8c4e1d1c5c54 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Volume 020505d6-d37e-46b8-98b7-38cb7fdd27f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-020505d6-d37e-46b8-98b7-38cb7fdd27f6', 'volume_size': 1}
Jul 10 12:49:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-eb4e2929-7258-45eb-873c-8c4e1d1c5c54 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:49:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d30af76a-92d2-4b33-9edf-7a384a3f06bd tempest-AbsoluteLimitsTests-652774683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d78dfef8-62c6-4daa-ae43-a40e3cf958b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db46f7f5-f24a-411d-8003-6eeccfda0a17', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d30af76a-92d2-4b33-9edf-7a384a3f06bd tempest-AbsoluteLimitsTests-652774683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bd0bcaf-dc8b-4769-ac3a-d6ba894e1e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:37 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-d30af76a-92d2-4b33-9edf-7a384a3f06bd tempest-AbsoluteLimitsTests-652774683 None] Volume volume-db46f7f5-f24a-411d-8003-6eeccfda0a17 (db46f7f5-f24a-411d-8003-6eeccfda0a17): created successfully
Jul 10 12:49:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d30af76a-92d2-4b33-9edf-7a384a3f06bd tempest-AbsoluteLimitsTests-652774683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bd0bcaf-dc8b-4769-ac3a-d6ba894e1e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d30af76a-92d2-4b33-9edf-7a384a3f06bd tempest-AbsoluteLimitsTests-652774683 None] Flow 'volume_create_manager' (431acc55-9718-464b-97ce-aa4da61c9b5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:49:37 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-d30af76a-92d2-4b33-9edf-7a384a3f06bd tempest-AbsoluteLimitsTests-652774683 None] Created volume successfully.
Jul 10 12:49:37 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e04d7ac-3880-40ff-a30a-a66d2fbf4f20 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:49:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7e04d7ac-3880-40ff-a30a-a66d2fbf4f20 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Flow 'volume_create_manager' (29044501-fe83-4c36-8a95-c6b2221b3890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:49:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7e04d7ac-3880-40ff-a30a-a66d2fbf4f20 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (004ebaef-16c0-409d-9029-3730b28e2c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7e04d7ac-3880-40ff-a30a-a66d2fbf4f20 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (004ebaef-16c0-409d-9029-3730b28e2c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1800315781',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2429b67f-ab78-4508-965e-12a3a28fdfaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b672e8fc6a4745d8a981a4b3bfc5ccdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:49:38Z,use_quota=True,user_id='c639dd0a31794446b044a5425a4a6882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7e04d7ac-3880-40ff-a30a-a66d2fbf4f20 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b6de348-1c64-479c-ad48-97b56bc10ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7e04d7ac-3880-40ff-a30a-a66d2fbf4f20 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b6de348-1c64-479c-ad48-97b56bc10ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7e04d7ac-3880-40ff-a30a-a66d2fbf4f20 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84e60dda-bfcc-4e20-b039-4d0724873833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7e04d7ac-3880-40ff-a30a-a66d2fbf4f20 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84e60dda-bfcc-4e20-b039-4d0724873833) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2429b67f-ab78-4508-965e-12a3a28fdfaa', 'volume_name': 'volume-2429b67f-ab78-4508-965e-12a3a28fdfaa', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7e04d7ac-3880-40ff-a30a-a66d2fbf4f20 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41f96691-08bc-4bb0-9566-5c8c41b5532b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7e04d7ac-3880-40ff-a30a-a66d2fbf4f20 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41f96691-08bc-4bb0-9566-5c8c41b5532b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7e04d7ac-3880-40ff-a30a-a66d2fbf4f20 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8edfa020-3fd7-4901-a462-0742ef316507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:37 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-7e04d7ac-3880-40ff-a30a-a66d2fbf4f20 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Volume 2429b67f-ab78-4508-965e-12a3a28fdfaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2429b67f-ab78-4508-965e-12a3a28fdfaa', 'volume_size': 1}
Jul 10 12:49:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-7e04d7ac-3880-40ff-a30a-a66d2fbf4f20 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:49:38 devstack sudo[99666]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e24686c7-6c21-4b5d-bf01-a513075fc6f7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fb1cc7e4-de10-44be-a1e6-6ebad2305d3a 1073741824" returned: 0 in 0.936s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e24686c7-6c21-4b5d-bf01-a513075fc6f7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fb1cc7e4-de10-44be-a1e6-6ebad2305d3a {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:38 devstack sudo[99671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fb1cc7e4-de10-44be-a1e6-6ebad2305d3a
Jul 10 12:49:38 devstack sudo[99671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:38 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-5030c836-7482-4022-af0a-30f5c0b93f6d tempest-AbsoluteLimitsTests-652774683 None] Acquiring lock "cinder-db46f7f5-f24a-411d-8003-6eeccfda0a17-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:49:38 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-5030c836-7482-4022-af0a-30f5c0b93f6d tempest-AbsoluteLimitsTests-652774683 None] Lock "cinder-db46f7f5-f24a-411d-8003-6eeccfda0a17-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:49:38 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-5030c836-7482-4022-af0a-30f5c0b93f6d tempest-AbsoluteLimitsTests-652774683 None] Acquiring lock "cinder-quobyte-db46f7f5-f24a-411d-8003-6eeccfda0a17" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:49:38 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-5030c836-7482-4022-af0a-30f5c0b93f6d tempest-AbsoluteLimitsTests-652774683 None] Lock "cinder-quobyte-db46f7f5-f24a-411d-8003-6eeccfda0a17" acquired by "delete_volume" :: waited 0.015s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:49:38 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[60267d14-4ee2-44ab-ab09-96f5f56969f9]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:49:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5030c836-7482-4022-af0a-30f5c0b93f6d tempest-AbsoluteLimitsTests-652774683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-db46f7f5-f24a-411d-8003-6eeccfda0a17 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:38 devstack sudo[99673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-db46f7f5-f24a-411d-8003-6eeccfda0a17
Jul 10 12:49:38 devstack sudo[99673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:38 devstack sudo[99671]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e24686c7-6c21-4b5d-bf01-a513075fc6f7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fb1cc7e4-de10-44be-a1e6-6ebad2305d3a" returned: 0 in 0.735s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:38 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-e24686c7-6c21-4b5d-bf01-a513075fc6f7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] <== create_volume: return (1717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:49:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e24686c7-6c21-4b5d-bf01-a513075fc6f7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.720s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c73f6c6e-3808-44ef-88a8-0de6681d4f2d tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.640s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:38 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-c73f6c6e-3808-44ef-88a8-0de6681d4f2d tempest-CreateVolumesFromSnapshotTest-1687039053 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-186609931',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e358bdb7-d257-4c4e-8985-698d601c2305,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b672e8fc6a4745d8a981a4b3bfc5ccdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:49:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:49:36Z,use_quota=True,user_id='c639dd0a31794446b044a5425a4a6882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:49:38 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-c73f6c6e-3808-44ef-88a8-0de6681d4f2d tempest-CreateVolumesFromSnapshotTest-1687039053 None] Creating volume e358bdb7-d257-4c4e-8985-698d601c2305 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:49:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c73f6c6e-3808-44ef-88a8-0de6681d4f2d tempest-CreateVolumesFromSnapshotTest-1687039053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:49:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c73f6c6e-3808-44ef-88a8-0de6681d4f2d tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:38 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-c73f6c6e-3808-44ef-88a8-0de6681d4f2d tempest-CreateVolumesFromSnapshotTest-1687039053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:49:38 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-c73f6c6e-3808-44ef-88a8-0de6681d4f2d tempest-CreateVolumesFromSnapshotTest-1687039053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:49:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c73f6c6e-3808-44ef-88a8-0de6681d4f2d tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:38 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-c73f6c6e-3808-44ef-88a8-0de6681d4f2d tempest-CreateVolumesFromSnapshotTest-1687039053 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:49:38 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-c73f6c6e-3808-44ef-88a8-0de6681d4f2d tempest-CreateVolumesFromSnapshotTest-1687039053 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:49:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c73f6c6e-3808-44ef-88a8-0de6681d4f2d tempest-CreateVolumesFromSnapshotTest-1687039053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e358bdb7-d257-4c4e-8985-698d601c2305 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:38 devstack sudo[99676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e358bdb7-d257-4c4e-8985-698d601c2305 1073741824
Jul 10 12:49:38 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e24686c7-6c21-4b5d-bf01-a513075fc6f7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61a05966-a628-4064-990d-f4f5b1f06761) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb1cc7e4-de10-44be-a1e6-6ebad2305d3a', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:38 devstack sudo[99676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:38 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e24686c7-6c21-4b5d-bf01-a513075fc6f7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51f23b04-093b-4bbc-9108-3c41f894258e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:38 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-e24686c7-6c21-4b5d-bf01-a513075fc6f7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Volume volume-fb1cc7e4-de10-44be-a1e6-6ebad2305d3a (fb1cc7e4-de10-44be-a1e6-6ebad2305d3a): created successfully
Jul 10 12:49:38 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e24686c7-6c21-4b5d-bf01-a513075fc6f7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51f23b04-093b-4bbc-9108-3c41f894258e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:38 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e24686c7-6c21-4b5d-bf01-a513075fc6f7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Flow 'volume_create_manager' (388595ac-71fb-4e3a-afa3-62cb7984facd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:49:39 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-e24686c7-6c21-4b5d-bf01-a513075fc6f7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Created volume successfully.
Jul 10 12:49:39 devstack sudo[99673]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5030c836-7482-4022-af0a-30f5c0b93f6d tempest-AbsoluteLimitsTests-652774683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-db46f7f5-f24a-411d-8003-6eeccfda0a17" returned: 0 in 0.824s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5030c836-7482-4022-af0a-30f5c0b93f6d tempest-AbsoluteLimitsTests-652774683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-db46f7f5-f24a-411d-8003-6eeccfda0a17 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:39 devstack sudo[99682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-db46f7f5-f24a-411d-8003-6eeccfda0a17
Jul 10 12:49:39 devstack sudo[99682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:39 devstack sudo[99676]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c73f6c6e-3808-44ef-88a8-0de6681d4f2d tempest-CreateVolumesFromSnapshotTest-1687039053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e358bdb7-d257-4c4e-8985-698d601c2305 1073741824" returned: 0 in 0.945s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c73f6c6e-3808-44ef-88a8-0de6681d4f2d tempest-CreateVolumesFromSnapshotTest-1687039053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e358bdb7-d257-4c4e-8985-698d601c2305 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:39 devstack sudo[99688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e358bdb7-d257-4c4e-8985-698d601c2305
Jul 10 12:49:39 devstack sudo[99688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:40 devstack sudo[99682]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5030c836-7482-4022-af0a-30f5c0b93f6d tempest-AbsoluteLimitsTests-652774683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-db46f7f5-f24a-411d-8003-6eeccfda0a17" returned: 0 in 0.756s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:40 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-5030c836-7482-4022-af0a-30f5c0b93f6d tempest-AbsoluteLimitsTests-652774683 None] Lock "cinder-quobyte-db46f7f5-f24a-411d-8003-6eeccfda0a17" released by "delete_volume" :: held 1.650s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:49:40 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-5030c836-7482-4022-af0a-30f5c0b93f6d tempest-AbsoluteLimitsTests-652774683 None] Created reservations ['e836fb75-eee9-4558-8702-2d3377358e4e', '716e714d-7d34-4b63-80da-d71352a74ca3', '813424f1-6b26-4049-9206-1bb5f6105f0b', '4f255ab2-050a-482c-945c-329a5d9676bc'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:49:40 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-7aec7b15-f153-4ef4-a5b6-956ae2d6b1fc tempest-GroupSnapshotsV319Test-94398658 None] Group tempest-GroupSnapshotsV319Test-Group-1307155922: creating
Jul 10 12:49:40 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-7aec7b15-f153-4ef4-a5b6-956ae2d6b1fc tempest-GroupSnapshotsV319Test-94398658 None] Group tempest-GroupSnapshotsV319Test-Group-1307155922: created successfully
Jul 10 12:49:40 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-7aec7b15-f153-4ef4-a5b6-956ae2d6b1fc tempest-GroupSnapshotsV319Test-94398658 None] Create group completed successfully.
Jul 10 12:49:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5030c836-7482-4022-af0a-30f5c0b93f6d tempest-AbsoluteLimitsTests-652774683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:49:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5030c836-7482-4022-af0a-30f5c0b93f6d tempest-AbsoluteLimitsTests-652774683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:40 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5030c836-7482-4022-af0a-30f5c0b93f6d tempest-AbsoluteLimitsTests-652774683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:49:40 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5030c836-7482-4022-af0a-30f5c0b93f6d tempest-AbsoluteLimitsTests-652774683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:49:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5030c836-7482-4022-af0a-30f5c0b93f6d tempest-AbsoluteLimitsTests-652774683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5030c836-7482-4022-af0a-30f5c0b93f6d tempest-AbsoluteLimitsTests-652774683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:40 devstack sudo[99691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:49:40 devstack sudo[99691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:40 devstack sudo[99688]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c73f6c6e-3808-44ef-88a8-0de6681d4f2d tempest-CreateVolumesFromSnapshotTest-1687039053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e358bdb7-d257-4c4e-8985-698d601c2305" returned: 0 in 0.690s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:40 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-c73f6c6e-3808-44ef-88a8-0de6681d4f2d tempest-CreateVolumesFromSnapshotTest-1687039053 None] <== create_volume: return (1677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:49:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c73f6c6e-3808-44ef-88a8-0de6681d4f2d tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.680s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-634bfe59-0156-47ec-83b9-2c2a6a573eb7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.845s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:40 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-634bfe59-0156-47ec-83b9-2c2a6a573eb7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1612091570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11b79f6c-faa4-440e-ae00-23310441d505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b672e8fc6a4745d8a981a4b3bfc5ccdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:49:37Z,use_quota=True,user_id='c639dd0a31794446b044a5425a4a6882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:49:40 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-634bfe59-0156-47ec-83b9-2c2a6a573eb7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Creating volume 11b79f6c-faa4-440e-ae00-23310441d505 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:49:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-634bfe59-0156-47ec-83b9-2c2a6a573eb7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:49:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-634bfe59-0156-47ec-83b9-2c2a6a573eb7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:40 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-634bfe59-0156-47ec-83b9-2c2a6a573eb7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:49:40 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-634bfe59-0156-47ec-83b9-2c2a6a573eb7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:49:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-634bfe59-0156-47ec-83b9-2c2a6a573eb7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:40 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-634bfe59-0156-47ec-83b9-2c2a6a573eb7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:49:40 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-634bfe59-0156-47ec-83b9-2c2a6a573eb7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:49:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-634bfe59-0156-47ec-83b9-2c2a6a573eb7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-11b79f6c-faa4-440e-ae00-23310441d505 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:40 devstack sudo[99694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-11b79f6c-faa4-440e-ae00-23310441d505 1073741824
Jul 10 12:49:40 devstack sudo[99694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:40 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c73f6c6e-3808-44ef-88a8-0de6681d4f2d tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fc4e985-c606-40e3-9574-ac94a95fe6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e358bdb7-d257-4c4e-8985-698d601c2305', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:40 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c73f6c6e-3808-44ef-88a8-0de6681d4f2d tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a8d2f3e-0615-469a-ac97-a6e47c50be46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:40 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-c73f6c6e-3808-44ef-88a8-0de6681d4f2d tempest-CreateVolumesFromSnapshotTest-1687039053 None] Volume volume-e358bdb7-d257-4c4e-8985-698d601c2305 (e358bdb7-d257-4c4e-8985-698d601c2305): created successfully
Jul 10 12:49:40 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c73f6c6e-3808-44ef-88a8-0de6681d4f2d tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a8d2f3e-0615-469a-ac97-a6e47c50be46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:40 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c73f6c6e-3808-44ef-88a8-0de6681d4f2d tempest-CreateVolumesFromSnapshotTest-1687039053 None] Flow 'volume_create_manager' (ee82b806-55c6-47d7-b0cd-3aaf16d84d2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:49:40 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-c73f6c6e-3808-44ef-88a8-0de6681d4f2d tempest-CreateVolumesFromSnapshotTest-1687039053 None] Created volume successfully.
Jul 10 12:49:41 devstack sudo[99691]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5030c836-7482-4022-af0a-30f5c0b93f6d tempest-AbsoluteLimitsTests-652774683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.753s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:41 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-5030c836-7482-4022-af0a-30f5c0b93f6d tempest-AbsoluteLimitsTests-652774683 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:49:41 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-5030c836-7482-4022-af0a-30f5c0b93f6d tempest-AbsoluteLimitsTests-652774683 None] Deleted volume successfully.
Jul 10 12:49:41 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-5030c836-7482-4022-af0a-30f5c0b93f6d tempest-AbsoluteLimitsTests-652774683 None] Lock "cinder-db46f7f5-f24a-411d-8003-6eeccfda0a17-delete_volume" released by "delete_volume" :: held 2.679s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:49:41 devstack sudo[99694]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-634bfe59-0156-47ec-83b9-2c2a6a573eb7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-11b79f6c-faa4-440e-ae00-23310441d505 1073741824" returned: 0 in 0.916s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-634bfe59-0156-47ec-83b9-2c2a6a573eb7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-11b79f6c-faa4-440e-ae00-23310441d505 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:41 devstack sudo[99701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-11b79f6c-faa4-440e-ae00-23310441d505
Jul 10 12:49:41 devstack sudo[99701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:42 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-98b509c4-c3f3-4271-ba9c-c2d2be43d759 tempest-GroupSnapshotsV319Test-94398658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:49:42 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-98b509c4-c3f3-4271-ba9c-c2d2be43d759 tempest-GroupSnapshotsV319Test-94398658 None] Flow 'volume_create_manager' (0c610c90-f69d-492d-bfdb-101050b70a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:49:42 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-98b509c4-c3f3-4271-ba9c-c2d2be43d759 tempest-GroupSnapshotsV319Test-94398658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a161ff6b-7d17-4ee3-9ba9-e522100e6c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:42 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-98b509c4-c3f3-4271-ba9c-c2d2be43d759 tempest-GroupSnapshotsV319Test-94398658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a161ff6b-7d17-4ee3-9ba9-e522100e6c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-826468149',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=934f2181-fb5b-4886-b36e-59b2d3d78932,host='devstack@QuobyteHD#QuobyteHD',id=a3b3c841-f6c9-485f-a666-f7de93ca4a85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b015e3d3ff3c43efb363199550ee934c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:49:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:49:42Z,use_quota=True,user_id='bd962fa7d78f49b6bcd22ef7b313ecd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27935c6-f522-4fc6-b077-b699443d7bd7),volume_type_id=b27935c6-f522-4fc6-b077-b699443d7bd7)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:42 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-98b509c4-c3f3-4271-ba9c-c2d2be43d759 tempest-GroupSnapshotsV319Test-94398658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fed2f93-f53f-499b-a95b-7581a2133921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:42 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-98b509c4-c3f3-4271-ba9c-c2d2be43d759 tempest-GroupSnapshotsV319Test-94398658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fed2f93-f53f-499b-a95b-7581a2133921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:42 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-98b509c4-c3f3-4271-ba9c-c2d2be43d759 tempest-GroupSnapshotsV319Test-94398658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1e9b1ec-173a-488c-b370-30e53ac35fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:42 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-98b509c4-c3f3-4271-ba9c-c2d2be43d759 tempest-GroupSnapshotsV319Test-94398658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1e9b1ec-173a-488c-b370-30e53ac35fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3b3c841-f6c9-485f-a666-f7de93ca4a85', 'volume_name': 'volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:42 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-98b509c4-c3f3-4271-ba9c-c2d2be43d759 tempest-GroupSnapshotsV319Test-94398658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aece26d-5d90-402f-82b0-3d3851a5d20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:42 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-98b509c4-c3f3-4271-ba9c-c2d2be43d759 tempest-GroupSnapshotsV319Test-94398658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aece26d-5d90-402f-82b0-3d3851a5d20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:42 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-98b509c4-c3f3-4271-ba9c-c2d2be43d759 tempest-GroupSnapshotsV319Test-94398658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd0f8878-1abc-4379-9d8a-e7e98f4a695c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:42 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-98b509c4-c3f3-4271-ba9c-c2d2be43d759 tempest-GroupSnapshotsV319Test-94398658 None] Volume a3b3c841-f6c9-485f-a666-f7de93ca4a85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85', 'volume_size': 1}
Jul 10 12:49:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-98b509c4-c3f3-4271-ba9c-c2d2be43d759 tempest-GroupSnapshotsV319Test-94398658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:49:42 devstack sudo[99701]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-634bfe59-0156-47ec-83b9-2c2a6a573eb7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-11b79f6c-faa4-440e-ae00-23310441d505" returned: 0 in 0.837s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:42 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-634bfe59-0156-47ec-83b9-2c2a6a573eb7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] <== create_volume: return (1806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:49:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-634bfe59-0156-47ec-83b9-2c2a6a573eb7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.810s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-eb4e2929-7258-45eb-873c-8c4e1d1c5c54 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.037s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:42 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-eb4e2929-7258-45eb-873c-8c4e1d1c5c54 tempest-CreateVolumesFromSnapshotTest-1687039053 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-654930948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=020505d6-d37e-46b8-98b7-38cb7fdd27f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b672e8fc6a4745d8a981a4b3bfc5ccdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:49:37Z,use_quota=True,user_id='c639dd0a31794446b044a5425a4a6882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:49:42 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-eb4e2929-7258-45eb-873c-8c4e1d1c5c54 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Creating volume 020505d6-d37e-46b8-98b7-38cb7fdd27f6 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:49:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-eb4e2929-7258-45eb-873c-8c4e1d1c5c54 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:49:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-eb4e2929-7258-45eb-873c-8c4e1d1c5c54 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:42 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-eb4e2929-7258-45eb-873c-8c4e1d1c5c54 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:49:42 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-eb4e2929-7258-45eb-873c-8c4e1d1c5c54 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:49:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-eb4e2929-7258-45eb-873c-8c4e1d1c5c54 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:42 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-eb4e2929-7258-45eb-873c-8c4e1d1c5c54 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:49:42 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-eb4e2929-7258-45eb-873c-8c4e1d1c5c54 tempest-CreateVolumesFromSnapshotTest-1687039053 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:49:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-eb4e2929-7258-45eb-873c-8c4e1d1c5c54 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-020505d6-d37e-46b8-98b7-38cb7fdd27f6 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:42 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-634bfe59-0156-47ec-83b9-2c2a6a573eb7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9018e86f-cd17-41f7-bc83-0635f520cdc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11b79f6c-faa4-440e-ae00-23310441d505', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:42 devstack sudo[99704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-020505d6-d37e-46b8-98b7-38cb7fdd27f6 1073741824
Jul 10 12:49:42 devstack sudo[99704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:42 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-634bfe59-0156-47ec-83b9-2c2a6a573eb7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e19b346e-a243-4b81-a5e4-c15cf94a311b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:42 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-634bfe59-0156-47ec-83b9-2c2a6a573eb7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Volume volume-11b79f6c-faa4-440e-ae00-23310441d505 (11b79f6c-faa4-440e-ae00-23310441d505): created successfully
Jul 10 12:49:42 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-634bfe59-0156-47ec-83b9-2c2a6a573eb7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e19b346e-a243-4b81-a5e4-c15cf94a311b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:42 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-634bfe59-0156-47ec-83b9-2c2a6a573eb7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Flow 'volume_create_manager' (c59b1332-d020-4536-a219-29d42c55c525) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:49:42 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-634bfe59-0156-47ec-83b9-2c2a6a573eb7 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Created volume successfully.
Jul 10 12:49:43 devstack sudo[99704]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-eb4e2929-7258-45eb-873c-8c4e1d1c5c54 tempest-CreateVolumesFromSnapshotTest-1687039053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-020505d6-d37e-46b8-98b7-38cb7fdd27f6 1073741824" returned: 0 in 0.943s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-eb4e2929-7258-45eb-873c-8c4e1d1c5c54 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-020505d6-d37e-46b8-98b7-38cb7fdd27f6 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:43 devstack sudo[99710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-020505d6-d37e-46b8-98b7-38cb7fdd27f6
Jul 10 12:49:43 devstack sudo[99710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:44 devstack sudo[99710]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-eb4e2929-7258-45eb-873c-8c4e1d1c5c54 tempest-CreateVolumesFromSnapshotTest-1687039053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-020505d6-d37e-46b8-98b7-38cb7fdd27f6" returned: 0 in 0.707s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:44 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-eb4e2929-7258-45eb-873c-8c4e1d1c5c54 tempest-CreateVolumesFromSnapshotTest-1687039053 None] <== create_volume: return (1695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:49:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-eb4e2929-7258-45eb-873c-8c4e1d1c5c54 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.698s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-7e04d7ac-3880-40ff-a30a-a66d2fbf4f20 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.407s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:44 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-7e04d7ac-3880-40ff-a30a-a66d2fbf4f20 tempest-CreateVolumesFromSnapshotTest-1687039053 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1800315781',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2429b67f-ab78-4508-965e-12a3a28fdfaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b672e8fc6a4745d8a981a4b3bfc5ccdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:49:38Z,use_quota=True,user_id='c639dd0a31794446b044a5425a4a6882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:49:44 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-7e04d7ac-3880-40ff-a30a-a66d2fbf4f20 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Creating volume 2429b67f-ab78-4508-965e-12a3a28fdfaa {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:49:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-7e04d7ac-3880-40ff-a30a-a66d2fbf4f20 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:49:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-7e04d7ac-3880-40ff-a30a-a66d2fbf4f20 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:44 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-7e04d7ac-3880-40ff-a30a-a66d2fbf4f20 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:49:44 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-7e04d7ac-3880-40ff-a30a-a66d2fbf4f20 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:49:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-7e04d7ac-3880-40ff-a30a-a66d2fbf4f20 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:44 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-7e04d7ac-3880-40ff-a30a-a66d2fbf4f20 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:49:44 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-7e04d7ac-3880-40ff-a30a-a66d2fbf4f20 tempest-CreateVolumesFromSnapshotTest-1687039053 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:49:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7e04d7ac-3880-40ff-a30a-a66d2fbf4f20 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2429b67f-ab78-4508-965e-12a3a28fdfaa 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-eb4e2929-7258-45eb-873c-8c4e1d1c5c54 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59095450-e9a0-409d-941d-43aa1fba998d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-020505d6-d37e-46b8-98b7-38cb7fdd27f6', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:44 devstack sudo[99713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2429b67f-ab78-4508-965e-12a3a28fdfaa 1073741824
Jul 10 12:49:44 devstack sudo[99713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-eb4e2929-7258-45eb-873c-8c4e1d1c5c54 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7d3875c-61b8-40af-a769-2ef3b474507b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:44 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-eb4e2929-7258-45eb-873c-8c4e1d1c5c54 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Volume volume-020505d6-d37e-46b8-98b7-38cb7fdd27f6 (020505d6-d37e-46b8-98b7-38cb7fdd27f6): created successfully
Jul 10 12:49:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-eb4e2929-7258-45eb-873c-8c4e1d1c5c54 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7d3875c-61b8-40af-a769-2ef3b474507b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-eb4e2929-7258-45eb-873c-8c4e1d1c5c54 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Flow 'volume_create_manager' (d1608260-8c3a-4c6f-b9ef-028c02dda571) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:49:44 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-eb4e2929-7258-45eb-873c-8c4e1d1c5c54 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Created volume successfully.
Jul 10 12:49:45 devstack sudo[99713]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7e04d7ac-3880-40ff-a30a-a66d2fbf4f20 tempest-CreateVolumesFromSnapshotTest-1687039053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2429b67f-ab78-4508-965e-12a3a28fdfaa 1073741824" returned: 0 in 0.912s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7e04d7ac-3880-40ff-a30a-a66d2fbf4f20 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2429b67f-ab78-4508-965e-12a3a28fdfaa {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:45 devstack sudo[99719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2429b67f-ab78-4508-965e-12a3a28fdfaa
Jul 10 12:49:45 devstack sudo[99719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:45 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dd7b200-3ebf-48fb-97ba-2acd570ed006 tempest-VolumesCloneNegativeTest-2026806363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:49:45 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6dd7b200-3ebf-48fb-97ba-2acd570ed006 tempest-VolumesCloneNegativeTest-2026806363 None] Flow 'volume_create_manager' (fe6c9e23-a99a-4d39-95aa-e084a9301a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:49:45 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6dd7b200-3ebf-48fb-97ba-2acd570ed006 tempest-VolumesCloneNegativeTest-2026806363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18a033ce-283d-4d8d-9abb-fbea02020eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:45 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6dd7b200-3ebf-48fb-97ba-2acd570ed006 tempest-VolumesCloneNegativeTest-2026806363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18a033ce-283d-4d8d-9abb-fbea02020eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:49:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1244570221',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf87ec23-79c2-4968-a136-d8d5f602b7b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94ac680b50f741858823094092fdbf12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:49:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:49:45Z,use_quota=True,user_id='140aa2bfbea547b3856ab20d2e97f30f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:45 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6dd7b200-3ebf-48fb-97ba-2acd570ed006 tempest-VolumesCloneNegativeTest-2026806363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33f90c2d-e087-4bbb-90f6-2979a4d53dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:45 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6dd7b200-3ebf-48fb-97ba-2acd570ed006 tempest-VolumesCloneNegativeTest-2026806363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33f90c2d-e087-4bbb-90f6-2979a4d53dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:45 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6dd7b200-3ebf-48fb-97ba-2acd570ed006 tempest-VolumesCloneNegativeTest-2026806363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (025451db-0059-4bf2-92f9-fb862ad54736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:45 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6dd7b200-3ebf-48fb-97ba-2acd570ed006 tempest-VolumesCloneNegativeTest-2026806363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (025451db-0059-4bf2-92f9-fb862ad54736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf87ec23-79c2-4968-a136-d8d5f602b7b2', 'volume_name': 'volume-bf87ec23-79c2-4968-a136-d8d5f602b7b2', 'volume_size': 2}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:45 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6dd7b200-3ebf-48fb-97ba-2acd570ed006 tempest-VolumesCloneNegativeTest-2026806363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49e4875d-4881-487e-b3a6-7fe5dc93018d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:45 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6dd7b200-3ebf-48fb-97ba-2acd570ed006 tempest-VolumesCloneNegativeTest-2026806363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49e4875d-4881-487e-b3a6-7fe5dc93018d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:45 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6dd7b200-3ebf-48fb-97ba-2acd570ed006 tempest-VolumesCloneNegativeTest-2026806363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea8cac25-9e97-48ac-8da4-dd054bd54ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:45 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-6dd7b200-3ebf-48fb-97ba-2acd570ed006 tempest-VolumesCloneNegativeTest-2026806363 None] Volume bf87ec23-79c2-4968-a136-d8d5f602b7b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf87ec23-79c2-4968-a136-d8d5f602b7b2', 'volume_size': 2}
Jul 10 12:49:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-6dd7b200-3ebf-48fb-97ba-2acd570ed006 tempest-VolumesCloneNegativeTest-2026806363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:49:45 devstack sudo[99719]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7e04d7ac-3880-40ff-a30a-a66d2fbf4f20 tempest-CreateVolumesFromSnapshotTest-1687039053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2429b67f-ab78-4508-965e-12a3a28fdfaa" returned: 0 in 0.673s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:45 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-7e04d7ac-3880-40ff-a30a-a66d2fbf4f20 tempest-CreateVolumesFromSnapshotTest-1687039053 None] <== create_volume: return (1626ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:49:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-7e04d7ac-3880-40ff-a30a-a66d2fbf4f20 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.629s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-98b509c4-c3f3-4271-ba9c-c2d2be43d759 tempest-GroupSnapshotsV319Test-94398658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.586s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:45 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-98b509c4-c3f3-4271-ba9c-c2d2be43d759 tempest-GroupSnapshotsV319Test-94398658 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=934f2181-fb5b-4886-b36e-59b2d3d78932,created_at=2026-07-10T10:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-826468149',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=934f2181-fb5b-4886-b36e-59b2d3d78932,host='devstack@QuobyteHD#QuobyteHD',id=a3b3c841-f6c9-485f-a666-f7de93ca4a85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b015e3d3ff3c43efb363199550ee934c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:49:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:49:42Z,use_quota=True,user_id='bd962fa7d78f49b6bcd22ef7b313ecd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27935c6-f522-4fc6-b077-b699443d7bd7),volume_type_id=b27935c6-f522-4fc6-b077-b699443d7bd7)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:49:45 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-98b509c4-c3f3-4271-ba9c-c2d2be43d759 tempest-GroupSnapshotsV319Test-94398658 None] Creating volume a3b3c841-f6c9-485f-a666-f7de93ca4a85 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:49:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-98b509c4-c3f3-4271-ba9c-c2d2be43d759 tempest-GroupSnapshotsV319Test-94398658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:49:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-98b509c4-c3f3-4271-ba9c-c2d2be43d759 tempest-GroupSnapshotsV319Test-94398658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:45 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-98b509c4-c3f3-4271-ba9c-c2d2be43d759 tempest-GroupSnapshotsV319Test-94398658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:49:45 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-98b509c4-c3f3-4271-ba9c-c2d2be43d759 tempest-GroupSnapshotsV319Test-94398658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:49:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-98b509c4-c3f3-4271-ba9c-c2d2be43d759 tempest-GroupSnapshotsV319Test-94398658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:45 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-98b509c4-c3f3-4271-ba9c-c2d2be43d759 tempest-GroupSnapshotsV319Test-94398658 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:49:45 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-98b509c4-c3f3-4271-ba9c-c2d2be43d759 tempest-GroupSnapshotsV319Test-94398658 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:49:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-98b509c4-c3f3-4271-ba9c-c2d2be43d759 tempest-GroupSnapshotsV319Test-94398658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:45 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7e04d7ac-3880-40ff-a30a-a66d2fbf4f20 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8edfa020-3fd7-4901-a462-0742ef316507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2429b67f-ab78-4508-965e-12a3a28fdfaa', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:45 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7e04d7ac-3880-40ff-a30a-a66d2fbf4f20 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fd9aece-d9e0-4dfb-ae37-5d1c7ca02f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:45 devstack sudo[99722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85 1073741824
Jul 10 12:49:45 devstack sudo[99722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:45 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-7e04d7ac-3880-40ff-a30a-a66d2fbf4f20 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Volume volume-2429b67f-ab78-4508-965e-12a3a28fdfaa (2429b67f-ab78-4508-965e-12a3a28fdfaa): created successfully
Jul 10 12:49:45 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7e04d7ac-3880-40ff-a30a-a66d2fbf4f20 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fd9aece-d9e0-4dfb-ae37-5d1c7ca02f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:45 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7e04d7ac-3880-40ff-a30a-a66d2fbf4f20 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Flow 'volume_create_manager' (29044501-fe83-4c36-8a95-c6b2221b3890) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:49:45 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-7e04d7ac-3880-40ff-a30a-a66d2fbf4f20 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Created volume successfully.
Jul 10 12:49:46 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e645561f-900a-4cb6-8a7b-d387867864c5 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Acquiring lock "cinder-2429b67f-ab78-4508-965e-12a3a28fdfaa-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:49:46 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e645561f-900a-4cb6-8a7b-d387867864c5 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "cinder-2429b67f-ab78-4508-965e-12a3a28fdfaa-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:49:46 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e645561f-900a-4cb6-8a7b-d387867864c5 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Acquiring lock "cinder-quobyte-2429b67f-ab78-4508-965e-12a3a28fdfaa" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:49:46 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e645561f-900a-4cb6-8a7b-d387867864c5 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "cinder-quobyte-2429b67f-ab78-4508-965e-12a3a28fdfaa" acquired by "delete_volume" :: waited 0.015s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:49:46 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bda68b1-f43e-4424-82ec-c31ebe99b08d]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:49:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e645561f-900a-4cb6-8a7b-d387867864c5 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2429b67f-ab78-4508-965e-12a3a28fdfaa {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:46 devstack sudo[99722]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-98b509c4-c3f3-4271-ba9c-c2d2be43d759 tempest-GroupSnapshotsV319Test-94398658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85 1073741824" returned: 0 in 0.908s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:46 devstack sudo[99728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2429b67f-ab78-4508-965e-12a3a28fdfaa
Jul 10 12:49:46 devstack sudo[99728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-98b509c4-c3f3-4271-ba9c-c2d2be43d759 tempest-GroupSnapshotsV319Test-94398658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:46 devstack sudo[99730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85
Jul 10 12:49:46 devstack sudo[99730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:47 devstack sudo[99728]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e645561f-900a-4cb6-8a7b-d387867864c5 tempest-CreateVolumesFromSnapshotTest-1687039053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2429b67f-ab78-4508-965e-12a3a28fdfaa" returned: 0 in 0.785s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e645561f-900a-4cb6-8a7b-d387867864c5 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2429b67f-ab78-4508-965e-12a3a28fdfaa {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:47 devstack sudo[99730]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:47 devstack sudo[99737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2429b67f-ab78-4508-965e-12a3a28fdfaa
Jul 10 12:49:47 devstack sudo[99737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-98b509c4-c3f3-4271-ba9c-c2d2be43d759 tempest-GroupSnapshotsV319Test-94398658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85" returned: 0 in 0.672s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:47 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-98b509c4-c3f3-4271-ba9c-c2d2be43d759 tempest-GroupSnapshotsV319Test-94398658 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:49:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-98b509c4-c3f3-4271-ba9c-c2d2be43d759 tempest-GroupSnapshotsV319Test-94398658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-6dd7b200-3ebf-48fb-97ba-2acd570ed006 tempest-VolumesCloneNegativeTest-2026806363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.175s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:47 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-6dd7b200-3ebf-48fb-97ba-2acd570ed006 tempest-VolumesCloneNegativeTest-2026806363 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:49:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1244570221',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf87ec23-79c2-4968-a136-d8d5f602b7b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94ac680b50f741858823094092fdbf12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:49:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:49:45Z,use_quota=True,user_id='140aa2bfbea547b3856ab20d2e97f30f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:49:47 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-6dd7b200-3ebf-48fb-97ba-2acd570ed006 tempest-VolumesCloneNegativeTest-2026806363 None] Creating volume bf87ec23-79c2-4968-a136-d8d5f602b7b2 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:49:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-6dd7b200-3ebf-48fb-97ba-2acd570ed006 tempest-VolumesCloneNegativeTest-2026806363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:49:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-6dd7b200-3ebf-48fb-97ba-2acd570ed006 tempest-VolumesCloneNegativeTest-2026806363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:47 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-6dd7b200-3ebf-48fb-97ba-2acd570ed006 tempest-VolumesCloneNegativeTest-2026806363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:49:47 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-6dd7b200-3ebf-48fb-97ba-2acd570ed006 tempest-VolumesCloneNegativeTest-2026806363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:49:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-6dd7b200-3ebf-48fb-97ba-2acd570ed006 tempest-VolumesCloneNegativeTest-2026806363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:47 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-6dd7b200-3ebf-48fb-97ba-2acd570ed006 tempest-VolumesCloneNegativeTest-2026806363 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:49:47 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-6dd7b200-3ebf-48fb-97ba-2acd570ed006 tempest-VolumesCloneNegativeTest-2026806363 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:49:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6dd7b200-3ebf-48fb-97ba-2acd570ed006 tempest-VolumesCloneNegativeTest-2026806363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-bf87ec23-79c2-4968-a136-d8d5f602b7b2 2147483648 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-98b509c4-c3f3-4271-ba9c-c2d2be43d759 tempest-GroupSnapshotsV319Test-94398658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd0f8878-1abc-4379-9d8a-e7e98f4a695c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-98b509c4-c3f3-4271-ba9c-c2d2be43d759 tempest-GroupSnapshotsV319Test-94398658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81afe9bb-c001-4287-9ce9-281c3aa718c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:47 devstack sudo[99739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-bf87ec23-79c2-4968-a136-d8d5f602b7b2 2147483648
Jul 10 12:49:47 devstack sudo[99739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:47 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-98b509c4-c3f3-4271-ba9c-c2d2be43d759 tempest-GroupSnapshotsV319Test-94398658 None] Volume volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85 (a3b3c841-f6c9-485f-a666-f7de93ca4a85): created successfully
Jul 10 12:49:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-98b509c4-c3f3-4271-ba9c-c2d2be43d759 tempest-GroupSnapshotsV319Test-94398658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81afe9bb-c001-4287-9ce9-281c3aa718c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-98b509c4-c3f3-4271-ba9c-c2d2be43d759 tempest-GroupSnapshotsV319Test-94398658 None] Flow 'volume_create_manager' (0c610c90-f69d-492d-bfdb-101050b70a35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:49:47 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-98b509c4-c3f3-4271-ba9c-c2d2be43d759 tempest-GroupSnapshotsV319Test-94398658 None] Created volume successfully.
Jul 10 12:49:48 devstack sudo[99737]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e645561f-900a-4cb6-8a7b-d387867864c5 tempest-CreateVolumesFromSnapshotTest-1687039053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2429b67f-ab78-4508-965e-12a3a28fdfaa" returned: 0 in 0.706s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:48 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e645561f-900a-4cb6-8a7b-d387867864c5 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "cinder-quobyte-2429b67f-ab78-4508-965e-12a3a28fdfaa" released by "delete_volume" :: held 1.528s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:49:48 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-e645561f-900a-4cb6-8a7b-d387867864c5 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Created reservations ['03b0390b-6452-481c-b71f-d3067e239528', '23481bc6-4889-4267-99e8-a7387588b64f', '79ae77ac-7859-49af-abac-4bdefa178005', '3bc76214-8f87-4f5f-8d25-d5dedcf1e925'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:49:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e645561f-900a-4cb6-8a7b-d387867864c5 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:49:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e645561f-900a-4cb6-8a7b-d387867864c5 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:48 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-e645561f-900a-4cb6-8a7b-d387867864c5 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:49:48 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-e645561f-900a-4cb6-8a7b-d387867864c5 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:49:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e645561f-900a-4cb6-8a7b-d387867864c5 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e645561f-900a-4cb6-8a7b-d387867864c5 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:48 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-7ed6207a-725a-4fd7-8903-dae0a6b98b42 tempest-GroupSnapshotsV319Test-94398658 None] GroupSnapshot 6e2e59f5-20bc-429e-9d05-e3f02d34e654: creating.
Jul 10 12:49:48 devstack sudo[99746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:49:48 devstack sudo[99746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:48 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7ed6207a-725a-4fd7-8903-dae0a6b98b42 tempest-GroupSnapshotsV319Test-94398658 None] Group snapshot 6e2e59f5-20bc-429e-9d05-e3f02d34e654: creating. {{(pid=87378) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 10 12:49:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-7ed6207a-725a-4fd7-8903-dae0a6b98b42 tempest-GroupSnapshotsV319Test-94398658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:49:48 devstack sudo[99739]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6dd7b200-3ebf-48fb-97ba-2acd570ed006 tempest-VolumesCloneNegativeTest-2026806363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-bf87ec23-79c2-4968-a136-d8d5f602b7b2 2147483648" returned: 0 in 1.015s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6dd7b200-3ebf-48fb-97ba-2acd570ed006 tempest-VolumesCloneNegativeTest-2026806363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-bf87ec23-79c2-4968-a136-d8d5f602b7b2 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:48 devstack sudo[99748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-bf87ec23-79c2-4968-a136-d8d5f602b7b2
Jul 10 12:49:48 devstack sudo[99748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:48 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8464719b-a8c4-4ace-a99f-45849d381515 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Acquiring lock "cinder-020505d6-d37e-46b8-98b7-38cb7fdd27f6-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:49:48 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8464719b-a8c4-4ace-a99f-45849d381515 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "cinder-020505d6-d37e-46b8-98b7-38cb7fdd27f6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:49:48 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8464719b-a8c4-4ace-a99f-45849d381515 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Acquiring lock "cinder-quobyte-020505d6-d37e-46b8-98b7-38cb7fdd27f6" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:49:48 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8464719b-a8c4-4ace-a99f-45849d381515 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "cinder-quobyte-020505d6-d37e-46b8-98b7-38cb7fdd27f6" acquired by "delete_volume" :: waited 0.024s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:49:48 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde0d65f-11e1-4b18-9d22-a26475c9513f]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:49:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8464719b-a8c4-4ace-a99f-45849d381515 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-020505d6-d37e-46b8-98b7-38cb7fdd27f6 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:48 devstack sudo[99746]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e645561f-900a-4cb6-8a7b-d387867864c5 tempest-CreateVolumesFromSnapshotTest-1687039053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.712s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:48 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-e645561f-900a-4cb6-8a7b-d387867864c5 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:49:48 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-e645561f-900a-4cb6-8a7b-d387867864c5 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Deleted volume successfully.
Jul 10 12:49:48 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e645561f-900a-4cb6-8a7b-d387867864c5 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "cinder-2429b67f-ab78-4508-965e-12a3a28fdfaa-delete_volume" released by "delete_volume" :: held 2.483s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:49:48 devstack sudo[99751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-020505d6-d37e-46b8-98b7-38cb7fdd27f6
Jul 10 12:49:48 devstack sudo[99751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:49 devstack sudo[99748]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6dd7b200-3ebf-48fb-97ba-2acd570ed006 tempest-VolumesCloneNegativeTest-2026806363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-bf87ec23-79c2-4968-a136-d8d5f602b7b2" returned: 0 in 0.721s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:49 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-6dd7b200-3ebf-48fb-97ba-2acd570ed006 tempest-VolumesCloneNegativeTest-2026806363 None] <== create_volume: return (1781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:49:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-6dd7b200-3ebf-48fb-97ba-2acd570ed006 tempest-VolumesCloneNegativeTest-2026806363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.784s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-7ed6207a-725a-4fd7-8903-dae0a6b98b42 tempest-GroupSnapshotsV319Test-94398658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.886s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:49 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6dd7b200-3ebf-48fb-97ba-2acd570ed006 tempest-VolumesCloneNegativeTest-2026806363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea8cac25-9e97-48ac-8da4-dd054bd54ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf87ec23-79c2-4968-a136-d8d5f602b7b2', 'volume_size': 2}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:49 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6dd7b200-3ebf-48fb-97ba-2acd570ed006 tempest-VolumesCloneNegativeTest-2026806363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23548083-aff1-4997-9051-9bc33847d030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:49 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-7ed6207a-725a-4fd7-8903-dae0a6b98b42 tempest-GroupSnapshotsV319Test-94398658 None] Creating offline snapshot df9cf0dd-b2ec-4b63-a517-27022a9aa525 of volume a3b3c841-f6c9-485f-a666-f7de93ca4a85 {{(pid=87378) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 10 12:49:49 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-6dd7b200-3ebf-48fb-97ba-2acd570ed006 tempest-VolumesCloneNegativeTest-2026806363 None] Volume volume-bf87ec23-79c2-4968-a136-d8d5f602b7b2 (bf87ec23-79c2-4968-a136-d8d5f602b7b2): created successfully
Jul 10 12:49:49 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6dd7b200-3ebf-48fb-97ba-2acd570ed006 tempest-VolumesCloneNegativeTest-2026806363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23548083-aff1-4997-9051-9bc33847d030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:49 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6dd7b200-3ebf-48fb-97ba-2acd570ed006 tempest-VolumesCloneNegativeTest-2026806363 None] Flow 'volume_create_manager' (fe6c9e23-a99a-4d39-95aa-e084a9301a47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:49:49 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9edacef-1329-49f4-b4a4-44da76e96ea5]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:49:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7ed6207a-725a-4fd7-8903-dae0a6b98b42 tempest-GroupSnapshotsV319Test-94398658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:49 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-6dd7b200-3ebf-48fb-97ba-2acd570ed006 tempest-VolumesCloneNegativeTest-2026806363 None] Created volume successfully.
Jul 10 12:49:49 devstack sudo[99755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85
Jul 10 12:49:49 devstack sudo[99755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:49 devstack sudo[99751]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8464719b-a8c4-4ace-a99f-45849d381515 tempest-CreateVolumesFromSnapshotTest-1687039053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-020505d6-d37e-46b8-98b7-38cb7fdd27f6" returned: 0 in 0.820s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8464719b-a8c4-4ace-a99f-45849d381515 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-020505d6-d37e-46b8-98b7-38cb7fdd27f6 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:49 devstack sudo[99760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-020505d6-d37e-46b8-98b7-38cb7fdd27f6
Jul 10 12:49:49 devstack sudo[99760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:50 devstack sudo[99755]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7ed6207a-725a-4fd7-8903-dae0a6b98b42 tempest-GroupSnapshotsV319Test-94398658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85" returned: 0 in 0.787s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7ed6207a-725a-4fd7-8903-dae0a6b98b42 tempest-GroupSnapshotsV319Test-94398658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85.df9cf0dd-b2ec-4b63-a517-27022a9aa525 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:50 devstack sudo[99765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85.df9cf0dd-b2ec-4b63-a517-27022a9aa525 1G
Jul 10 12:49:50 devstack sudo[99765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:50 devstack sudo[99760]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8464719b-a8c4-4ace-a99f-45849d381515 tempest-CreateVolumesFromSnapshotTest-1687039053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-020505d6-d37e-46b8-98b7-38cb7fdd27f6" returned: 0 in 0.690s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:50 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8464719b-a8c4-4ace-a99f-45849d381515 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "cinder-quobyte-020505d6-d37e-46b8-98b7-38cb7fdd27f6" released by "delete_volume" :: held 1.572s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:49:50 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-8464719b-a8c4-4ace-a99f-45849d381515 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Created reservations ['6a4c57bf-c43b-4630-8ba6-5ffc5f08abb1', '34956c07-2f0d-457c-b3c3-31ae8e92ca40', 'ace96b82-f20a-4017-8f2d-f2ad5643a19d', '6168256e-872d-474c-b69a-740537cceb35'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:49:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-8464719b-a8c4-4ace-a99f-45849d381515 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:49:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-8464719b-a8c4-4ace-a99f-45849d381515 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:50 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-8464719b-a8c4-4ace-a99f-45849d381515 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:49:50 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-8464719b-a8c4-4ace-a99f-45849d381515 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:49:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-8464719b-a8c4-4ace-a99f-45849d381515 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8464719b-a8c4-4ace-a99f-45849d381515 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:50 devstack sudo[99768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:49:50 devstack sudo[99768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:50 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-857c7af3-d4f3-4678-8519-a05ede967e0f tempest-VolumesCloneNegativeTest-2026806363 None] Acquiring lock "cinder-bf87ec23-79c2-4968-a136-d8d5f602b7b2-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:49:50 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-857c7af3-d4f3-4678-8519-a05ede967e0f tempest-VolumesCloneNegativeTest-2026806363 None] Lock "cinder-bf87ec23-79c2-4968-a136-d8d5f602b7b2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:49:50 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-857c7af3-d4f3-4678-8519-a05ede967e0f tempest-VolumesCloneNegativeTest-2026806363 None] Acquiring lock "cinder-quobyte-bf87ec23-79c2-4968-a136-d8d5f602b7b2" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:49:50 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-857c7af3-d4f3-4678-8519-a05ede967e0f tempest-VolumesCloneNegativeTest-2026806363 None] Lock "cinder-quobyte-bf87ec23-79c2-4968-a136-d8d5f602b7b2" acquired by "delete_volume" :: waited 0.020s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:49:50 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7bda99-f5ff-476e-9ff2-b0bbef2c7e74]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:49:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-857c7af3-d4f3-4678-8519-a05ede967e0f tempest-VolumesCloneNegativeTest-2026806363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-bf87ec23-79c2-4968-a136-d8d5f602b7b2 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:50 devstack sudo[99774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-bf87ec23-79c2-4968-a136-d8d5f602b7b2
Jul 10 12:49:50 devstack sudo[99774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:50 devstack sudo[99765]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7ed6207a-725a-4fd7-8903-dae0a6b98b42 tempest-GroupSnapshotsV319Test-94398658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85.df9cf0dd-b2ec-4b63-a517-27022a9aa525 1G" returned: 0 in 0.909s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7ed6207a-725a-4fd7-8903-dae0a6b98b42 tempest-GroupSnapshotsV319Test-94398658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85.df9cf0dd-b2ec-4b63-a517-27022a9aa525 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:50 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b101a3f1-674d-4cf0-8378-4f4497e13bf2 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Acquiring lock "cinder-11b79f6c-faa4-440e-ae00-23310441d505-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:49:51 devstack sudo[99776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85.df9cf0dd-b2ec-4b63-a517-27022a9aa525
Jul 10 12:49:51 devstack sudo[99776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:51 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b101a3f1-674d-4cf0-8378-4f4497e13bf2 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "cinder-11b79f6c-faa4-440e-ae00-23310441d505-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:49:51 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b101a3f1-674d-4cf0-8378-4f4497e13bf2 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Acquiring lock "cinder-quobyte-11b79f6c-faa4-440e-ae00-23310441d505" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:49:51 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b101a3f1-674d-4cf0-8378-4f4497e13bf2 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "cinder-quobyte-11b79f6c-faa4-440e-ae00-23310441d505" acquired by "delete_volume" :: waited 0.020s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:49:51 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f4de57-f118-405a-b5a1-358b5bec2602]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:49:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b101a3f1-674d-4cf0-8378-4f4497e13bf2 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-11b79f6c-faa4-440e-ae00-23310441d505 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:51 devstack sudo[99778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-11b79f6c-faa4-440e-ae00-23310441d505
Jul 10 12:49:51 devstack sudo[99778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:51 devstack sudo[99768]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8464719b-a8c4-4ace-a99f-45849d381515 tempest-CreateVolumesFromSnapshotTest-1687039053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.787s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:51 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-8464719b-a8c4-4ace-a99f-45849d381515 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:49:51 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-8464719b-a8c4-4ace-a99f-45849d381515 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Deleted volume successfully.
Jul 10 12:49:51 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8464719b-a8c4-4ace-a99f-45849d381515 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "cinder-020505d6-d37e-46b8-98b7-38cb7fdd27f6-delete_volume" released by "delete_volume" :: held 2.605s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:49:51 devstack sudo[99774]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-857c7af3-d4f3-4678-8519-a05ede967e0f tempest-VolumesCloneNegativeTest-2026806363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-bf87ec23-79c2-4968-a136-d8d5f602b7b2" returned: 0 in 0.902s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-857c7af3-d4f3-4678-8519-a05ede967e0f tempest-VolumesCloneNegativeTest-2026806363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-bf87ec23-79c2-4968-a136-d8d5f602b7b2 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:51 devstack sudo[99788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-bf87ec23-79c2-4968-a136-d8d5f602b7b2
Jul 10 12:49:51 devstack sudo[99788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:51 devstack sudo[99776]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7ed6207a-725a-4fd7-8903-dae0a6b98b42 tempest-GroupSnapshotsV319Test-94398658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85.df9cf0dd-b2ec-4b63-a517-27022a9aa525" returned: 0 in 0.780s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:51 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-7ed6207a-725a-4fd7-8903-dae0a6b98b42 tempest-GroupSnapshotsV319Test-94398658 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85.df9cf0dd-b2ec-4b63-a517-27022a9aa525 is being set with open permissions: ugo+rw: NotImplementedError
Jul 10 12:49:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7ed6207a-725a-4fd7-8903-dae0a6b98b42 tempest-GroupSnapshotsV319Test-94398658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85.df9cf0dd-b2ec-4b63-a517-27022a9aa525 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:51 devstack sudo[99790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85.df9cf0dd-b2ec-4b63-a517-27022a9aa525
Jul 10 12:49:51 devstack sudo[99790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:51 devstack sudo[99778]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b101a3f1-674d-4cf0-8378-4f4497e13bf2 tempest-CreateVolumesFromSnapshotTest-1687039053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-11b79f6c-faa4-440e-ae00-23310441d505" returned: 0 in 0.802s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b101a3f1-674d-4cf0-8378-4f4497e13bf2 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-11b79f6c-faa4-440e-ae00-23310441d505 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:51 devstack sudo[99795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-11b79f6c-faa4-440e-ae00-23310441d505
Jul 10 12:49:51 devstack sudo[99795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:52 devstack sudo[99788]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-857c7af3-d4f3-4678-8519-a05ede967e0f tempest-VolumesCloneNegativeTest-2026806363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-bf87ec23-79c2-4968-a136-d8d5f602b7b2" returned: 0 in 0.701s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:52 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-857c7af3-d4f3-4678-8519-a05ede967e0f tempest-VolumesCloneNegativeTest-2026806363 None] Lock "cinder-quobyte-bf87ec23-79c2-4968-a136-d8d5f602b7b2" released by "delete_volume" :: held 1.642s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:49:52 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-857c7af3-d4f3-4678-8519-a05ede967e0f tempest-VolumesCloneNegativeTest-2026806363 None] Created reservations ['839e9818-8b90-4fa0-941c-dd3f5be12ccd', '810922ab-a3f9-4845-a95b-ec6410c8bf23', '6154558c-7dea-488b-8703-f7ed5686bf8c', '824229fb-173a-474b-b9a8-8c4e0304cb27'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:49:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-857c7af3-d4f3-4678-8519-a05ede967e0f tempest-VolumesCloneNegativeTest-2026806363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:49:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-857c7af3-d4f3-4678-8519-a05ede967e0f tempest-VolumesCloneNegativeTest-2026806363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:52 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-857c7af3-d4f3-4678-8519-a05ede967e0f tempest-VolumesCloneNegativeTest-2026806363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:49:52 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-857c7af3-d4f3-4678-8519-a05ede967e0f tempest-VolumesCloneNegativeTest-2026806363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:49:52 devstack sudo[99790]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-857c7af3-d4f3-4678-8519-a05ede967e0f tempest-VolumesCloneNegativeTest-2026806363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-857c7af3-d4f3-4678-8519-a05ede967e0f tempest-VolumesCloneNegativeTest-2026806363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7ed6207a-725a-4fd7-8903-dae0a6b98b42 tempest-GroupSnapshotsV319Test-94398658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85.df9cf0dd-b2ec-4b63-a517-27022a9aa525" returned: 0 in 0.737s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:52 devstack sudo[99799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:49:52 devstack sudo[99799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7ed6207a-725a-4fd7-8903-dae0a6b98b42 tempest-GroupSnapshotsV319Test-94398658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:52 devstack sudo[99801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85.info
Jul 10 12:49:52 devstack sudo[99801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:52 devstack sudo[99795]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b101a3f1-674d-4cf0-8378-4f4497e13bf2 tempest-CreateVolumesFromSnapshotTest-1687039053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-11b79f6c-faa4-440e-ae00-23310441d505" returned: 0 in 0.700s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:52 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b101a3f1-674d-4cf0-8378-4f4497e13bf2 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "cinder-quobyte-11b79f6c-faa4-440e-ae00-23310441d505" released by "delete_volume" :: held 1.550s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:49:52 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-b101a3f1-674d-4cf0-8378-4f4497e13bf2 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Created reservations ['f9ef78ea-9d33-406b-8797-c8a5ac1b83e3', '3844c6c5-beb9-4020-882d-44915b7578e7', '0c3cab99-de0d-48f1-abe8-d9d72f1d7310', 'f5aea62b-399a-4f4a-8c3d-43ea295a3e70'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:49:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-b101a3f1-674d-4cf0-8378-4f4497e13bf2 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:49:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-b101a3f1-674d-4cf0-8378-4f4497e13bf2 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:52 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-b101a3f1-674d-4cf0-8378-4f4497e13bf2 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:49:52 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-b101a3f1-674d-4cf0-8378-4f4497e13bf2 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:49:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-b101a3f1-674d-4cf0-8378-4f4497e13bf2 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b101a3f1-674d-4cf0-8378-4f4497e13bf2 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:52 devstack sudo[99804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:49:52 devstack sudo[99804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:53 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e5ba383e-a3ac-4c79-994d-9c9618bb8bda tempest-CreateVolumesFromSnapshotTest-1687039053 None] Acquiring lock "cinder-e358bdb7-d257-4c4e-8985-698d601c2305-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:49:53 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e5ba383e-a3ac-4c79-994d-9c9618bb8bda tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "cinder-e358bdb7-d257-4c4e-8985-698d601c2305-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:49:53 devstack sudo[99801]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7ed6207a-725a-4fd7-8903-dae0a6b98b42 tempest-GroupSnapshotsV319Test-94398658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85.info" returned: 0 in 0.826s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:53 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-7ed6207a-725a-4fd7-8903-dae0a6b98b42 tempest-GroupSnapshotsV319Test-94398658 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 10 12:49:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7ed6207a-725a-4fd7-8903-dae0a6b98b42 tempest-GroupSnapshotsV319Test-94398658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:53 devstack sudo[99799]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-857c7af3-d4f3-4678-8519-a05ede967e0f tempest-VolumesCloneNegativeTest-2026806363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.914s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:53 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-857c7af3-d4f3-4678-8519-a05ede967e0f tempest-VolumesCloneNegativeTest-2026806363 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:49:53 devstack sudo[99808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85.info
Jul 10 12:49:53 devstack sudo[99808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:53 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-857c7af3-d4f3-4678-8519-a05ede967e0f tempest-VolumesCloneNegativeTest-2026806363 None] Deleted volume successfully.
Jul 10 12:49:53 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e5ba383e-a3ac-4c79-994d-9c9618bb8bda tempest-CreateVolumesFromSnapshotTest-1687039053 None] Acquiring lock "cinder-quobyte-e358bdb7-d257-4c4e-8985-698d601c2305" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:49:53 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e5ba383e-a3ac-4c79-994d-9c9618bb8bda tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "cinder-quobyte-e358bdb7-d257-4c4e-8985-698d601c2305" acquired by "delete_volume" :: waited 0.025s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:49:53 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-857c7af3-d4f3-4678-8519-a05ede967e0f tempest-VolumesCloneNegativeTest-2026806363 None] Lock "cinder-bf87ec23-79c2-4968-a136-d8d5f602b7b2-delete_volume" released by "delete_volume" :: held 2.847s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:49:53 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[95982c6a-02be-48a3-8dda-41f33d317033]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:49:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e5ba383e-a3ac-4c79-994d-9c9618bb8bda tempest-CreateVolumesFromSnapshotTest-1687039053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e358bdb7-d257-4c4e-8985-698d601c2305 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:53 devstack sudo[99810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e358bdb7-d257-4c4e-8985-698d601c2305
Jul 10 12:49:53 devstack sudo[99810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:53 devstack sudo[99804]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b101a3f1-674d-4cf0-8378-4f4497e13bf2 tempest-CreateVolumesFromSnapshotTest-1687039053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.896s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:53 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-b101a3f1-674d-4cf0-8378-4f4497e13bf2 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:49:53 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-b101a3f1-674d-4cf0-8378-4f4497e13bf2 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Deleted volume successfully.
Jul 10 12:49:53 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b101a3f1-674d-4cf0-8378-4f4497e13bf2 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "cinder-11b79f6c-faa4-440e-ae00-23310441d505-delete_volume" released by "delete_volume" :: held 2.738s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:49:54 devstack sudo[99808]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7ed6207a-725a-4fd7-8903-dae0a6b98b42 tempest-GroupSnapshotsV319Test-94398658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85.info" returned: 0 in 0.879s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-7ed6207a-725a-4fd7-8903-dae0a6b98b42 tempest-GroupSnapshotsV319Test-94398658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.063s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:54 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-7ed6207a-725a-4fd7-8903-dae0a6b98b42 tempest-GroupSnapshotsV319Test-94398658 None] group_snapshot 6e2e59f5-20bc-429e-9d05-e3f02d34e654: created successfully
Jul 10 12:49:54 devstack sudo[99810]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e5ba383e-a3ac-4c79-994d-9c9618bb8bda tempest-CreateVolumesFromSnapshotTest-1687039053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e358bdb7-d257-4c4e-8985-698d601c2305" returned: 0 in 0.934s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e5ba383e-a3ac-4c79-994d-9c9618bb8bda tempest-CreateVolumesFromSnapshotTest-1687039053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e358bdb7-d257-4c4e-8985-698d601c2305 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:54 devstack sudo[99817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e358bdb7-d257-4c4e-8985-698d601c2305
Jul 10 12:49:54 devstack sudo[99817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:55 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-44ac91ee-518e-4812-9e54-eb97e8d4acfe tempest-GroupSnapshotsV319Test-94398658 None] group_snapshot 6e2e59f5-20bc-429e-9d05-e3f02d34e654: deleting
Jul 10 12:49:55 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-44ac91ee-518e-4812-9e54-eb97e8d4acfe tempest-GroupSnapshotsV319Test-94398658 None] group_snapshot 6e2e59f5-20bc-429e-9d05-e3f02d34e654: deleting {{(pid=87378) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 10 12:49:55 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-44ac91ee-518e-4812-9e54-eb97e8d4acfe tempest-GroupSnapshotsV319Test-94398658 None] Acquiring lock "cinder-quobyte-a3b3c841-f6c9-485f-a666-f7de93ca4a85" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:49:55 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-44ac91ee-518e-4812-9e54-eb97e8d4acfe tempest-GroupSnapshotsV319Test-94398658 None] Lock "cinder-quobyte-a3b3c841-f6c9-485f-a666-f7de93ca4a85" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:49:55 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-44ac91ee-518e-4812-9e54-eb97e8d4acfe tempest-GroupSnapshotsV319Test-94398658 None] Acquiring lock "cinder-quobyte-df9cf0dd-b2ec-4b63-a517-27022a9aa525" by "_delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:49:55 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-44ac91ee-518e-4812-9e54-eb97e8d4acfe tempest-GroupSnapshotsV319Test-94398658 None] Lock "cinder-quobyte-df9cf0dd-b2ec-4b63-a517-27022a9aa525" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:49:55 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-44ac91ee-518e-4812-9e54-eb97e8d4acfe tempest-GroupSnapshotsV319Test-94398658 None] Deleting offline snapshot df9cf0dd-b2ec-4b63-a517-27022a9aa525 of volume a3b3c841-f6c9-485f-a666-f7de93ca4a85 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 10 12:49:55 devstack sudo[99817]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:55 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-44ac91ee-518e-4812-9e54-eb97e8d4acfe tempest-GroupSnapshotsV319Test-94398658 None] snapshot_file for this snap is: volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85.df9cf0dd-b2ec-4b63-a517-27022a9aa525 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 10 12:49:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e5ba383e-a3ac-4c79-994d-9c9618bb8bda tempest-CreateVolumesFromSnapshotTest-1687039053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e358bdb7-d257-4c4e-8985-698d601c2305" returned: 0 in 0.744s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:55 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e5ba383e-a3ac-4c79-994d-9c9618bb8bda tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "cinder-quobyte-e358bdb7-d257-4c4e-8985-698d601c2305" released by "delete_volume" :: held 1.726s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:49:55 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae81ef4a-39d7-4a08-b5b1-2f494e48a1c2]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:49:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-44ac91ee-518e-4812-9e54-eb97e8d4acfe tempest-GroupSnapshotsV319Test-94398658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85.df9cf0dd-b2ec-4b63-a517-27022a9aa525 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:55 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-e5ba383e-a3ac-4c79-994d-9c9618bb8bda tempest-CreateVolumesFromSnapshotTest-1687039053 None] Created reservations ['4871be0c-4b9f-400b-9f3f-6c96a4edf381', 'b62dd015-48c1-474f-a4fa-c397640908e5', '95c4fd42-f0b7-4428-be9e-d25649ec02a0', '03c77e59-2688-4b08-82ff-5f906d614164'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:49:55 devstack sudo[99820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85.df9cf0dd-b2ec-4b63-a517-27022a9aa525
Jul 10 12:49:55 devstack sudo[99820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e5ba383e-a3ac-4c79-994d-9c9618bb8bda tempest-CreateVolumesFromSnapshotTest-1687039053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:49:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e5ba383e-a3ac-4c79-994d-9c9618bb8bda tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:55 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-e5ba383e-a3ac-4c79-994d-9c9618bb8bda tempest-CreateVolumesFromSnapshotTest-1687039053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:49:55 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-e5ba383e-a3ac-4c79-994d-9c9618bb8bda tempest-CreateVolumesFromSnapshotTest-1687039053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:49:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e5ba383e-a3ac-4c79-994d-9c9618bb8bda tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e5ba383e-a3ac-4c79-994d-9c9618bb8bda tempest-CreateVolumesFromSnapshotTest-1687039053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:55 devstack sudo[99822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:49:55 devstack sudo[99822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:55 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-30b3c0b5-b829-47ac-b240-6158cc93eb0b tempest-CreateVolumesFromSnapshotTest-1687039053 None] Acquiring lock "cinder-fb1cc7e4-de10-44be-a1e6-6ebad2305d3a-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:49:55 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-30b3c0b5-b829-47ac-b240-6158cc93eb0b tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "cinder-fb1cc7e4-de10-44be-a1e6-6ebad2305d3a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:49:55 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-30b3c0b5-b829-47ac-b240-6158cc93eb0b tempest-CreateVolumesFromSnapshotTest-1687039053 None] Acquiring lock "cinder-quobyte-fb1cc7e4-de10-44be-a1e6-6ebad2305d3a" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:49:55 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-30b3c0b5-b829-47ac-b240-6158cc93eb0b tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "cinder-quobyte-fb1cc7e4-de10-44be-a1e6-6ebad2305d3a" acquired by "delete_volume" :: waited 0.018s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:49:55 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[591ea1c2-caa2-495a-a3c5-07b014942d6c]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:49:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-30b3c0b5-b829-47ac-b240-6158cc93eb0b tempest-CreateVolumesFromSnapshotTest-1687039053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fb1cc7e4-de10-44be-a1e6-6ebad2305d3a {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:55 devstack sudo[99824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fb1cc7e4-de10-44be-a1e6-6ebad2305d3a
Jul 10 12:49:55 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:56 devstack sudo[99820]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-44ac91ee-518e-4812-9e54-eb97e8d4acfe tempest-GroupSnapshotsV319Test-94398658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85.df9cf0dd-b2ec-4b63-a517-27022a9aa525" returned: 0 in 0.993s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:56 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-44ac91ee-518e-4812-9e54-eb97e8d4acfe tempest-GroupSnapshotsV319Test-94398658 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:49:56 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[02279667-d8a4-4372-bbd7-4f54fd0470cc]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:49:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-44ac91ee-518e-4812-9e54-eb97e8d4acfe tempest-GroupSnapshotsV319Test-94398658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:56 devstack sudo[99822]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e5ba383e-a3ac-4c79-994d-9c9618bb8bda tempest-CreateVolumesFromSnapshotTest-1687039053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.888s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:56 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-e5ba383e-a3ac-4c79-994d-9c9618bb8bda tempest-CreateVolumesFromSnapshotTest-1687039053 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:49:56 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-e5ba383e-a3ac-4c79-994d-9c9618bb8bda tempest-CreateVolumesFromSnapshotTest-1687039053 None] Deleted volume successfully.
Jul 10 12:49:56 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e5ba383e-a3ac-4c79-994d-9c9618bb8bda tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "cinder-e358bdb7-d257-4c4e-8985-698d601c2305-delete_volume" released by "delete_volume" :: held 2.964s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:49:56 devstack sudo[99830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85
Jul 10 12:49:56 devstack sudo[99830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:56 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:49:56 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] Flow 'volume_create_manager' (5ab3a4d8-6597-4ee5-988f-0a85cb383bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:49:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2fb9e09-c58c-4c20-bd6f-fb63541a1ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-30b3c0b5-b829-47ac-b240-6158cc93eb0b tempest-CreateVolumesFromSnapshotTest-1687039053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fb1cc7e4-de10-44be-a1e6-6ebad2305d3a" returned: 0 in 0.979s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-30b3c0b5-b829-47ac-b240-6158cc93eb0b tempest-CreateVolumesFromSnapshotTest-1687039053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fb1cc7e4-de10-44be-a1e6-6ebad2305d3a {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:56 devstack sudo[99836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fb1cc7e4-de10-44be-a1e6-6ebad2305d3a
Jul 10 12:49:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2fb9e09-c58c-4c20-bd6f-fb63541a1ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:49:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1094352085',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36d5e427-f4f8-4810-91a3-2af748fe4505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ae27bc66f6f4210b877b85ee358565d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:49:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:49:57Z,use_quota=True,user_id='2505f63fbdc442cf864e7e7cba8a0c9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:56 devstack sudo[99836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84b041cb-bceb-4f5f-ad69-e759ee42997b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84b041cb-bceb-4f5f-ad69-e759ee42997b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b6f7365-ffa3-47c7-a0b1-79952c4efcda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:56 devstack cinder-volume[87378]: DEBUG cinder.image.glance [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] Creating Keystone auth plugin from conf {{(pid=87378) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 10 12:49:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b6f7365-ffa3-47c7-a0b1-79952c4efcda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '36d5e427-f4f8-4810-91a3-2af748fe4505', 'volume_name': 'volume-36d5e427-f4f8-4810-91a3-2af748fe4505', 'volume_size': 1, 'image_id': 'c73e431b-92e2-4ca0-8142-903361296a8f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c73e431b-92e2-4ca0-8142-903361296a8f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ea129ca6c904ec8b3827a458726b692', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c73e431b-92e2-4ca0-8142-903361296a8f', 'created_at': datetime.datetime(2026, 7, 10, 10, 26, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 10, 26, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c73e431b-92e2-4ca0-8142-903361296a8f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74a0abb9c560>}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce24b35b-19b0-4cb2-be5f-653d8cb7c61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:57 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce24b35b-19b0-4cb2-be5f-653d8cb7c61c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:49:57 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1402afb8-59ad-4669-a25e-ede70ade56e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:49:57 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] Volume 36d5e427-f4f8-4810-91a3-2af748fe4505: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-36d5e427-f4f8-4810-91a3-2af748fe4505', 'volume_size': 1, 'image_id': 'c73e431b-92e2-4ca0-8142-903361296a8f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c73e431b-92e2-4ca0-8142-903361296a8f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ea129ca6c904ec8b3827a458726b692', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c73e431b-92e2-4ca0-8142-903361296a8f', 'created_at': datetime.datetime(2026, 7, 10, 10, 26, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 10, 26, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c73e431b-92e2-4ca0-8142-903361296a8f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74a0abb9c560>}
Jul 10 12:49:57 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] Trying to clone 36d5e427-f4f8-4810-91a3-2af748fe4505 from image c73e431b-92e2-4ca0-8142-903361296a8f at location (None, [{'url': 'file:///opt/stack/data/glance/images/c73e431b-92e2-4ca0-8142-903361296a8f', 'metadata': {}}]). {{(pid=87378) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 10 12:49:57 devstack sudo[99830]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-44ac91ee-518e-4812-9e54-eb97e8d4acfe tempest-GroupSnapshotsV319Test-94398658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85" returned: 0 in 0.864s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-44ac91ee-518e-4812-9e54-eb97e8d4acfe tempest-GroupSnapshotsV319Test-94398658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85.df9cf0dd-b2ec-4b63-a517-27022a9aa525 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:57 devstack sudo[99841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85.df9cf0dd-b2ec-4b63-a517-27022a9aa525
Jul 10 12:49:57 devstack sudo[99841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:57 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_1ykpoexjdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87378) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 10 12:49:57 devstack cinder-volume[87378]: INFO cinder.image.image_utils [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] Image download 20.69 MB at 20.69 MB/s
Jul 10 12:49:57 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[26630ff8-119b-4163-98ad-c0885b5dfc39]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:49:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_1ykpoexjdevstack@QuobyteHD {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:57 devstack sudo[99836]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-30b3c0b5-b829-47ac-b240-6158cc93eb0b tempest-CreateVolumesFromSnapshotTest-1687039053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fb1cc7e4-de10-44be-a1e6-6ebad2305d3a" returned: 0 in 0.743s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:57 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-30b3c0b5-b829-47ac-b240-6158cc93eb0b tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "cinder-quobyte-fb1cc7e4-de10-44be-a1e6-6ebad2305d3a" released by "delete_volume" :: held 1.781s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:49:57 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-30b3c0b5-b829-47ac-b240-6158cc93eb0b tempest-CreateVolumesFromSnapshotTest-1687039053 None] Created reservations ['64416785-16e0-4f95-824d-f1c0c6b836b0', '56cf4e65-be3b-41a5-98e7-72b6a5420ac2', '5f58e478-baeb-4e62-b559-24cf5279e80c', 'e4308d84-2c3e-4521-8c27-e38bfc58ca7d'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:49:57 devstack sudo[99845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_1ykpoexjdevstack@QuobyteHD
Jul 10 12:49:57 devstack sudo[99845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-30b3c0b5-b829-47ac-b240-6158cc93eb0b tempest-CreateVolumesFromSnapshotTest-1687039053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:49:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-30b3c0b5-b829-47ac-b240-6158cc93eb0b tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:57 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-30b3c0b5-b829-47ac-b240-6158cc93eb0b tempest-CreateVolumesFromSnapshotTest-1687039053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:49:57 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-30b3c0b5-b829-47ac-b240-6158cc93eb0b tempest-CreateVolumesFromSnapshotTest-1687039053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:49:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-30b3c0b5-b829-47ac-b240-6158cc93eb0b tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-30b3c0b5-b829-47ac-b240-6158cc93eb0b tempest-CreateVolumesFromSnapshotTest-1687039053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:57 devstack sudo[99847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:49:57 devstack sudo[99847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:57 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-460d8d95-a681-4975-9f92-cb5d7c6e3df5 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Acquiring lock "cinder-78215143-e1ea-4e15-8575-866d7ecc7c0d-delete_snapshot" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:49:57 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-460d8d95-a681-4975-9f92-cb5d7c6e3df5 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "cinder-78215143-e1ea-4e15-8575-866d7ecc7c0d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:49:57 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-460d8d95-a681-4975-9f92-cb5d7c6e3df5 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Acquiring lock "cinder-quobyte-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:49:57 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-460d8d95-a681-4975-9f92-cb5d7c6e3df5 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "cinder-quobyte-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:49:57 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-460d8d95-a681-4975-9f92-cb5d7c6e3df5 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Acquiring lock "cinder-quobyte-78215143-e1ea-4e15-8575-866d7ecc7c0d" by "_delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:49:57 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-460d8d95-a681-4975-9f92-cb5d7c6e3df5 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "cinder-quobyte-78215143-e1ea-4e15-8575-866d7ecc7c0d" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:49:57 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-460d8d95-a681-4975-9f92-cb5d7c6e3df5 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Deleting offline snapshot 78215143-e1ea-4e15-8575-866d7ecc7c0d of volume 0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 10 12:49:57 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-460d8d95-a681-4975-9f92-cb5d7c6e3df5 tempest-CreateVolumesFromSnapshotTest-1687039053 None] snapshot_file for this snap is: volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760.78215143-e1ea-4e15-8575-866d7ecc7c0d {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 10 12:49:58 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[1220e2ee-dad8-4977-a294-823107ffa7a8]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:49:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-460d8d95-a681-4975-9f92-cb5d7c6e3df5 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760.78215143-e1ea-4e15-8575-866d7ecc7c0d {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:58 devstack sudo[99841]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-44ac91ee-518e-4812-9e54-eb97e8d4acfe tempest-GroupSnapshotsV319Test-94398658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85.df9cf0dd-b2ec-4b63-a517-27022a9aa525" returned: 0 in 1.021s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-44ac91ee-518e-4812-9e54-eb97e8d4acfe tempest-GroupSnapshotsV319Test-94398658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85.df9cf0dd-b2ec-4b63-a517-27022a9aa525 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:58 devstack sudo[99853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85.df9cf0dd-b2ec-4b63-a517-27022a9aa525
Jul 10 12:49:58 devstack sudo[99853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:58 devstack sudo[99852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760.78215143-e1ea-4e15-8575-866d7ecc7c0d
Jul 10 12:49:58 devstack sudo[99852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:58 devstack sudo[99845]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_1ykpoexjdevstack@QuobyteHD" returned: 0 in 0.855s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:58 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] Temporary image c73e431b-92e2-4ca0-8142-903361296a8f is fetched for user 2505f63fbdc442cf864e7e7cba8a0c9e. {{(pid=87378) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 10 12:49:58 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b594d8-0685-47c3-b5f7-4d015732f74d]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:49:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_1ykpoexjdevstack@QuobyteHD {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:58 devstack sudo[99847]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-30b3c0b5-b829-47ac-b240-6158cc93eb0b tempest-CreateVolumesFromSnapshotTest-1687039053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.757s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:58 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-30b3c0b5-b829-47ac-b240-6158cc93eb0b tempest-CreateVolumesFromSnapshotTest-1687039053 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:49:58 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-30b3c0b5-b829-47ac-b240-6158cc93eb0b tempest-CreateVolumesFromSnapshotTest-1687039053 None] Deleted volume successfully.
Jul 10 12:49:58 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-30b3c0b5-b829-47ac-b240-6158cc93eb0b tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "cinder-fb1cc7e4-de10-44be-a1e6-6ebad2305d3a-delete_volume" released by "delete_volume" :: held 2.776s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:49:58 devstack sudo[99860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_1ykpoexjdevstack@QuobyteHD
Jul 10 12:49:58 devstack sudo[99860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:58 devstack sudo[99853]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-44ac91ee-518e-4812-9e54-eb97e8d4acfe tempest-GroupSnapshotsV319Test-94398658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85.df9cf0dd-b2ec-4b63-a517-27022a9aa525" returned: 0 in 0.698s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:58 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-44ac91ee-518e-4812-9e54-eb97e8d4acfe tempest-GroupSnapshotsV319Test-94398658 None] Lock "cinder-quobyte-df9cf0dd-b2ec-4b63-a517-27022a9aa525" released by "_delete_snapshot" :: held 3.712s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:49:58 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-44ac91ee-518e-4812-9e54-eb97e8d4acfe tempest-GroupSnapshotsV319Test-94398658 None] Lock "cinder-quobyte-a3b3c841-f6c9-485f-a666-f7de93ca4a85" released by "delete_snapshot" :: held 3.741s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:49:58 devstack cinder-volume[87378]: WARNING cinder.quota [None req-44ac91ee-518e-4812-9e54-eb97e8d4acfe tempest-GroupSnapshotsV319Test-94398658 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1418494728 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1418494728, it is now deprecated. Please use the default quota class for default quota.
Jul 10 12:49:58 devstack cinder-volume[87378]: WARNING cinder.quota [None req-44ac91ee-518e-4812-9e54-eb97e8d4acfe tempest-GroupSnapshotsV319Test-94398658 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1418494728 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1418494728, it is now deprecated. Please use the default quota class for default quota.
Jul 10 12:49:58 devstack sudo[99852]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-460d8d95-a681-4975-9f92-cb5d7c6e3df5 tempest-CreateVolumesFromSnapshotTest-1687039053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760.78215143-e1ea-4e15-8575-866d7ecc7c0d" returned: 0 in 0.891s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:58 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-460d8d95-a681-4975-9f92-cb5d7c6e3df5 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:49:58 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9967315-b62a-4957-9e5b-d3e0f9ddf5d3]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:49:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-460d8d95-a681-4975-9f92-cb5d7c6e3df5 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:58 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-44ac91ee-518e-4812-9e54-eb97e8d4acfe tempest-GroupSnapshotsV319Test-94398658 None] Created reservations ['939a32f8-7cc3-4734-abf6-875e8266497b', '29165dc3-77eb-4ff8-83ec-8ee61e1c1893', '79327633-cec1-4b55-b2a2-5da9d838c960', 'c92633a3-0a42-48c1-8f73-1096ff68de8e'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:49:59 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-44ac91ee-518e-4812-9e54-eb97e8d4acfe tempest-GroupSnapshotsV319Test-94398658 None] group_snapshot 6e2e59f5-20bc-429e-9d05-e3f02d34e654: deleted successfully
Jul 10 12:49:59 devstack sudo[99866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760
Jul 10 12:49:59 devstack sudo[99866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:59 devstack sudo[99860]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_1ykpoexjdevstack@QuobyteHD" returned: 0 in 0.815s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:49:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:59 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:49:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1094352085',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36d5e427-f4f8-4810-91a3-2af748fe4505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ae27bc66f6f4210b877b85ee358565d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:49:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:49:57Z,use_quota=True,user_id='2505f63fbdc442cf864e7e7cba8a0c9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:49:59 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] Creating volume 36d5e427-f4f8-4810-91a3-2af748fe4505 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:49:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:49:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:49:59 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:49:59 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:49:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:49:59 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:49:59 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:49:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-36d5e427-f4f8-4810-91a3-2af748fe4505 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:59 devstack sudo[99874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-36d5e427-f4f8-4810-91a3-2af748fe4505 1073741824
Jul 10 12:49:59 devstack sudo[99874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:59 devstack sudo[99866]: pam_unix(sudo:session): session closed for user root
Jul 10 12:49:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-460d8d95-a681-4975-9f92-cb5d7c6e3df5 tempest-CreateVolumesFromSnapshotTest-1687039053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760" returned: 0 in 0.831s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:49:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-460d8d95-a681-4975-9f92-cb5d7c6e3df5 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760.78215143-e1ea-4e15-8575-866d7ecc7c0d {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:49:59 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3bb6059a-6ba2-46eb-bb71-de7dfd864f10 tempest-GroupSnapshotsV319Test-94398658 None] Acquiring lock "cinder-quobyte-a3b3c841-f6c9-485f-a666-f7de93ca4a85" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:49:59 devstack sudo[99882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760.78215143-e1ea-4e15-8575-866d7ecc7c0d
Jul 10 12:49:59 devstack sudo[99882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:49:59 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3bb6059a-6ba2-46eb-bb71-de7dfd864f10 tempest-GroupSnapshotsV319Test-94398658 None] Lock "cinder-quobyte-a3b3c841-f6c9-485f-a666-f7de93ca4a85" acquired by "delete_volume" :: waited 0.027s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:49:59 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[510c4c85-96c6-484f-97af-379083699607]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:49:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3bb6059a-6ba2-46eb-bb71-de7dfd864f10 tempest-GroupSnapshotsV319Test-94398658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:00 devstack sudo[99885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85
Jul 10 12:50:00 devstack sudo[99885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:00 devstack sudo[99874]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-36d5e427-f4f8-4810-91a3-2af748fe4505 1073741824" returned: 0 in 0.942s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-36d5e427-f4f8-4810-91a3-2af748fe4505 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:00 devstack sudo[99888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-36d5e427-f4f8-4810-91a3-2af748fe4505
Jul 10 12:50:00 devstack sudo[99888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:00 devstack sudo[99882]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-460d8d95-a681-4975-9f92-cb5d7c6e3df5 tempest-CreateVolumesFromSnapshotTest-1687039053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760.78215143-e1ea-4e15-8575-866d7ecc7c0d" returned: 0 in 0.789s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-460d8d95-a681-4975-9f92-cb5d7c6e3df5 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760.78215143-e1ea-4e15-8575-866d7ecc7c0d {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:00 devstack sudo[99896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760.78215143-e1ea-4e15-8575-866d7ecc7c0d
Jul 10 12:50:00 devstack sudo[99896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:00 devstack sudo[99885]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3bb6059a-6ba2-46eb-bb71-de7dfd864f10 tempest-GroupSnapshotsV319Test-94398658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85" returned: 0 in 0.835s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3bb6059a-6ba2-46eb-bb71-de7dfd864f10 tempest-GroupSnapshotsV319Test-94398658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:00 devstack sudo[99899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85
Jul 10 12:50:00 devstack sudo[99899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:00 devstack sudo[99888]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-36d5e427-f4f8-4810-91a3-2af748fe4505" returned: 0 in 0.676s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:00 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] <== create_volume: return (1664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:50:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.668s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:50:00 devstack cinder-volume[87378]: DEBUG cinder.volume.volume_utils [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] Attempting download of c73e431b-92e2-4ca0-8142-903361296a8f ((None, [{'url': 'file:///opt/stack/data/glance/images/c73e431b-92e2-4ca0-8142-903361296a8f', 'metadata': {}}])) to volume 36d5e427-f4f8-4810-91a3-2af748fe4505. {{(pid=87378) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 10 12:50:00 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1e1c72-b6a6-4c9b-841d-5f102c1270b7]: (4, 'raw') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:50:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c73e431b-92e2-4ca0-8142-903361296a8f_57ycvhlj {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:01 devstack sudo[99901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c73e431b-92e2-4ca0-8142-903361296a8f_57ycvhlj
Jul 10 12:50:01 devstack sudo[99901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:01 devstack sudo[99896]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-460d8d95-a681-4975-9f92-cb5d7c6e3df5 tempest-CreateVolumesFromSnapshotTest-1687039053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760.78215143-e1ea-4e15-8575-866d7ecc7c0d" returned: 0 in 0.719s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:01 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-460d8d95-a681-4975-9f92-cb5d7c6e3df5 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "cinder-quobyte-78215143-e1ea-4e15-8575-866d7ecc7c0d" released by "_delete_snapshot" :: held 3.354s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:50:01 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-460d8d95-a681-4975-9f92-cb5d7c6e3df5 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "cinder-quobyte-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760" released by "delete_snapshot" :: held 3.388s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:50:01 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-460d8d95-a681-4975-9f92-cb5d7c6e3df5 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Created reservations ['883f3fb4-ab30-44b6-ab2a-1144cef18d40', '2b3c5c6d-4b07-4af4-8370-572e00811474', '6d7bf2de-744c-4b87-8b25-9722b65f44be', '99bcbed6-8ddc-4117-8619-bb71b4d47181'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:50:01 devstack sudo[99899]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3bb6059a-6ba2-46eb-bb71-de7dfd864f10 tempest-GroupSnapshotsV319Test-94398658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-a3b3c841-f6c9-485f-a666-f7de93ca4a85" returned: 0 in 0.693s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:01 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3bb6059a-6ba2-46eb-bb71-de7dfd864f10 tempest-GroupSnapshotsV319Test-94398658 None] Lock "cinder-quobyte-a3b3c841-f6c9-485f-a666-f7de93ca4a85" released by "delete_volume" :: held 1.601s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:50:01 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-460d8d95-a681-4975-9f92-cb5d7c6e3df5 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Delete snapshot completed successfully.
Jul 10 12:50:01 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-460d8d95-a681-4975-9f92-cb5d7c6e3df5 tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "cinder-78215143-e1ea-4e15-8575-866d7ecc7c0d-delete_snapshot" released by "delete_snapshot" :: held 3.572s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:50:01 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-3bb6059a-6ba2-46eb-bb71-de7dfd864f10 tempest-GroupSnapshotsV319Test-94398658 None] Created reservations ['91a09329-9bdd-41f0-a81a-e8df54b7946f'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:50:01 devstack cinder-volume[87378]: WARNING cinder.quota [None req-3bb6059a-6ba2-46eb-bb71-de7dfd864f10 tempest-GroupSnapshotsV319Test-94398658 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1418494728 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1418494728, it is now deprecated. Please use the default quota class for default quota.
Jul 10 12:50:01 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-3bb6059a-6ba2-46eb-bb71-de7dfd864f10 tempest-GroupSnapshotsV319Test-94398658 None] Created reservations ['4483f112-9faf-4432-86e9-c294959e9db9', '3a4bc864-6783-4e1f-bbab-35057d968518', '963295bd-5931-45e7-ba37-4df4cd33944b', '0c1fdb4c-1c10-49e6-8d0c-410540231748'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:50:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3bb6059a-6ba2-46eb-bb71-de7dfd864f10 tempest-GroupSnapshotsV319Test-94398658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:50:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3bb6059a-6ba2-46eb-bb71-de7dfd864f10 tempest-GroupSnapshotsV319Test-94398658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:50:01 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3bb6059a-6ba2-46eb-bb71-de7dfd864f10 tempest-GroupSnapshotsV319Test-94398658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:50:01 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3bb6059a-6ba2-46eb-bb71-de7dfd864f10 tempest-GroupSnapshotsV319Test-94398658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:50:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3bb6059a-6ba2-46eb-bb71-de7dfd864f10 tempest-GroupSnapshotsV319Test-94398658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:50:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3bb6059a-6ba2-46eb-bb71-de7dfd864f10 tempest-GroupSnapshotsV319Test-94398658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:01 devstack sudo[99907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:50:01 devstack sudo[99907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:01 devstack sudo[99901]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c73e431b-92e2-4ca0-8142-903361296a8f_57ycvhlj" returned: 0 in 0.826s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c73e431b-92e2-4ca0-8142-903361296a8f_57ycvhlj {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:01 devstack sudo[99909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c73e431b-92e2-4ca0-8142-903361296a8f_57ycvhlj
Jul 10 12:50:01 devstack sudo[99909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:02 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-91e0ce37-1a0c-4057-965f-e767f7cb237e tempest-CreateVolumesFromSnapshotTest-1687039053 None] Acquiring lock "cinder-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:50:02 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-91e0ce37-1a0c-4057-965f-e767f7cb237e tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "cinder-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:50:02 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-91e0ce37-1a0c-4057-965f-e767f7cb237e tempest-CreateVolumesFromSnapshotTest-1687039053 None] Acquiring lock "cinder-quobyte-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:50:02 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-91e0ce37-1a0c-4057-965f-e767f7cb237e tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "cinder-quobyte-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760" acquired by "delete_volume" :: waited 0.017s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:50:02 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[2411ce1e-746d-4b7d-ba25-b5e670652675]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:50:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-91e0ce37-1a0c-4057-965f-e767f7cb237e tempest-CreateVolumesFromSnapshotTest-1687039053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:02 devstack sudo[99907]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3bb6059a-6ba2-46eb-bb71-de7dfd864f10 tempest-GroupSnapshotsV319Test-94398658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.767s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:02 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-3bb6059a-6ba2-46eb-bb71-de7dfd864f10 tempest-GroupSnapshotsV319Test-94398658 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:50:02 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-3bb6059a-6ba2-46eb-bb71-de7dfd864f10 tempest-GroupSnapshotsV319Test-94398658 None] Delete group completed successfully.
Jul 10 12:50:02 devstack sudo[99912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760
Jul 10 12:50:02 devstack sudo[99912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:02 devstack sudo[99909]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c73e431b-92e2-4ca0-8142-903361296a8f_57ycvhlj" returned: 1 in 0.855s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c73e431b-92e2-4ca0-8142-903361296a8f_57ycvhlj' failed. Not Retrying. {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 10 12:50:02 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe49565-bf29-49ff-aa5c-061674b83815]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:50:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_1ykpoexjdevstack@QuobyteHD {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:02 devstack sudo[99916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_1ykpoexjdevstack@QuobyteHD
Jul 10 12:50:02 devstack sudo[99916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:03 devstack sudo[99912]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-91e0ce37-1a0c-4057-965f-e767f7cb237e tempest-CreateVolumesFromSnapshotTest-1687039053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760" returned: 0 in 0.869s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-91e0ce37-1a0c-4057-965f-e767f7cb237e tempest-CreateVolumesFromSnapshotTest-1687039053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:03 devstack sudo[99923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760
Jul 10 12:50:03 devstack sudo[99923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:03 devstack sudo[99916]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_1ykpoexjdevstack@QuobyteHD" returned: 0 in 0.824s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:03 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] c73e431b-92e2-4ca0-8142-903361296a8f was qcow2, converting to raw {{(pid=87378) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 10 12:50:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_1ykpoexjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-36d5e427-f4f8-4810-91a3-2af748fe4505 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:03 devstack sudo[99928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_1ykpoexjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-36d5e427-f4f8-4810-91a3-2af748fe4505
Jul 10 12:50:03 devstack sudo[99928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:03 devstack sudo[99923]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-91e0ce37-1a0c-4057-965f-e767f7cb237e tempest-CreateVolumesFromSnapshotTest-1687039053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760" returned: 0 in 0.741s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:04 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-91e0ce37-1a0c-4057-965f-e767f7cb237e tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "cinder-quobyte-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760" released by "delete_volume" :: held 1.713s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:50:04 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-91e0ce37-1a0c-4057-965f-e767f7cb237e tempest-CreateVolumesFromSnapshotTest-1687039053 None] Created reservations ['98068afa-e2a7-4614-a99e-20024f796128', '1358fb9e-4e53-42ec-9bb9-23c77eaf2542', '287a6c4e-6a6a-45f0-a81d-bccf3ffc7325', '515c327e-72a5-4594-9780-936bf3bd2c34'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:50:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-91e0ce37-1a0c-4057-965f-e767f7cb237e tempest-CreateVolumesFromSnapshotTest-1687039053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:50:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-91e0ce37-1a0c-4057-965f-e767f7cb237e tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:50:04 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-91e0ce37-1a0c-4057-965f-e767f7cb237e tempest-CreateVolumesFromSnapshotTest-1687039053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:50:04 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-91e0ce37-1a0c-4057-965f-e767f7cb237e tempest-CreateVolumesFromSnapshotTest-1687039053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:50:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-91e0ce37-1a0c-4057-965f-e767f7cb237e tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:50:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-91e0ce37-1a0c-4057-965f-e767f7cb237e tempest-CreateVolumesFromSnapshotTest-1687039053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:04 devstack sudo[99934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:50:04 devstack sudo[99934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:05 devstack sudo[99934]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-91e0ce37-1a0c-4057-965f-e767f7cb237e tempest-CreateVolumesFromSnapshotTest-1687039053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.867s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:05 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-91e0ce37-1a0c-4057-965f-e767f7cb237e tempest-CreateVolumesFromSnapshotTest-1687039053 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:50:05 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-91e0ce37-1a0c-4057-965f-e767f7cb237e tempest-CreateVolumesFromSnapshotTest-1687039053 None] Deleted volume successfully.
Jul 10 12:50:05 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-91e0ce37-1a0c-4057-965f-e767f7cb237e tempest-CreateVolumesFromSnapshotTest-1687039053 None] Lock "cinder-0bfeb31a-4ac1-4cb2-8b9b-1dfd6f5c8760-delete_volume" released by "delete_volume" :: held 2.855s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:50:05 devstack sudo[99928]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_1ykpoexjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-36d5e427-f4f8-4810-91a3-2af748fe4505" returned: 0 in 2.456s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:05 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_1ykpoexjdevstack@QuobyteHD, size 112.00 MB, duration 2.46 sec, destination /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-36d5e427-f4f8-4810-91a3-2af748fe4505 {{(pid=87378) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 10 12:50:05 devstack cinder-volume[87378]: INFO cinder.image.image_utils [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] Converted 112.00 MB image at 45.59 MB/s
Jul 10 12:50:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-36d5e427-f4f8-4810-91a3-2af748fe4505 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:05 devstack sudo[99942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-36d5e427-f4f8-4810-91a3-2af748fe4505 1G
Jul 10 12:50:05 devstack sudo[99942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:06 devstack sudo[99942]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-36d5e427-f4f8-4810-91a3-2af748fe4505 1G" returned: 0 in 0.759s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:06 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ccda839-8b9a-4afe-a0ea-151b60233028]: (4, 'raw') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:50:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-36d5e427-f4f8-4810-91a3-2af748fe4505 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:06 devstack sudo[99947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-36d5e427-f4f8-4810-91a3-2af748fe4505
Jul 10 12:50:06 devstack sudo[99947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:07 devstack sudo[99947]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-36d5e427-f4f8-4810-91a3-2af748fe4505" returned: 0 in 0.808s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-36d5e427-f4f8-4810-91a3-2af748fe4505 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:07 devstack sudo[99951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-36d5e427-f4f8-4810-91a3-2af748fe4505
Jul 10 12:50:07 devstack sudo[99951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:08 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f4825e4-145b-4e33-b1ec-930a18e1c8fe tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:50:08 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9f4825e4-145b-4e33-b1ec-930a18e1c8fe tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Flow 'volume_create_manager' (139e2bfc-195e-4c57-80c3-4e6e6d07e459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:50:08 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9f4825e4-145b-4e33-b1ec-930a18e1c8fe tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dae258e-d277-4f10-954a-4945c9ce2a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:08 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9f4825e4-145b-4e33-b1ec-930a18e1c8fe tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dae258e-d277-4f10-954a-4945c9ce2a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:50:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1351624878',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa65cb37-36c4-456a-8b0a-ebe29d607b09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17be70b6ecde468abbc0fe96f21fe624',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:50:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:50:08Z,use_quota=True,user_id='b751c1898d4d45ce82357a3608cbc2de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:08 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9f4825e4-145b-4e33-b1ec-930a18e1c8fe tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23a96e1e-1800-45fc-adc0-7eb98ea87de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:08 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9f4825e4-145b-4e33-b1ec-930a18e1c8fe tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23a96e1e-1800-45fc-adc0-7eb98ea87de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:08 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9f4825e4-145b-4e33-b1ec-930a18e1c8fe tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36768b50-71ff-4f6a-8a0d-2b5b7e2d2229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:08 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9f4825e4-145b-4e33-b1ec-930a18e1c8fe tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36768b50-71ff-4f6a-8a0d-2b5b7e2d2229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa65cb37-36c4-456a-8b0a-ebe29d607b09', 'volume_name': 'volume-fa65cb37-36c4-456a-8b0a-ebe29d607b09', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:08 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9f4825e4-145b-4e33-b1ec-930a18e1c8fe tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05885125-3ece-427a-8fe2-c7bbf2c40822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:08 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9f4825e4-145b-4e33-b1ec-930a18e1c8fe tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05885125-3ece-427a-8fe2-c7bbf2c40822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:08 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9f4825e4-145b-4e33-b1ec-930a18e1c8fe tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1392488-151c-4ac7-a78a-b2ccd17c4f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:08 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-9f4825e4-145b-4e33-b1ec-930a18e1c8fe tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Volume fa65cb37-36c4-456a-8b0a-ebe29d607b09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa65cb37-36c4-456a-8b0a-ebe29d607b09', 'volume_size': 1}
Jul 10 12:50:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-9f4825e4-145b-4e33-b1ec-930a18e1c8fe tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:50:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-9f4825e4-145b-4e33-b1ec-930a18e1c8fe tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:50:08 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-9f4825e4-145b-4e33-b1ec-930a18e1c8fe tempest-CreateVolumesFromSourceVolumeTest-425015976 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:50:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1351624878',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa65cb37-36c4-456a-8b0a-ebe29d607b09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17be70b6ecde468abbc0fe96f21fe624',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:50:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:50:08Z,use_quota=True,user_id='b751c1898d4d45ce82357a3608cbc2de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:50:08 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-9f4825e4-145b-4e33-b1ec-930a18e1c8fe tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Creating volume fa65cb37-36c4-456a-8b0a-ebe29d607b09 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:50:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-9f4825e4-145b-4e33-b1ec-930a18e1c8fe tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:50:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-9f4825e4-145b-4e33-b1ec-930a18e1c8fe tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:50:08 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-9f4825e4-145b-4e33-b1ec-930a18e1c8fe tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:50:08 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-9f4825e4-145b-4e33-b1ec-930a18e1c8fe tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:50:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-9f4825e4-145b-4e33-b1ec-930a18e1c8fe tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:50:08 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-9f4825e4-145b-4e33-b1ec-930a18e1c8fe tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:50:08 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-9f4825e4-145b-4e33-b1ec-930a18e1c8fe tempest-CreateVolumesFromSourceVolumeTest-425015976 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:50:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9f4825e4-145b-4e33-b1ec-930a18e1c8fe tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fa65cb37-36c4-456a-8b0a-ebe29d607b09 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:08 devstack sudo[99953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fa65cb37-36c4-456a-8b0a-ebe29d607b09 1073741824
Jul 10 12:50:08 devstack sudo[99953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:08 devstack sudo[99951]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-36d5e427-f4f8-4810-91a3-2af748fe4505" returned: 1 in 0.834s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-36d5e427-f4f8-4810-91a3-2af748fe4505' failed. Not Retrying. {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 10 12:50:08 devstack cinder-volume[87378]: DEBUG cinder.volume.volume_utils [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] Downloaded image c73e431b-92e2-4ca0-8142-903361296a8f ((None, [{'url': 'file:///opt/stack/data/glance/images/c73e431b-92e2-4ca0-8142-903361296a8f', 'metadata': {}}])) to volume 36d5e427-f4f8-4810-91a3-2af748fe4505 successfully. {{(pid=87378) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 10 12:50:08 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] Temporary image c73e431b-92e2-4ca0-8142-903361296a8f for user 2505f63fbdc442cf864e7e7cba8a0c9e is deleted. {{(pid=87378) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 10 12:50:08 devstack cinder-volume[87378]: DEBUG cinder.volume.volume_utils [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] Marking volume 36d5e427-f4f8-4810-91a3-2af748fe4505 as bootable. {{(pid=87378) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 10 12:50:08 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] Copying metadata from image c73e431b-92e2-4ca0-8142-903361296a8f to 36d5e427-f4f8-4810-91a3-2af748fe4505. {{(pid=87378) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 10 12:50:08 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] Creating volume glance metadata for volume 36d5e427-f4f8-4810-91a3-2af748fe4505 backed by image c73e431b-92e2-4ca0-8142-903361296a8f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c73e431b-92e2-4ca0-8142-903361296a8f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87378) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 10 12:50:08 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1402afb8-59ad-4669-a25e-ede70ade56e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36d5e427-f4f8-4810-91a3-2af748fe4505', 'volume_size': 1, 'image_id': 'c73e431b-92e2-4ca0-8142-903361296a8f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c73e431b-92e2-4ca0-8142-903361296a8f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ea129ca6c904ec8b3827a458726b692', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c73e431b-92e2-4ca0-8142-903361296a8f', 'created_at': datetime.datetime(2026, 7, 10, 10, 26, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 10, 26, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c73e431b-92e2-4ca0-8142-903361296a8f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74a0abb9c560>}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:08 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db24f708-4367-4adb-b1f7-95b613b517c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:08 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] Volume volume-36d5e427-f4f8-4810-91a3-2af748fe4505 (36d5e427-f4f8-4810-91a3-2af748fe4505): created successfully
Jul 10 12:50:08 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db24f708-4367-4adb-b1f7-95b613b517c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:08 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] Flow 'volume_create_manager' (5ab3a4d8-6597-4ee5-988f-0a85cb383bb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:50:08 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-21ea6705-7f6c-4ee3-9712-b0830383a274 tempest-VolumesExtendTest-1635708943 None] Created volume successfully.
Jul 10 12:50:09 devstack sudo[99953]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9f4825e4-145b-4e33-b1ec-930a18e1c8fe tempest-CreateVolumesFromSourceVolumeTest-425015976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fa65cb37-36c4-456a-8b0a-ebe29d607b09 1073741824" returned: 0 in 0.929s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9f4825e4-145b-4e33-b1ec-930a18e1c8fe tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fa65cb37-36c4-456a-8b0a-ebe29d607b09 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:09 devstack sudo[99962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fa65cb37-36c4-456a-8b0a-ebe29d607b09
Jul 10 12:50:09 devstack sudo[99962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-77d35032-0de5-4a6d-8292-82861035196c tempest-VolumesExtendTest-1635708943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:50:09 devstack sudo[99962]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9f4825e4-145b-4e33-b1ec-930a18e1c8fe tempest-CreateVolumesFromSourceVolumeTest-425015976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fa65cb37-36c4-456a-8b0a-ebe29d607b09" returned: 0 in 0.722s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:09 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-9f4825e4-145b-4e33-b1ec-930a18e1c8fe tempest-CreateVolumesFromSourceVolumeTest-425015976 None] <== create_volume: return (1695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:50:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-9f4825e4-145b-4e33-b1ec-930a18e1c8fe tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.697s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:50:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-77d35032-0de5-4a6d-8292-82861035196c tempest-VolumesExtendTest-1635708943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.161s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:50:09 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9f4825e4-145b-4e33-b1ec-930a18e1c8fe tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1392488-151c-4ac7-a78a-b2ccd17c4f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa65cb37-36c4-456a-8b0a-ebe29d607b09', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:09 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9f4825e4-145b-4e33-b1ec-930a18e1c8fe tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (468a4f3b-7ac7-4d04-ab72-ab6fe3b7da1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:09 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ffb76d4-5848-4d95-b153-058a8a875e8c]: (4, 'raw') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:50:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-77d35032-0de5-4a6d-8292-82861035196c tempest-VolumesExtendTest-1635708943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-36d5e427-f4f8-4810-91a3-2af748fe4505 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:09 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-9f4825e4-145b-4e33-b1ec-930a18e1c8fe tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Volume volume-fa65cb37-36c4-456a-8b0a-ebe29d607b09 (fa65cb37-36c4-456a-8b0a-ebe29d607b09): created successfully
Jul 10 12:50:09 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9f4825e4-145b-4e33-b1ec-930a18e1c8fe tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (468a4f3b-7ac7-4d04-ab72-ab6fe3b7da1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:09 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9f4825e4-145b-4e33-b1ec-930a18e1c8fe tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Flow 'volume_create_manager' (139e2bfc-195e-4c57-80c3-4e6e6d07e459) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:50:09 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-9f4825e4-145b-4e33-b1ec-930a18e1c8fe tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Created volume successfully.
Jul 10 12:50:10 devstack sudo[99965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-36d5e427-f4f8-4810-91a3-2af748fe4505
Jul 10 12:50:10 devstack sudo[99965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:10 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1dca7d8-4052-4e16-8976-fd3a2d5b0176 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:50:10 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d1dca7d8-4052-4e16-8976-fd3a2d5b0176 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Flow 'volume_create_manager' (78689d11-056f-4ea4-a604-9d460fa26f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:50:10 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d1dca7d8-4052-4e16-8976-fd3a2d5b0176 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12edd5fe-3ca1-458e-b7c2-f875fa745d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:10 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d1dca7d8-4052-4e16-8976-fd3a2d5b0176 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12edd5fe-3ca1-458e-b7c2-f875fa745d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:50:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-102041749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8109f74-d2a8-42ba-bb26-cde8bb604eae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17be70b6ecde468abbc0fe96f21fe624',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:50:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:50:11Z,use_quota=True,user_id='b751c1898d4d45ce82357a3608cbc2de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:10 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d1dca7d8-4052-4e16-8976-fd3a2d5b0176 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (428047a3-a07a-4b6c-acd9-290658cdd788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:10 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d1dca7d8-4052-4e16-8976-fd3a2d5b0176 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (428047a3-a07a-4b6c-acd9-290658cdd788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:10 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d1dca7d8-4052-4e16-8976-fd3a2d5b0176 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (652b5bbb-b798-4c84-a340-3ff5ae629944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:10 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d1dca7d8-4052-4e16-8976-fd3a2d5b0176 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (652b5bbb-b798-4c84-a340-3ff5ae629944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8109f74-d2a8-42ba-bb26-cde8bb604eae', 'volume_name': 'volume-d8109f74-d2a8-42ba-bb26-cde8bb604eae', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:10 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d1dca7d8-4052-4e16-8976-fd3a2d5b0176 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bad01c12-4196-49e5-a8eb-6f42b00de284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:10 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d1dca7d8-4052-4e16-8976-fd3a2d5b0176 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bad01c12-4196-49e5-a8eb-6f42b00de284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:10 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d1dca7d8-4052-4e16-8976-fd3a2d5b0176 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc20f303-3cfa-429b-922e-a2b04abdfac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:10 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-d1dca7d8-4052-4e16-8976-fd3a2d5b0176 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Volume d8109f74-d2a8-42ba-bb26-cde8bb604eae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8109f74-d2a8-42ba-bb26-cde8bb604eae', 'volume_size': 1}
Jul 10 12:50:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d1dca7d8-4052-4e16-8976-fd3a2d5b0176 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:50:10 devstack sudo[99965]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-77d35032-0de5-4a6d-8292-82861035196c tempest-VolumesExtendTest-1635708943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-36d5e427-f4f8-4810-91a3-2af748fe4505" returned: 0 in 0.996s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-77d35032-0de5-4a6d-8292-82861035196c tempest-VolumesExtendTest-1635708943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-36d5e427-f4f8-4810-91a3-2af748fe4505 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:11 devstack sudo[99969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-36d5e427-f4f8-4810-91a3-2af748fe4505
Jul 10 12:50:11 devstack sudo[99969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:11 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-35df4435-0b9d-4bc0-abcb-4ccec5774d46 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:50:11 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-35df4435-0b9d-4bc0-abcb-4ccec5774d46 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Flow 'volume_create_manager' (df5eee3e-45cf-48cb-bd40-d722f4def149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:50:11 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-35df4435-0b9d-4bc0-abcb-4ccec5774d46 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abe9073d-5ccc-4b2e-858e-f5d0d00e9afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:11 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-35df4435-0b9d-4bc0-abcb-4ccec5774d46 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abe9073d-5ccc-4b2e-858e-f5d0d00e9afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:50:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1250178946',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5d9022a-5116-48e5-959d-5058c348a974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17be70b6ecde468abbc0fe96f21fe624',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:50:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:50:11Z,use_quota=True,user_id='b751c1898d4d45ce82357a3608cbc2de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:11 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-35df4435-0b9d-4bc0-abcb-4ccec5774d46 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a3c50d3-ce52-493c-beeb-2ac70d7c9609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:11 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-35df4435-0b9d-4bc0-abcb-4ccec5774d46 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a3c50d3-ce52-493c-beeb-2ac70d7c9609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:11 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-35df4435-0b9d-4bc0-abcb-4ccec5774d46 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad43e2ee-0b9b-4a2b-aa4e-705a21647661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:11 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-35df4435-0b9d-4bc0-abcb-4ccec5774d46 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad43e2ee-0b9b-4a2b-aa4e-705a21647661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5d9022a-5116-48e5-959d-5058c348a974', 'volume_name': 'volume-e5d9022a-5116-48e5-959d-5058c348a974', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:11 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-35df4435-0b9d-4bc0-abcb-4ccec5774d46 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1de8b6f3-f1c8-4575-8d89-61731e6ad8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:11 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-35df4435-0b9d-4bc0-abcb-4ccec5774d46 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1de8b6f3-f1c8-4575-8d89-61731e6ad8c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:11 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-35df4435-0b9d-4bc0-abcb-4ccec5774d46 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74cedd96-ada0-4139-96b0-76f7fd62ce34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:11 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-35df4435-0b9d-4bc0-abcb-4ccec5774d46 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Volume e5d9022a-5116-48e5-959d-5058c348a974: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5d9022a-5116-48e5-959d-5058c348a974', 'volume_size': 1}
Jul 10 12:50:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-35df4435-0b9d-4bc0-abcb-4ccec5774d46 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:50:11 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dc3bf87-4756-42ef-9761-7d2f5fb6964b tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:50:11 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2dc3bf87-4756-42ef-9761-7d2f5fb6964b tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Flow 'volume_create_manager' (0d794625-9f2f-49f8-bc67-4c36ff2d866e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:50:11 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2dc3bf87-4756-42ef-9761-7d2f5fb6964b tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8428369e-4974-493c-b062-bc01b175ebf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:11 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2dc3bf87-4756-42ef-9761-7d2f5fb6964b tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8428369e-4974-493c-b062-bc01b175ebf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:50:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1019280525',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=770f31e8-9f64-46fa-bde3-bf0e6139387b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17be70b6ecde468abbc0fe96f21fe624',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:50:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:50:12Z,use_quota=True,user_id='b751c1898d4d45ce82357a3608cbc2de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:11 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2dc3bf87-4756-42ef-9761-7d2f5fb6964b tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2774cfbb-18f2-4dbc-93c0-648fb130eeb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:11 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2dc3bf87-4756-42ef-9761-7d2f5fb6964b tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2774cfbb-18f2-4dbc-93c0-648fb130eeb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:11 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2dc3bf87-4756-42ef-9761-7d2f5fb6964b tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6977f9e-bece-4f9a-8107-81e0ff8f5b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:11 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2dc3bf87-4756-42ef-9761-7d2f5fb6964b tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6977f9e-bece-4f9a-8107-81e0ff8f5b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '770f31e8-9f64-46fa-bde3-bf0e6139387b', 'volume_name': 'volume-770f31e8-9f64-46fa-bde3-bf0e6139387b', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:11 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2dc3bf87-4756-42ef-9761-7d2f5fb6964b tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d54d5429-af42-48b7-9ac6-95c2d96176ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:11 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2dc3bf87-4756-42ef-9761-7d2f5fb6964b tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d54d5429-af42-48b7-9ac6-95c2d96176ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:11 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2dc3bf87-4756-42ef-9761-7d2f5fb6964b tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ce10b20-7b8b-46bd-9a12-41726654b5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:11 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-2dc3bf87-4756-42ef-9761-7d2f5fb6964b tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Volume 770f31e8-9f64-46fa-bde3-bf0e6139387b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-770f31e8-9f64-46fa-bde3-bf0e6139387b', 'volume_size': 1}
Jul 10 12:50:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2dc3bf87-4756-42ef-9761-7d2f5fb6964b tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:50:11 devstack sudo[99969]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-77d35032-0de5-4a6d-8292-82861035196c tempest-VolumesExtendTest-1635708943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-36d5e427-f4f8-4810-91a3-2af748fe4505" returned: 1 in 0.926s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-77d35032-0de5-4a6d-8292-82861035196c tempest-VolumesExtendTest-1635708943 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-36d5e427-f4f8-4810-91a3-2af748fe4505' failed. Not Retrying. {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 10 12:50:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-77d35032-0de5-4a6d-8292-82861035196c tempest-VolumesExtendTest-1635708943 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-36d5e427-f4f8-4810-91a3-2af748fe4505 2G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-77d35032-0de5-4a6d-8292-82861035196c tempest-VolumesExtendTest-1635708943 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-36d5e427-f4f8-4810-91a3-2af748fe4505 2G" returned: 0 in 0.112s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-77d35032-0de5-4a6d-8292-82861035196c tempest-VolumesExtendTest-1635708943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.091s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:50:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d1dca7d8-4052-4e16-8976-fd3a2d5b0176 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.157s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:50:11 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-d1dca7d8-4052-4e16-8976-fd3a2d5b0176 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:50:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-102041749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8109f74-d2a8-42ba-bb26-cde8bb604eae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17be70b6ecde468abbc0fe96f21fe624',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:50:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:50:11Z,use_quota=True,user_id='b751c1898d4d45ce82357a3608cbc2de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:50:11 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-d1dca7d8-4052-4e16-8976-fd3a2d5b0176 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Creating volume d8109f74-d2a8-42ba-bb26-cde8bb604eae {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:50:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d1dca7d8-4052-4e16-8976-fd3a2d5b0176 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:50:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d1dca7d8-4052-4e16-8976-fd3a2d5b0176 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:50:11 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-d1dca7d8-4052-4e16-8976-fd3a2d5b0176 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:50:11 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-d1dca7d8-4052-4e16-8976-fd3a2d5b0176 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:50:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d1dca7d8-4052-4e16-8976-fd3a2d5b0176 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:50:11 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-d1dca7d8-4052-4e16-8976-fd3a2d5b0176 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:50:11 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-d1dca7d8-4052-4e16-8976-fd3a2d5b0176 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:50:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d1dca7d8-4052-4e16-8976-fd3a2d5b0176 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-d8109f74-d2a8-42ba-bb26-cde8bb604eae 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:12 devstack sudo[99977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-d8109f74-d2a8-42ba-bb26-cde8bb604eae 1073741824
Jul 10 12:50:12 devstack sudo[99977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:12 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eced083-fd3b-4c11-bb40-b7b2e032af41 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:50:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-8eced083-fd3b-4c11-bb40-b7b2e032af41 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Flow 'volume_create_manager' (ebbc3206-c0bb-465c-add0-e9b092c1e71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:50:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-8eced083-fd3b-4c11-bb40-b7b2e032af41 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9ab16e0-1c04-4e01-b649-2dbcd495ef2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-8eced083-fd3b-4c11-bb40-b7b2e032af41 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9ab16e0-1c04-4e01-b649-2dbcd495ef2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-607386466',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=392bfb59-feef-406f-b200-96debd337190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17be70b6ecde468abbc0fe96f21fe624',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:50:12Z,use_quota=True,user_id='b751c1898d4d45ce82357a3608cbc2de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-8eced083-fd3b-4c11-bb40-b7b2e032af41 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e87f98e-caf8-49cc-9010-bb25550bcf3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-8eced083-fd3b-4c11-bb40-b7b2e032af41 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e87f98e-caf8-49cc-9010-bb25550bcf3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-8eced083-fd3b-4c11-bb40-b7b2e032af41 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28fd4d2a-880e-4e33-b83d-65a5fe521671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-8eced083-fd3b-4c11-bb40-b7b2e032af41 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28fd4d2a-880e-4e33-b83d-65a5fe521671) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '392bfb59-feef-406f-b200-96debd337190', 'volume_name': 'volume-392bfb59-feef-406f-b200-96debd337190', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-8eced083-fd3b-4c11-bb40-b7b2e032af41 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2944e5f2-ae11-4a92-8bb7-507644bf5c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-8eced083-fd3b-4c11-bb40-b7b2e032af41 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2944e5f2-ae11-4a92-8bb7-507644bf5c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-8eced083-fd3b-4c11-bb40-b7b2e032af41 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a69f9f1c-2f68-4b02-be50-d3cf1aca6597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:12 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-8eced083-fd3b-4c11-bb40-b7b2e032af41 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Volume 392bfb59-feef-406f-b200-96debd337190: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-392bfb59-feef-406f-b200-96debd337190', 'volume_size': 1}
Jul 10 12:50:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-8eced083-fd3b-4c11-bb40-b7b2e032af41 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:50:12 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-77d35032-0de5-4a6d-8292-82861035196c tempest-VolumesExtendTest-1635708943 None] Extend volume completed successfully.
Jul 10 12:50:12 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-c353a88c-0fdb-4d15-9930-d926f3191f36 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:50:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c353a88c-0fdb-4d15-9930-d926f3191f36 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Flow 'volume_create_manager' (9a16e7c3-9d21-49ec-b483-00eebff3168d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:50:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c353a88c-0fdb-4d15-9930-d926f3191f36 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76dcfbb1-c210-4ecf-b4ca-c03d7d7ecc8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c353a88c-0fdb-4d15-9930-d926f3191f36 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76dcfbb1-c210-4ecf-b4ca-c03d7d7ecc8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2042502907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d180feb-143a-437d-a904-568cad0e3150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17be70b6ecde468abbc0fe96f21fe624',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:50:12Z,use_quota=True,user_id='b751c1898d4d45ce82357a3608cbc2de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c353a88c-0fdb-4d15-9930-d926f3191f36 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0b79fef-5e39-437c-84b7-10577d5e5c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c353a88c-0fdb-4d15-9930-d926f3191f36 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0b79fef-5e39-437c-84b7-10577d5e5c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c353a88c-0fdb-4d15-9930-d926f3191f36 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (764275ad-8515-4b27-9748-4131973fd20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c353a88c-0fdb-4d15-9930-d926f3191f36 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (764275ad-8515-4b27-9748-4131973fd20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d180feb-143a-437d-a904-568cad0e3150', 'volume_name': 'volume-2d180feb-143a-437d-a904-568cad0e3150', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c353a88c-0fdb-4d15-9930-d926f3191f36 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78cee408-f3b2-4730-b9b5-b0789cdb00de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c353a88c-0fdb-4d15-9930-d926f3191f36 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78cee408-f3b2-4730-b9b5-b0789cdb00de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c353a88c-0fdb-4d15-9930-d926f3191f36 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc35e6d9-20d3-4340-abd6-484173544b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:12 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-c353a88c-0fdb-4d15-9930-d926f3191f36 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Volume 2d180feb-143a-437d-a904-568cad0e3150: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d180feb-143a-437d-a904-568cad0e3150', 'volume_size': 1}
Jul 10 12:50:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c353a88c-0fdb-4d15-9930-d926f3191f36 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:50:12 devstack sudo[99977]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:12 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:50:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:50:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:50:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:50:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:50:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:50:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d1dca7d8-4052-4e16-8976-fd3a2d5b0176 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-d8109f74-d2a8-42ba-bb26-cde8bb604eae 1073741824" returned: 0 in 1.004s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:13 devstack sudo[99983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:50:13 devstack sudo[99983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d1dca7d8-4052-4e16-8976-fd3a2d5b0176 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-d8109f74-d2a8-42ba-bb26-cde8bb604eae {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:13 devstack sudo[99985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-d8109f74-d2a8-42ba-bb26-cde8bb604eae
Jul 10 12:50:13 devstack sudo[99985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:13 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-44c161eb-c097-4310-adca-e672e9276915 tempest-VolumesExtendTest-1635708943 None] Acquiring lock "cinder-36d5e427-f4f8-4810-91a3-2af748fe4505-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:50:13 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-44c161eb-c097-4310-adca-e672e9276915 tempest-VolumesExtendTest-1635708943 None] Lock "cinder-36d5e427-f4f8-4810-91a3-2af748fe4505-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:50:13 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-44c161eb-c097-4310-adca-e672e9276915 tempest-VolumesExtendTest-1635708943 None] Acquiring lock "cinder-quobyte-36d5e427-f4f8-4810-91a3-2af748fe4505" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:50:13 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-44c161eb-c097-4310-adca-e672e9276915 tempest-VolumesExtendTest-1635708943 None] Lock "cinder-quobyte-36d5e427-f4f8-4810-91a3-2af748fe4505" acquired by "delete_volume" :: waited 0.017s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:50:13 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e4e836-9740-426b-babf-ad0b5cb34e50]: (4, 'raw') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:50:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-44c161eb-c097-4310-adca-e672e9276915 tempest-VolumesExtendTest-1635708943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-36d5e427-f4f8-4810-91a3-2af748fe4505 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:13 devstack sudo[99987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-36d5e427-f4f8-4810-91a3-2af748fe4505
Jul 10 12:50:13 devstack sudo[99987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:13 devstack sudo[99983]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.799s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:13 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:50:13 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager._thread_info {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:50:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread count: 28 {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 10 12:50:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread info: [<_MainThread(MainThread, started 128233544536192)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128233445424704)>, <Thread(Thread-3 (stat_writer), started daemon 128233435118528)>, <Thread(Rabbit-heartbeat, started daemon 128233435718016)>, <Thread(Thread-5 (_runner), started daemon 128233432624448)>, <Thread(Thread-7 (_runner), started daemon 128233432674688)>, <Thread(fd_logger, started daemon 128233428569472)>, <Thread(privsep_reader, started daemon 128233429417088)>, <Thread(tpool_thread_0, started daemon 128233421182656)>, <Thread(tpool_thread_1, started daemon 128233412789952)>, <Thread(tpool_thread_2, started daemon 128233404397248)>, <Thread(tpool_thread_3, started daemon 128233396004544)>, <Thread(tpool_thread_4, started daemon 128233387611840)>, <Thread(tpool_thread_5, started daemon 128233379219136)>, <Thread(tpool_thread_6, started daemon 128233370826432)>, <Thread(tpool_thread_7, started daemon 128233362433728)>, <Thread(tpool_thread_8, started daemon 128233354041024)>, <Thread(tpool_thread_9, started daemon 128233345631936)>, <Thread(tpool_thread_10, started daemon 128233337222848)>, <Thread(tpool_thread_11, started daemon 128233328813760)>, <Thread(tpool_thread_12, started daemon 128233320404672)>, <Thread(tpool_thread_13, started daemon 128233311995584)>, <Thread(tpool_thread_14, started daemon 128233303586496)>, <Thread(tpool_thread_15, started daemon 128233295177408)>, <Thread(tpool_thread_16, started daemon 128233286768320)>, <Thread(tpool_thread_17, started daemon 128233278359232)>, <Thread(tpool_thread_18, started daemon 128233269950144)>, <Thread(tpool_thread_19, started daemon 128233261541056)>] {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 10 12:50:13 devstack sudo[99985]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d1dca7d8-4052-4e16-8976-fd3a2d5b0176 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-d8109f74-d2a8-42ba-bb26-cde8bb604eae" returned: 0 in 0.819s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:13 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-d1dca7d8-4052-4e16-8976-fd3a2d5b0176 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] <== create_volume: return (1890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:50:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d1dca7d8-4052-4e16-8976-fd3a2d5b0176 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.896s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:50:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-35df4435-0b9d-4bc0-abcb-4ccec5774d46 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.543s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:50:13 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-35df4435-0b9d-4bc0-abcb-4ccec5774d46 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:50:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1250178946',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5d9022a-5116-48e5-959d-5058c348a974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17be70b6ecde468abbc0fe96f21fe624',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:50:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:50:11Z,use_quota=True,user_id='b751c1898d4d45ce82357a3608cbc2de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:50:13 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-35df4435-0b9d-4bc0-abcb-4ccec5774d46 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Creating volume e5d9022a-5116-48e5-959d-5058c348a974 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:50:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-35df4435-0b9d-4bc0-abcb-4ccec5774d46 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:50:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-35df4435-0b9d-4bc0-abcb-4ccec5774d46 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:50:13 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-35df4435-0b9d-4bc0-abcb-4ccec5774d46 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:50:13 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-35df4435-0b9d-4bc0-abcb-4ccec5774d46 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:50:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-35df4435-0b9d-4bc0-abcb-4ccec5774d46 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:50:13 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-35df4435-0b9d-4bc0-abcb-4ccec5774d46 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:50:13 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-35df4435-0b9d-4bc0-abcb-4ccec5774d46 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:50:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-35df4435-0b9d-4bc0-abcb-4ccec5774d46 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e5d9022a-5116-48e5-959d-5058c348a974 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d1dca7d8-4052-4e16-8976-fd3a2d5b0176 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc20f303-3cfa-429b-922e-a2b04abdfac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8109f74-d2a8-42ba-bb26-cde8bb604eae', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:13 devstack sudo[99991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e5d9022a-5116-48e5-959d-5058c348a974 1073741824
Jul 10 12:50:13 devstack sudo[99991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d1dca7d8-4052-4e16-8976-fd3a2d5b0176 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a86af7f-2357-405d-a477-d784ea769edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:13 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-d1dca7d8-4052-4e16-8976-fd3a2d5b0176 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Volume volume-d8109f74-d2a8-42ba-bb26-cde8bb604eae (d8109f74-d2a8-42ba-bb26-cde8bb604eae): created successfully
Jul 10 12:50:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d1dca7d8-4052-4e16-8976-fd3a2d5b0176 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a86af7f-2357-405d-a477-d784ea769edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d1dca7d8-4052-4e16-8976-fd3a2d5b0176 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Flow 'volume_create_manager' (78689d11-056f-4ea4-a604-9d460fa26f91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:50:13 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-d1dca7d8-4052-4e16-8976-fd3a2d5b0176 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Created volume successfully.
Jul 10 12:50:14 devstack sudo[99987]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-44c161eb-c097-4310-adca-e672e9276915 tempest-VolumesExtendTest-1635708943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-36d5e427-f4f8-4810-91a3-2af748fe4505" returned: 0 in 0.914s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-44c161eb-c097-4310-adca-e672e9276915 tempest-VolumesExtendTest-1635708943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-36d5e427-f4f8-4810-91a3-2af748fe4505 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:14 devstack sudo[99995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-36d5e427-f4f8-4810-91a3-2af748fe4505
Jul 10 12:50:14 devstack sudo[99995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:14 devstack sudo[99991]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-35df4435-0b9d-4bc0-abcb-4ccec5774d46 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e5d9022a-5116-48e5-959d-5058c348a974 1073741824" returned: 0 in 0.999s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-35df4435-0b9d-4bc0-abcb-4ccec5774d46 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e5d9022a-5116-48e5-959d-5058c348a974 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:14 devstack sudo[100000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e5d9022a-5116-48e5-959d-5058c348a974
Jul 10 12:50:14 devstack sudo[100000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:15 devstack sudo[99995]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-44c161eb-c097-4310-adca-e672e9276915 tempest-VolumesExtendTest-1635708943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-36d5e427-f4f8-4810-91a3-2af748fe4505" returned: 1 in 0.860s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-44c161eb-c097-4310-adca-e672e9276915 tempest-VolumesExtendTest-1635708943 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-36d5e427-f4f8-4810-91a3-2af748fe4505' failed. Not Retrying. {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 10 12:50:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-44c161eb-c097-4310-adca-e672e9276915 tempest-VolumesExtendTest-1635708943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-36d5e427-f4f8-4810-91a3-2af748fe4505 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:15 devstack sudo[100005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-36d5e427-f4f8-4810-91a3-2af748fe4505
Jul 10 12:50:15 devstack sudo[100005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:15 devstack sudo[100000]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-35df4435-0b9d-4bc0-abcb-4ccec5774d46 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e5d9022a-5116-48e5-959d-5058c348a974" returned: 0 in 0.815s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:15 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-35df4435-0b9d-4bc0-abcb-4ccec5774d46 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] <== create_volume: return (1867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:50:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-35df4435-0b9d-4bc0-abcb-4ccec5774d46 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.871s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:50:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2dc3bf87-4756-42ef-9761-7d2f5fb6964b tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.103s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:50:15 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-2dc3bf87-4756-42ef-9761-7d2f5fb6964b tempest-CreateVolumesFromSourceVolumeTest-425015976 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:50:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1019280525',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=770f31e8-9f64-46fa-bde3-bf0e6139387b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17be70b6ecde468abbc0fe96f21fe624',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:50:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:50:12Z,use_quota=True,user_id='b751c1898d4d45ce82357a3608cbc2de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:50:15 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-2dc3bf87-4756-42ef-9761-7d2f5fb6964b tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Creating volume 770f31e8-9f64-46fa-bde3-bf0e6139387b {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:50:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2dc3bf87-4756-42ef-9761-7d2f5fb6964b tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:50:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2dc3bf87-4756-42ef-9761-7d2f5fb6964b tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:50:15 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-2dc3bf87-4756-42ef-9761-7d2f5fb6964b tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:50:15 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-2dc3bf87-4756-42ef-9761-7d2f5fb6964b tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:50:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2dc3bf87-4756-42ef-9761-7d2f5fb6964b tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:50:15 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-2dc3bf87-4756-42ef-9761-7d2f5fb6964b tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:50:15 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-2dc3bf87-4756-42ef-9761-7d2f5fb6964b tempest-CreateVolumesFromSourceVolumeTest-425015976 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:50:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2dc3bf87-4756-42ef-9761-7d2f5fb6964b tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-770f31e8-9f64-46fa-bde3-bf0e6139387b 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:15 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-35df4435-0b9d-4bc0-abcb-4ccec5774d46 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74cedd96-ada0-4139-96b0-76f7fd62ce34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5d9022a-5116-48e5-959d-5058c348a974', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:15 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-35df4435-0b9d-4bc0-abcb-4ccec5774d46 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caf244fb-76e3-4db2-8962-ebc59179e065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:15 devstack sudo[100008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-770f31e8-9f64-46fa-bde3-bf0e6139387b 1073741824
Jul 10 12:50:15 devstack sudo[100008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:15 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-35df4435-0b9d-4bc0-abcb-4ccec5774d46 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Volume volume-e5d9022a-5116-48e5-959d-5058c348a974 (e5d9022a-5116-48e5-959d-5058c348a974): created successfully
Jul 10 12:50:15 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-35df4435-0b9d-4bc0-abcb-4ccec5774d46 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caf244fb-76e3-4db2-8962-ebc59179e065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:15 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-35df4435-0b9d-4bc0-abcb-4ccec5774d46 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Flow 'volume_create_manager' (df5eee3e-45cf-48cb-bd40-d722f4def149) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:50:15 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-35df4435-0b9d-4bc0-abcb-4ccec5774d46 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Created volume successfully.
Jul 10 12:50:15 devstack sudo[100005]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-44c161eb-c097-4310-adca-e672e9276915 tempest-VolumesExtendTest-1635708943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-36d5e427-f4f8-4810-91a3-2af748fe4505" returned: 0 in 0.761s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:16 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-44c161eb-c097-4310-adca-e672e9276915 tempest-VolumesExtendTest-1635708943 None] Lock "cinder-quobyte-36d5e427-f4f8-4810-91a3-2af748fe4505" released by "delete_volume" :: held 2.635s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:50:16 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-44c161eb-c097-4310-adca-e672e9276915 tempest-VolumesExtendTest-1635708943 None] Created reservations ['326d7fad-c1ab-4c75-9e92-82c9086de91c', '0744b357-5711-43e5-a597-c16c9f515f5c', 'a9a4ec11-d180-4393-8e37-84061be425c8', 'ec72d3d2-036c-4736-b587-40d659d78914'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:50:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-44c161eb-c097-4310-adca-e672e9276915 tempest-VolumesExtendTest-1635708943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:50:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-44c161eb-c097-4310-adca-e672e9276915 tempest-VolumesExtendTest-1635708943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:50:16 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-44c161eb-c097-4310-adca-e672e9276915 tempest-VolumesExtendTest-1635708943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:50:16 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-44c161eb-c097-4310-adca-e672e9276915 tempest-VolumesExtendTest-1635708943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:50:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-44c161eb-c097-4310-adca-e672e9276915 tempest-VolumesExtendTest-1635708943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:50:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-44c161eb-c097-4310-adca-e672e9276915 tempest-VolumesExtendTest-1635708943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:16 devstack sudo[100011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:50:16 devstack sudo[100011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:16 devstack sudo[100008]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2dc3bf87-4756-42ef-9761-7d2f5fb6964b tempest-CreateVolumesFromSourceVolumeTest-425015976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-770f31e8-9f64-46fa-bde3-bf0e6139387b 1073741824" returned: 0 in 1.035s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2dc3bf87-4756-42ef-9761-7d2f5fb6964b tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-770f31e8-9f64-46fa-bde3-bf0e6139387b {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:16 devstack sudo[100017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-770f31e8-9f64-46fa-bde3-bf0e6139387b
Jul 10 12:50:16 devstack sudo[100017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:16 devstack sudo[100011]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-44c161eb-c097-4310-adca-e672e9276915 tempest-VolumesExtendTest-1635708943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.784s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:16 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-44c161eb-c097-4310-adca-e672e9276915 tempest-VolumesExtendTest-1635708943 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:50:16 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-44c161eb-c097-4310-adca-e672e9276915 tempest-VolumesExtendTest-1635708943 None] Deleted volume successfully.
Jul 10 12:50:17 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-44c161eb-c097-4310-adca-e672e9276915 tempest-VolumesExtendTest-1635708943 None] Lock "cinder-36d5e427-f4f8-4810-91a3-2af748fe4505-delete_volume" released by "delete_volume" :: held 3.728s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:50:17 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d3adade-e20b-47dd-be6b-bd9ab6dbbed1 tempest-VolumesExtendTest-1635708943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:50:17 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5d3adade-e20b-47dd-be6b-bd9ab6dbbed1 tempest-VolumesExtendTest-1635708943 None] Flow 'volume_create_manager' (9ff90723-e9d7-4911-9a76-8d20a37ad461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:50:17 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5d3adade-e20b-47dd-be6b-bd9ab6dbbed1 tempest-VolumesExtendTest-1635708943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9cf002c-a895-48ac-a637-1a000cf1f537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:17 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5d3adade-e20b-47dd-be6b-bd9ab6dbbed1 tempest-VolumesExtendTest-1635708943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9cf002c-a895-48ac-a637-1a000cf1f537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1775080929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d3a909c-feec-4faf-8fb0-9fe12f18e747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ae27bc66f6f4210b877b85ee358565d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:50:17Z,use_quota=True,user_id='2505f63fbdc442cf864e7e7cba8a0c9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:17 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5d3adade-e20b-47dd-be6b-bd9ab6dbbed1 tempest-VolumesExtendTest-1635708943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f84004e7-fec8-44d9-aa2b-b9f934c536d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:17 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5d3adade-e20b-47dd-be6b-bd9ab6dbbed1 tempest-VolumesExtendTest-1635708943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f84004e7-fec8-44d9-aa2b-b9f934c536d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:17 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5d3adade-e20b-47dd-be6b-bd9ab6dbbed1 tempest-VolumesExtendTest-1635708943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ec80ed3-426e-4714-a720-6dc4b1c82751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:17 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5d3adade-e20b-47dd-be6b-bd9ab6dbbed1 tempest-VolumesExtendTest-1635708943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ec80ed3-426e-4714-a720-6dc4b1c82751) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d3a909c-feec-4faf-8fb0-9fe12f18e747', 'volume_name': 'volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:17 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5d3adade-e20b-47dd-be6b-bd9ab6dbbed1 tempest-VolumesExtendTest-1635708943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01d24d32-8d05-4e5b-8192-b849e4efe1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:17 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5d3adade-e20b-47dd-be6b-bd9ab6dbbed1 tempest-VolumesExtendTest-1635708943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01d24d32-8d05-4e5b-8192-b849e4efe1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:17 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5d3adade-e20b-47dd-be6b-bd9ab6dbbed1 tempest-VolumesExtendTest-1635708943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b361e34c-ae96-48e8-90f3-4f007374a0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:17 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-5d3adade-e20b-47dd-be6b-bd9ab6dbbed1 tempest-VolumesExtendTest-1635708943 None] Volume 5d3a909c-feec-4faf-8fb0-9fe12f18e747: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747', 'volume_size': 1}
Jul 10 12:50:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5d3adade-e20b-47dd-be6b-bd9ab6dbbed1 tempest-VolumesExtendTest-1635708943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:50:17 devstack sudo[100017]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2dc3bf87-4756-42ef-9761-7d2f5fb6964b tempest-CreateVolumesFromSourceVolumeTest-425015976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-770f31e8-9f64-46fa-bde3-bf0e6139387b" returned: 0 in 0.737s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:17 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-2dc3bf87-4756-42ef-9761-7d2f5fb6964b tempest-CreateVolumesFromSourceVolumeTest-425015976 None] <== create_volume: return (1845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:50:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2dc3bf87-4756-42ef-9761-7d2f5fb6964b tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.848s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:50:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-8eced083-fd3b-4c11-bb40-b7b2e032af41 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.430s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:50:17 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-8eced083-fd3b-4c11-bb40-b7b2e032af41 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-607386466',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=392bfb59-feef-406f-b200-96debd337190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17be70b6ecde468abbc0fe96f21fe624',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:50:12Z,use_quota=True,user_id='b751c1898d4d45ce82357a3608cbc2de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:50:17 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-8eced083-fd3b-4c11-bb40-b7b2e032af41 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Creating volume 392bfb59-feef-406f-b200-96debd337190 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:50:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-8eced083-fd3b-4c11-bb40-b7b2e032af41 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:50:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-8eced083-fd3b-4c11-bb40-b7b2e032af41 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:50:17 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-8eced083-fd3b-4c11-bb40-b7b2e032af41 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:50:17 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-8eced083-fd3b-4c11-bb40-b7b2e032af41 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:50:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-8eced083-fd3b-4c11-bb40-b7b2e032af41 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:50:17 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-8eced083-fd3b-4c11-bb40-b7b2e032af41 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:50:17 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-8eced083-fd3b-4c11-bb40-b7b2e032af41 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:50:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8eced083-fd3b-4c11-bb40-b7b2e032af41 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-392bfb59-feef-406f-b200-96debd337190 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:17 devstack sudo[100020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-392bfb59-feef-406f-b200-96debd337190 1073741824
Jul 10 12:50:17 devstack sudo[100020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:17 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2dc3bf87-4756-42ef-9761-7d2f5fb6964b tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ce10b20-7b8b-46bd-9a12-41726654b5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-770f31e8-9f64-46fa-bde3-bf0e6139387b', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:17 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2dc3bf87-4756-42ef-9761-7d2f5fb6964b tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec06c1f4-151e-4d5a-bb29-be0a205f6859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:17 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-2dc3bf87-4756-42ef-9761-7d2f5fb6964b tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Volume volume-770f31e8-9f64-46fa-bde3-bf0e6139387b (770f31e8-9f64-46fa-bde3-bf0e6139387b): created successfully
Jul 10 12:50:17 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2dc3bf87-4756-42ef-9761-7d2f5fb6964b tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec06c1f4-151e-4d5a-bb29-be0a205f6859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:17 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2dc3bf87-4756-42ef-9761-7d2f5fb6964b tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Flow 'volume_create_manager' (0d794625-9f2f-49f8-bc67-4c36ff2d866e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:50:17 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-2dc3bf87-4756-42ef-9761-7d2f5fb6964b tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Created volume successfully.
Jul 10 12:50:18 devstack sudo[100020]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8eced083-fd3b-4c11-bb40-b7b2e032af41 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-392bfb59-feef-406f-b200-96debd337190 1073741824" returned: 0 in 0.872s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8eced083-fd3b-4c11-bb40-b7b2e032af41 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-392bfb59-feef-406f-b200-96debd337190 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:18 devstack sudo[100025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-392bfb59-feef-406f-b200-96debd337190
Jul 10 12:50:18 devstack sudo[100025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:19 devstack sudo[100025]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8eced083-fd3b-4c11-bb40-b7b2e032af41 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-392bfb59-feef-406f-b200-96debd337190" returned: 0 in 0.678s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:19 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-8eced083-fd3b-4c11-bb40-b7b2e032af41 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] <== create_volume: return (1589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:50:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-8eced083-fd3b-4c11-bb40-b7b2e032af41 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:50:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c353a88c-0fdb-4d15-9930-d926f3191f36 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.600s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:50:19 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-c353a88c-0fdb-4d15-9930-d926f3191f36 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2042502907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d180feb-143a-437d-a904-568cad0e3150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17be70b6ecde468abbc0fe96f21fe624',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:50:12Z,use_quota=True,user_id='b751c1898d4d45ce82357a3608cbc2de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:50:19 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-c353a88c-0fdb-4d15-9930-d926f3191f36 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Creating volume 2d180feb-143a-437d-a904-568cad0e3150 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:50:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c353a88c-0fdb-4d15-9930-d926f3191f36 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:50:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c353a88c-0fdb-4d15-9930-d926f3191f36 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:50:19 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-c353a88c-0fdb-4d15-9930-d926f3191f36 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:50:19 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-c353a88c-0fdb-4d15-9930-d926f3191f36 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:50:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c353a88c-0fdb-4d15-9930-d926f3191f36 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:50:19 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-c353a88c-0fdb-4d15-9930-d926f3191f36 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:50:19 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-c353a88c-0fdb-4d15-9930-d926f3191f36 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:50:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c353a88c-0fdb-4d15-9930-d926f3191f36 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2d180feb-143a-437d-a904-568cad0e3150 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:19 devstack sudo[100029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2d180feb-143a-437d-a904-568cad0e3150 1073741824
Jul 10 12:50:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-8eced083-fd3b-4c11-bb40-b7b2e032af41 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a69f9f1c-2f68-4b02-be50-d3cf1aca6597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-392bfb59-feef-406f-b200-96debd337190', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:19 devstack sudo[100029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-8eced083-fd3b-4c11-bb40-b7b2e032af41 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdec3bc9-f93a-4c51-ae35-c5a062ce2896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:19 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-8eced083-fd3b-4c11-bb40-b7b2e032af41 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Volume volume-392bfb59-feef-406f-b200-96debd337190 (392bfb59-feef-406f-b200-96debd337190): created successfully
Jul 10 12:50:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-8eced083-fd3b-4c11-bb40-b7b2e032af41 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdec3bc9-f93a-4c51-ae35-c5a062ce2896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-8eced083-fd3b-4c11-bb40-b7b2e032af41 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Flow 'volume_create_manager' (ebbc3206-c0bb-465c-add0-e9b092c1e71e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:50:19 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-8eced083-fd3b-4c11-bb40-b7b2e032af41 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Created volume successfully.
Jul 10 12:50:20 devstack sudo[100029]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c353a88c-0fdb-4d15-9930-d926f3191f36 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2d180feb-143a-437d-a904-568cad0e3150 1073741824" returned: 0 in 0.922s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c353a88c-0fdb-4d15-9930-d926f3191f36 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2d180feb-143a-437d-a904-568cad0e3150 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:20 devstack sudo[100035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2d180feb-143a-437d-a904-568cad0e3150
Jul 10 12:50:20 devstack sudo[100035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:20 devstack sudo[100035]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c353a88c-0fdb-4d15-9930-d926f3191f36 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2d180feb-143a-437d-a904-568cad0e3150" returned: 0 in 0.666s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:20 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-c353a88c-0fdb-4d15-9930-d926f3191f36 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:50:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c353a88c-0fdb-4d15-9930-d926f3191f36 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.638s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:50:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5d3adade-e20b-47dd-be6b-bd9ab6dbbed1 tempest-VolumesExtendTest-1635708943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.521s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:50:20 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5d3adade-e20b-47dd-be6b-bd9ab6dbbed1 tempest-VolumesExtendTest-1635708943 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1775080929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d3a909c-feec-4faf-8fb0-9fe12f18e747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ae27bc66f6f4210b877b85ee358565d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:50:17Z,use_quota=True,user_id='2505f63fbdc442cf864e7e7cba8a0c9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:50:20 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-5d3adade-e20b-47dd-be6b-bd9ab6dbbed1 tempest-VolumesExtendTest-1635708943 None] Creating volume 5d3a909c-feec-4faf-8fb0-9fe12f18e747 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:50:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5d3adade-e20b-47dd-be6b-bd9ab6dbbed1 tempest-VolumesExtendTest-1635708943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:50:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5d3adade-e20b-47dd-be6b-bd9ab6dbbed1 tempest-VolumesExtendTest-1635708943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:50:20 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5d3adade-e20b-47dd-be6b-bd9ab6dbbed1 tempest-VolumesExtendTest-1635708943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:50:20 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5d3adade-e20b-47dd-be6b-bd9ab6dbbed1 tempest-VolumesExtendTest-1635708943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:50:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5d3adade-e20b-47dd-be6b-bd9ab6dbbed1 tempest-VolumesExtendTest-1635708943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:50:20 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5d3adade-e20b-47dd-be6b-bd9ab6dbbed1 tempest-VolumesExtendTest-1635708943 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:50:20 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-5d3adade-e20b-47dd-be6b-bd9ab6dbbed1 tempest-VolumesExtendTest-1635708943 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:50:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5d3adade-e20b-47dd-be6b-bd9ab6dbbed1 tempest-VolumesExtendTest-1635708943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:20 devstack sudo[100038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747 1073741824
Jul 10 12:50:20 devstack sudo[100038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:20 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c353a88c-0fdb-4d15-9930-d926f3191f36 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc35e6d9-20d3-4340-abd6-484173544b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d180feb-143a-437d-a904-568cad0e3150', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:20 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c353a88c-0fdb-4d15-9930-d926f3191f36 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1174e600-06c1-438f-8f6a-26e67af7986f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:20 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-c353a88c-0fdb-4d15-9930-d926f3191f36 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Volume volume-2d180feb-143a-437d-a904-568cad0e3150 (2d180feb-143a-437d-a904-568cad0e3150): created successfully
Jul 10 12:50:20 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c353a88c-0fdb-4d15-9930-d926f3191f36 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1174e600-06c1-438f-8f6a-26e67af7986f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:20 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c353a88c-0fdb-4d15-9930-d926f3191f36 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Flow 'volume_create_manager' (9a16e7c3-9d21-49ec-b483-00eebff3168d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:50:20 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-c353a88c-0fdb-4d15-9930-d926f3191f36 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Created volume successfully.
Jul 10 12:50:21 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-4f7a836d-68ca-46e5-97ed-5aa198b847ac tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Acquiring lock "cinder-2d180feb-143a-437d-a904-568cad0e3150-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:50:21 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-4f7a836d-68ca-46e5-97ed-5aa198b847ac tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "cinder-2d180feb-143a-437d-a904-568cad0e3150-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:50:21 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-4f7a836d-68ca-46e5-97ed-5aa198b847ac tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Acquiring lock "cinder-quobyte-2d180feb-143a-437d-a904-568cad0e3150" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:50:21 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-4f7a836d-68ca-46e5-97ed-5aa198b847ac tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "cinder-quobyte-2d180feb-143a-437d-a904-568cad0e3150" acquired by "delete_volume" :: waited 0.022s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:50:21 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[037fccab-fa5d-4842-95d5-8b190d6dfccf]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:50:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4f7a836d-68ca-46e5-97ed-5aa198b847ac tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2d180feb-143a-437d-a904-568cad0e3150 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:21 devstack sudo[100043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2d180feb-143a-437d-a904-568cad0e3150
Jul 10 12:50:21 devstack sudo[100043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:21 devstack sudo[100038]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5d3adade-e20b-47dd-be6b-bd9ab6dbbed1 tempest-VolumesExtendTest-1635708943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747 1073741824" returned: 0 in 0.957s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5d3adade-e20b-47dd-be6b-bd9ab6dbbed1 tempest-VolumesExtendTest-1635708943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:21 devstack sudo[100046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747
Jul 10 12:50:21 devstack sudo[100046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:22 devstack sudo[100043]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4f7a836d-68ca-46e5-97ed-5aa198b847ac tempest-CreateVolumesFromSourceVolumeTest-425015976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2d180feb-143a-437d-a904-568cad0e3150" returned: 0 in 0.997s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4f7a836d-68ca-46e5-97ed-5aa198b847ac tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2d180feb-143a-437d-a904-568cad0e3150 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:22 devstack sudo[100085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2d180feb-143a-437d-a904-568cad0e3150
Jul 10 12:50:22 devstack sudo[100085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:22 devstack sudo[100046]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5d3adade-e20b-47dd-be6b-bd9ab6dbbed1 tempest-VolumesExtendTest-1635708943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747" returned: 0 in 0.852s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:22 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5d3adade-e20b-47dd-be6b-bd9ab6dbbed1 tempest-VolumesExtendTest-1635708943 None] <== create_volume: return (1872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:50:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5d3adade-e20b-47dd-be6b-bd9ab6dbbed1 tempest-VolumesExtendTest-1635708943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.876s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:50:22 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5d3adade-e20b-47dd-be6b-bd9ab6dbbed1 tempest-VolumesExtendTest-1635708943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b361e34c-ae96-48e8-90f3-4f007374a0dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:22 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5d3adade-e20b-47dd-be6b-bd9ab6dbbed1 tempest-VolumesExtendTest-1635708943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e17e3f78-bea1-4daa-a447-59cfc856eca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:22 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-5d3adade-e20b-47dd-be6b-bd9ab6dbbed1 tempest-VolumesExtendTest-1635708943 None] Volume volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747 (5d3a909c-feec-4faf-8fb0-9fe12f18e747): created successfully
Jul 10 12:50:22 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5d3adade-e20b-47dd-be6b-bd9ab6dbbed1 tempest-VolumesExtendTest-1635708943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e17e3f78-bea1-4daa-a447-59cfc856eca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:22 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5d3adade-e20b-47dd-be6b-bd9ab6dbbed1 tempest-VolumesExtendTest-1635708943 None] Flow 'volume_create_manager' (9ff90723-e9d7-4911-9a76-8d20a37ad461) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:50:22 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-5d3adade-e20b-47dd-be6b-bd9ab6dbbed1 tempest-VolumesExtendTest-1635708943 None] Created volume successfully.
Jul 10 12:50:23 devstack sudo[100085]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4f7a836d-68ca-46e5-97ed-5aa198b847ac tempest-CreateVolumesFromSourceVolumeTest-425015976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2d180feb-143a-437d-a904-568cad0e3150" returned: 0 in 0.756s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:23 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-4f7a836d-68ca-46e5-97ed-5aa198b847ac tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "cinder-quobyte-2d180feb-143a-437d-a904-568cad0e3150" released by "delete_volume" :: held 1.802s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:50:23 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-4f7a836d-68ca-46e5-97ed-5aa198b847ac tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Created reservations ['34da145d-efba-418e-887f-faa2f7813990', 'b472a4b0-e662-42f1-a2bd-482243eff600', 'e45c40cf-fc20-49fc-8fd6-65eafc98db6d', '83e73644-fab1-4b57-b15c-1bc5bc5fcb1d'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:50:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-4f7a836d-68ca-46e5-97ed-5aa198b847ac tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:50:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-4f7a836d-68ca-46e5-97ed-5aa198b847ac tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:50:23 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-4f7a836d-68ca-46e5-97ed-5aa198b847ac tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:50:23 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-4f7a836d-68ca-46e5-97ed-5aa198b847ac tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:50:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-4f7a836d-68ca-46e5-97ed-5aa198b847ac tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:50:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4f7a836d-68ca-46e5-97ed-5aa198b847ac tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:23 devstack sudo[100091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:50:23 devstack sudo[100091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:23 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-aa38065f-7866-48e5-b034-137d3128a7d9 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Acquiring lock "cinder-392bfb59-feef-406f-b200-96debd337190-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:50:23 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-aa38065f-7866-48e5-b034-137d3128a7d9 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "cinder-392bfb59-feef-406f-b200-96debd337190-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:50:23 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-aa38065f-7866-48e5-b034-137d3128a7d9 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Acquiring lock "cinder-quobyte-392bfb59-feef-406f-b200-96debd337190" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:50:23 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-aa38065f-7866-48e5-b034-137d3128a7d9 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "cinder-quobyte-392bfb59-feef-406f-b200-96debd337190" acquired by "delete_volume" :: waited 0.016s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:50:23 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[50900835-e803-4b9b-ad10-5b4540507e93]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:50:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-aa38065f-7866-48e5-b034-137d3128a7d9 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-392bfb59-feef-406f-b200-96debd337190 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:23 devstack sudo[100093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-392bfb59-feef-406f-b200-96debd337190
Jul 10 12:50:23 devstack sudo[100093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-bb0641d2-d359-4138-b927-9cf3b2ccf52f tempest-VolumesExtendTest-1635708943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:50:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-bb0641d2-d359-4138-b927-9cf3b2ccf52f tempest-VolumesExtendTest-1635708943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:50:24 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-bb0641d2-d359-4138-b927-9cf3b2ccf52f tempest-VolumesExtendTest-1635708943 None] Creating offline snapshot fa563802-002f-4134-a588-956fff4cfcde of volume 5d3a909c-feec-4faf-8fb0-9fe12f18e747 {{(pid=87378) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 10 12:50:24 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aeeaaf9-3894-4b30-be4a-3eb6eea1f2fb]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:50:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-bb0641d2-d359-4138-b927-9cf3b2ccf52f tempest-VolumesExtendTest-1635708943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:24 devstack sudo[100095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747
Jul 10 12:50:24 devstack sudo[100095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:24 devstack sudo[100091]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4f7a836d-68ca-46e5-97ed-5aa198b847ac tempest-CreateVolumesFromSourceVolumeTest-425015976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.840s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:24 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-4f7a836d-68ca-46e5-97ed-5aa198b847ac tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:50:24 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-4f7a836d-68ca-46e5-97ed-5aa198b847ac tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Deleted volume successfully.
Jul 10 12:50:24 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-4f7a836d-68ca-46e5-97ed-5aa198b847ac tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "cinder-2d180feb-143a-437d-a904-568cad0e3150-delete_volume" released by "delete_volume" :: held 2.885s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:50:24 devstack sudo[100093]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-aa38065f-7866-48e5-b034-137d3128a7d9 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-392bfb59-feef-406f-b200-96debd337190" returned: 0 in 0.888s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-aa38065f-7866-48e5-b034-137d3128a7d9 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-392bfb59-feef-406f-b200-96debd337190 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:24 devstack sudo[100101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-392bfb59-feef-406f-b200-96debd337190
Jul 10 12:50:24 devstack sudo[100101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:24 devstack sudo[100095]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-bb0641d2-d359-4138-b927-9cf3b2ccf52f tempest-VolumesExtendTest-1635708943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747" returned: 0 in 0.861s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-bb0641d2-d359-4138-b927-9cf3b2ccf52f tempest-VolumesExtendTest-1635708943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747.fa563802-002f-4134-a588-956fff4cfcde 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:24 devstack sudo[100106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747.fa563802-002f-4134-a588-956fff4cfcde 1G
Jul 10 12:50:24 devstack sudo[100106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:25 devstack sudo[100101]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-aa38065f-7866-48e5-b034-137d3128a7d9 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-392bfb59-feef-406f-b200-96debd337190" returned: 0 in 0.701s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:25 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-aa38065f-7866-48e5-b034-137d3128a7d9 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "cinder-quobyte-392bfb59-feef-406f-b200-96debd337190" released by "delete_volume" :: held 1.649s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:50:25 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-aa38065f-7866-48e5-b034-137d3128a7d9 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Created reservations ['3ad7f9cf-ae20-4ab6-bae4-8dbdb328c35d', '1a15d705-43eb-49d5-95b8-61a158446cc9', '32ae4b70-e026-4d87-b55e-2a1a7936ef49', '2fa31dce-e745-4bae-8855-4bc113a278b7'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:50:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-aa38065f-7866-48e5-b034-137d3128a7d9 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:50:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-aa38065f-7866-48e5-b034-137d3128a7d9 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:50:25 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-aa38065f-7866-48e5-b034-137d3128a7d9 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:50:25 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-aa38065f-7866-48e5-b034-137d3128a7d9 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:50:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-aa38065f-7866-48e5-b034-137d3128a7d9 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:50:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-aa38065f-7866-48e5-b034-137d3128a7d9 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:25 devstack sudo[100112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:50:25 devstack sudo[100112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:25 devstack sudo[100106]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-bb0641d2-d359-4138-b927-9cf3b2ccf52f tempest-VolumesExtendTest-1635708943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747.fa563802-002f-4134-a588-956fff4cfcde 1G" returned: 0 in 0.870s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-bb0641d2-d359-4138-b927-9cf3b2ccf52f tempest-VolumesExtendTest-1635708943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747.fa563802-002f-4134-a588-956fff4cfcde {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:25 devstack sudo[100115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747.fa563802-002f-4134-a588-956fff4cfcde
Jul 10 12:50:25 devstack sudo[100115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:25 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b43f447d-8de9-44a5-a91a-f4c714926d9d tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Acquiring lock "cinder-770f31e8-9f64-46fa-bde3-bf0e6139387b-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:50:25 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b43f447d-8de9-44a5-a91a-f4c714926d9d tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "cinder-770f31e8-9f64-46fa-bde3-bf0e6139387b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:50:26 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b43f447d-8de9-44a5-a91a-f4c714926d9d tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Acquiring lock "cinder-quobyte-770f31e8-9f64-46fa-bde3-bf0e6139387b" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:50:26 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b43f447d-8de9-44a5-a91a-f4c714926d9d tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "cinder-quobyte-770f31e8-9f64-46fa-bde3-bf0e6139387b" acquired by "delete_volume" :: waited 0.020s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:50:26 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b5bda0-d213-4b84-ad44-353021acf4b7]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:50:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b43f447d-8de9-44a5-a91a-f4c714926d9d tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-770f31e8-9f64-46fa-bde3-bf0e6139387b {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:26 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-50c8f405-81e4-498d-b177-e03c47f7b69f tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:50:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-50c8f405-81e4-498d-b177-e03c47f7b69f tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Flow 'volume_create_manager' (6dc3861d-3140-4d57-aaf4-9e8c440917f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:50:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-50c8f405-81e4-498d-b177-e03c47f7b69f tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (270eb056-c22b-47d2-9bf2-194d950b79e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:26 devstack sudo[100117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-770f31e8-9f64-46fa-bde3-bf0e6139387b
Jul 10 12:50:26 devstack sudo[100117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-50c8f405-81e4-498d-b177-e03c47f7b69f tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (270eb056-c22b-47d2-9bf2-194d950b79e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:50:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-813926029',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=500c88ae-4171-4bd9-ba9a-3abdf276be49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26f422c6f39d4ec98d3929f1ee135185',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:50:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:50:26Z,use_quota=True,user_id='e15225e8baf046cd822be5a4b9ce99e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-50c8f405-81e4-498d-b177-e03c47f7b69f tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86459f2e-51a8-469c-baa1-8bcdc6cd9d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-50c8f405-81e4-498d-b177-e03c47f7b69f tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86459f2e-51a8-469c-baa1-8bcdc6cd9d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-50c8f405-81e4-498d-b177-e03c47f7b69f tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de80ecd1-d563-4702-bdcb-952d758fc3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-50c8f405-81e4-498d-b177-e03c47f7b69f tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de80ecd1-d563-4702-bdcb-952d758fc3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '500c88ae-4171-4bd9-ba9a-3abdf276be49', 'volume_name': 'volume-500c88ae-4171-4bd9-ba9a-3abdf276be49', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-50c8f405-81e4-498d-b177-e03c47f7b69f tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca185486-5c60-43c9-8d78-658f6d5f02d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-50c8f405-81e4-498d-b177-e03c47f7b69f tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca185486-5c60-43c9-8d78-658f6d5f02d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-50c8f405-81e4-498d-b177-e03c47f7b69f tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e953a795-0af2-4e99-a5fc-7b26bf1bdb1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:26 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-50c8f405-81e4-498d-b177-e03c47f7b69f tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Volume 500c88ae-4171-4bd9-ba9a-3abdf276be49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-500c88ae-4171-4bd9-ba9a-3abdf276be49', 'volume_size': 1}
Jul 10 12:50:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-50c8f405-81e4-498d-b177-e03c47f7b69f tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:50:26 devstack sudo[100112]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-aa38065f-7866-48e5-b034-137d3128a7d9 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.784s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:26 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-aa38065f-7866-48e5-b034-137d3128a7d9 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:50:26 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-aa38065f-7866-48e5-b034-137d3128a7d9 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Deleted volume successfully.
Jul 10 12:50:26 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-aa38065f-7866-48e5-b034-137d3128a7d9 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "cinder-392bfb59-feef-406f-b200-96debd337190-delete_volume" released by "delete_volume" :: held 2.667s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:50:26 devstack sudo[100115]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-bb0641d2-d359-4138-b927-9cf3b2ccf52f tempest-VolumesExtendTest-1635708943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747.fa563802-002f-4134-a588-956fff4cfcde" returned: 0 in 0.867s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:26 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-bb0641d2-d359-4138-b927-9cf3b2ccf52f tempest-VolumesExtendTest-1635708943 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747.fa563802-002f-4134-a588-956fff4cfcde is being set with open permissions: ugo+rw
Jul 10 12:50:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-bb0641d2-d359-4138-b927-9cf3b2ccf52f tempest-VolumesExtendTest-1635708943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747.fa563802-002f-4134-a588-956fff4cfcde {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:26 devstack sudo[100123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747.fa563802-002f-4134-a588-956fff4cfcde
Jul 10 12:50:26 devstack sudo[100123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:26 devstack sudo[100117]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b43f447d-8de9-44a5-a91a-f4c714926d9d tempest-CreateVolumesFromSourceVolumeTest-425015976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-770f31e8-9f64-46fa-bde3-bf0e6139387b" returned: 0 in 0.813s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b43f447d-8de9-44a5-a91a-f4c714926d9d tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-770f31e8-9f64-46fa-bde3-bf0e6139387b {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:26 devstack sudo[100128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-770f31e8-9f64-46fa-bde3-bf0e6139387b
Jul 10 12:50:26 devstack sudo[100128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:27 devstack sudo[100123]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-bb0641d2-d359-4138-b927-9cf3b2ccf52f tempest-VolumesExtendTest-1635708943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747.fa563802-002f-4134-a588-956fff4cfcde" returned: 0 in 0.662s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-bb0641d2-d359-4138-b927-9cf3b2ccf52f tempest-VolumesExtendTest-1635708943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:27 devstack sudo[100131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747.info
Jul 10 12:50:27 devstack sudo[100131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:27 devstack sudo[100128]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b43f447d-8de9-44a5-a91a-f4c714926d9d tempest-CreateVolumesFromSourceVolumeTest-425015976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-770f31e8-9f64-46fa-bde3-bf0e6139387b" returned: 0 in 0.690s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:27 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b43f447d-8de9-44a5-a91a-f4c714926d9d tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "cinder-quobyte-770f31e8-9f64-46fa-bde3-bf0e6139387b" released by "delete_volume" :: held 1.556s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:50:27 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-b43f447d-8de9-44a5-a91a-f4c714926d9d tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Created reservations ['5834b340-ae1e-4e32-992d-359bfd59abee', 'b8c7c195-c92b-47d2-b1c1-ff594f3b9646', 'e3cc7c75-5763-4556-ba70-99e4fabbf869', '39c091b4-677b-45cd-a577-2eeb485c19dd'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:50:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-b43f447d-8de9-44a5-a91a-f4c714926d9d tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:50:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-b43f447d-8de9-44a5-a91a-f4c714926d9d tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:50:27 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-b43f447d-8de9-44a5-a91a-f4c714926d9d tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:50:27 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-b43f447d-8de9-44a5-a91a-f4c714926d9d tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:50:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-b43f447d-8de9-44a5-a91a-f4c714926d9d tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:50:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b43f447d-8de9-44a5-a91a-f4c714926d9d tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:27 devstack sudo[100134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:50:27 devstack sudo[100134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:28 devstack sudo[100131]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-bb0641d2-d359-4138-b927-9cf3b2ccf52f tempest-VolumesExtendTest-1635708943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747.info" returned: 0 in 0.698s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:28 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-bb0641d2-d359-4138-b927-9cf3b2ccf52f tempest-VolumesExtendTest-1635708943 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747.info is being set with open permissions: ugo+rw
Jul 10 12:50:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-bb0641d2-d359-4138-b927-9cf3b2ccf52f tempest-VolumesExtendTest-1635708943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:28 devstack sudo[100137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747.info
Jul 10 12:50:28 devstack sudo[100137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:28 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b14a69ba-6a8c-4f3b-af0e-a8e0a9359d71 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Acquiring lock "cinder-e5d9022a-5116-48e5-959d-5058c348a974-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:50:28 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b14a69ba-6a8c-4f3b-af0e-a8e0a9359d71 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "cinder-e5d9022a-5116-48e5-959d-5058c348a974-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:50:28 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b14a69ba-6a8c-4f3b-af0e-a8e0a9359d71 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Acquiring lock "cinder-quobyte-e5d9022a-5116-48e5-959d-5058c348a974" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:50:28 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b14a69ba-6a8c-4f3b-af0e-a8e0a9359d71 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "cinder-quobyte-e5d9022a-5116-48e5-959d-5058c348a974" acquired by "delete_volume" :: waited 0.017s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:50:28 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a68c4c-de4b-40cf-baa3-cbca736b550e]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:50:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b14a69ba-6a8c-4f3b-af0e-a8e0a9359d71 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e5d9022a-5116-48e5-959d-5058c348a974 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:28 devstack sudo[100134]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b43f447d-8de9-44a5-a91a-f4c714926d9d tempest-CreateVolumesFromSourceVolumeTest-425015976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.688s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:28 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-b43f447d-8de9-44a5-a91a-f4c714926d9d tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:50:28 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-b43f447d-8de9-44a5-a91a-f4c714926d9d tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Deleted volume successfully.
Jul 10 12:50:28 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b43f447d-8de9-44a5-a91a-f4c714926d9d tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "cinder-770f31e8-9f64-46fa-bde3-bf0e6139387b-delete_volume" released by "delete_volume" :: held 2.481s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:50:28 devstack sudo[100141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e5d9022a-5116-48e5-959d-5058c348a974
Jul 10 12:50:28 devstack sudo[100141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:28 devstack sudo[100137]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-bb0641d2-d359-4138-b927-9cf3b2ccf52f tempest-VolumesExtendTest-1635708943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747.info" returned: 0 in 0.723s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-bb0641d2-d359-4138-b927-9cf3b2ccf52f tempest-VolumesExtendTest-1635708943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.778s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:50:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-50c8f405-81e4-498d-b177-e03c47f7b69f tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.531s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:50:28 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-50c8f405-81e4-498d-b177-e03c47f7b69f tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:50:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-813926029',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=500c88ae-4171-4bd9-ba9a-3abdf276be49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26f422c6f39d4ec98d3929f1ee135185',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:50:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:50:26Z,use_quota=True,user_id='e15225e8baf046cd822be5a4b9ce99e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:50:28 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-50c8f405-81e4-498d-b177-e03c47f7b69f tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Creating volume 500c88ae-4171-4bd9-ba9a-3abdf276be49 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:50:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-50c8f405-81e4-498d-b177-e03c47f7b69f tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:50:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-50c8f405-81e4-498d-b177-e03c47f7b69f tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:50:28 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-50c8f405-81e4-498d-b177-e03c47f7b69f tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:50:28 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-50c8f405-81e4-498d-b177-e03c47f7b69f tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:50:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-50c8f405-81e4-498d-b177-e03c47f7b69f tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:50:28 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-50c8f405-81e4-498d-b177-e03c47f7b69f tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:50:28 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-50c8f405-81e4-498d-b177-e03c47f7b69f tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:50:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-50c8f405-81e4-498d-b177-e03c47f7b69f tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-500c88ae-4171-4bd9-ba9a-3abdf276be49 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:28 devstack sudo[100144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-500c88ae-4171-4bd9-ba9a-3abdf276be49 1073741824
Jul 10 12:50:28 devstack sudo[100144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:28 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-bb0641d2-d359-4138-b927-9cf3b2ccf52f tempest-VolumesExtendTest-1635708943 None] Create snapshot completed successfully
Jul 10 12:50:29 devstack sudo[100141]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b14a69ba-6a8c-4f3b-af0e-a8e0a9359d71 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e5d9022a-5116-48e5-959d-5058c348a974" returned: 0 in 0.799s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b14a69ba-6a8c-4f3b-af0e-a8e0a9359d71 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e5d9022a-5116-48e5-959d-5058c348a974 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:29 devstack sudo[100150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e5d9022a-5116-48e5-959d-5058c348a974
Jul 10 12:50:29 devstack sudo[100150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d5c0d8e2-5648-4612-8016-3051610c74d1 tempest-VolumesExtendTest-1635708943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:50:29 devstack sudo[100144]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-50c8f405-81e4-498d-b177-e03c47f7b69f tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-500c88ae-4171-4bd9-ba9a-3abdf276be49 1073741824" returned: 0 in 0.889s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-50c8f405-81e4-498d-b177-e03c47f7b69f tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-500c88ae-4171-4bd9-ba9a-3abdf276be49 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:29 devstack sudo[100155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-500c88ae-4171-4bd9-ba9a-3abdf276be49
Jul 10 12:50:29 devstack sudo[100155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:29 devstack sudo[100150]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b14a69ba-6a8c-4f3b-af0e-a8e0a9359d71 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e5d9022a-5116-48e5-959d-5058c348a974" returned: 0 in 0.722s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:29 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b14a69ba-6a8c-4f3b-af0e-a8e0a9359d71 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "cinder-quobyte-e5d9022a-5116-48e5-959d-5058c348a974" released by "delete_volume" :: held 1.573s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:50:29 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-b14a69ba-6a8c-4f3b-af0e-a8e0a9359d71 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Created reservations ['f1fc87d8-606d-4cdc-a278-7acc9301cf25', '05ef8f0a-1f40-4c01-9f0f-dd2120f54dab', 'afff915e-4531-41af-923f-36c99f205098', 'a41d4bd5-1111-4c7e-adc6-36dcd78c5d0e'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:50:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-b14a69ba-6a8c-4f3b-af0e-a8e0a9359d71 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:50:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-b14a69ba-6a8c-4f3b-af0e-a8e0a9359d71 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:50:29 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-b14a69ba-6a8c-4f3b-af0e-a8e0a9359d71 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:50:30 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-b14a69ba-6a8c-4f3b-af0e-a8e0a9359d71 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:50:30 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-b14a69ba-6a8c-4f3b-af0e-a8e0a9359d71 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:50:30 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b14a69ba-6a8c-4f3b-af0e-a8e0a9359d71 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:30 devstack sudo[100158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:50:30 devstack sudo[100158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:30 devstack sudo[100155]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:30 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-50c8f405-81e4-498d-b177-e03c47f7b69f tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-500c88ae-4171-4bd9-ba9a-3abdf276be49" returned: 0 in 0.665s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:30 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-50c8f405-81e4-498d-b177-e03c47f7b69f tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] <== create_volume: return (1593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:50:30 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-50c8f405-81e4-498d-b177-e03c47f7b69f tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.597s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:50:30 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d5c0d8e2-5648-4612-8016-3051610c74d1 tempest-VolumesExtendTest-1635708943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.060s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:50:30 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-50c8f405-81e4-498d-b177-e03c47f7b69f tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e953a795-0af2-4e99-a5fc-7b26bf1bdb1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-500c88ae-4171-4bd9-ba9a-3abdf276be49', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:30 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-50c8f405-81e4-498d-b177-e03c47f7b69f tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8116033-fef6-4f2c-bdd2-d236a3eb2051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:30 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6779581-2148-45d8-a872-3b7347fd3adf]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:50:30 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d5c0d8e2-5648-4612-8016-3051610c74d1 tempest-VolumesExtendTest-1635708943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:30 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-50c8f405-81e4-498d-b177-e03c47f7b69f tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Volume volume-500c88ae-4171-4bd9-ba9a-3abdf276be49 (500c88ae-4171-4bd9-ba9a-3abdf276be49): created successfully
Jul 10 12:50:30 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-50c8f405-81e4-498d-b177-e03c47f7b69f tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8116033-fef6-4f2c-bdd2-d236a3eb2051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:30 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-50c8f405-81e4-498d-b177-e03c47f7b69f tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Flow 'volume_create_manager' (6dc3861d-3140-4d57-aaf4-9e8c440917f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:50:30 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-50c8f405-81e4-498d-b177-e03c47f7b69f tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Created volume successfully.
Jul 10 12:50:30 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-42e613aa-cd5d-437b-8c1c-5c3b798cd83d tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Acquiring lock "cinder-d8109f74-d2a8-42ba-bb26-cde8bb604eae-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:50:30 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-42e613aa-cd5d-437b-8c1c-5c3b798cd83d tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "cinder-d8109f74-d2a8-42ba-bb26-cde8bb604eae-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:50:30 devstack sudo[100161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747
Jul 10 12:50:30 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-42e613aa-cd5d-437b-8c1c-5c3b798cd83d tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Acquiring lock "cinder-quobyte-d8109f74-d2a8-42ba-bb26-cde8bb604eae" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:50:30 devstack sudo[100161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:30 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-42e613aa-cd5d-437b-8c1c-5c3b798cd83d tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "cinder-quobyte-d8109f74-d2a8-42ba-bb26-cde8bb604eae" acquired by "delete_volume" :: waited 0.016s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:50:30 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a5e8ec-e105-4e01-a61f-a2ef5c6c86c0]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:50:30 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-42e613aa-cd5d-437b-8c1c-5c3b798cd83d tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-d8109f74-d2a8-42ba-bb26-cde8bb604eae {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:30 devstack sudo[100158]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:30 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b14a69ba-6a8c-4f3b-af0e-a8e0a9359d71 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.724s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:30 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-b14a69ba-6a8c-4f3b-af0e-a8e0a9359d71 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:50:30 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-b14a69ba-6a8c-4f3b-af0e-a8e0a9359d71 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Deleted volume successfully.
Jul 10 12:50:30 devstack sudo[100164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-d8109f74-d2a8-42ba-bb26-cde8bb604eae
Jul 10 12:50:30 devstack sudo[100164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:30 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b14a69ba-6a8c-4f3b-af0e-a8e0a9359d71 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "cinder-e5d9022a-5116-48e5-959d-5058c348a974-delete_volume" released by "delete_volume" :: held 2.523s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:50:31 devstack sudo[100161]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d5c0d8e2-5648-4612-8016-3051610c74d1 tempest-VolumesExtendTest-1635708943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747" returned: 0 in 0.841s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d5c0d8e2-5648-4612-8016-3051610c74d1 tempest-VolumesExtendTest-1635708943 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747.fa563802-002f-4134-a588-956fff4cfcde 2G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d5c0d8e2-5648-4612-8016-3051610c74d1 tempest-VolumesExtendTest-1635708943 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747.fa563802-002f-4134-a588-956fff4cfcde 2G" returned: 0 in 0.152s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d5c0d8e2-5648-4612-8016-3051610c74d1 tempest-VolumesExtendTest-1635708943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.039s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:50:31 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-d5c0d8e2-5648-4612-8016-3051610c74d1 tempest-VolumesExtendTest-1635708943 None] Extend volume completed successfully.
Jul 10 12:50:31 devstack sudo[100164]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-42e613aa-cd5d-437b-8c1c-5c3b798cd83d tempest-CreateVolumesFromSourceVolumeTest-425015976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-d8109f74-d2a8-42ba-bb26-cde8bb604eae" returned: 0 in 0.881s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-42e613aa-cd5d-437b-8c1c-5c3b798cd83d tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-d8109f74-d2a8-42ba-bb26-cde8bb604eae {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:31 devstack sudo[100175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-d8109f74-d2a8-42ba-bb26-cde8bb604eae
Jul 10 12:50:31 devstack sudo[100175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d5a156c7-4a9a-42ae-adfc-d21264468d15 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:50:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d5a156c7-4a9a-42ae-adfc-d21264468d15 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:50:31 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-d5a156c7-4a9a-42ae-adfc-d21264468d15 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Creating offline snapshot ab250450-f8c0-49d0-b083-0ffe4c798045 of volume 500c88ae-4171-4bd9-ba9a-3abdf276be49 {{(pid=87378) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 10 12:50:31 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c3c1f1-96cf-40d9-89f0-8fddc09336ba]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:50:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d5a156c7-4a9a-42ae-adfc-d21264468d15 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-500c88ae-4171-4bd9-ba9a-3abdf276be49 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:31 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-d0e05c2d-2e07-4ec1-b847-6bc28de57556 tempest-VolumesExtendTest-1635708943 None] Acquiring lock "cinder-fa563802-002f-4134-a588-956fff4cfcde-delete_snapshot" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:50:31 devstack sudo[100177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-500c88ae-4171-4bd9-ba9a-3abdf276be49
Jul 10 12:50:31 devstack sudo[100177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:31 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-d0e05c2d-2e07-4ec1-b847-6bc28de57556 tempest-VolumesExtendTest-1635708943 None] Lock "cinder-fa563802-002f-4134-a588-956fff4cfcde-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:50:31 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-d0e05c2d-2e07-4ec1-b847-6bc28de57556 tempest-VolumesExtendTest-1635708943 None] Acquiring lock "cinder-quobyte-5d3a909c-feec-4faf-8fb0-9fe12f18e747" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:50:31 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-d0e05c2d-2e07-4ec1-b847-6bc28de57556 tempest-VolumesExtendTest-1635708943 None] Lock "cinder-quobyte-5d3a909c-feec-4faf-8fb0-9fe12f18e747" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:50:31 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-d0e05c2d-2e07-4ec1-b847-6bc28de57556 tempest-VolumesExtendTest-1635708943 None] Acquiring lock "cinder-quobyte-fa563802-002f-4134-a588-956fff4cfcde" by "_delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:50:31 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-d0e05c2d-2e07-4ec1-b847-6bc28de57556 tempest-VolumesExtendTest-1635708943 None] Lock "cinder-quobyte-fa563802-002f-4134-a588-956fff4cfcde" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:50:31 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-d0e05c2d-2e07-4ec1-b847-6bc28de57556 tempest-VolumesExtendTest-1635708943 None] Deleting offline snapshot fa563802-002f-4134-a588-956fff4cfcde of volume 5d3a909c-feec-4faf-8fb0-9fe12f18e747 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 10 12:50:31 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-d0e05c2d-2e07-4ec1-b847-6bc28de57556 tempest-VolumesExtendTest-1635708943 None] snapshot_file for this snap is: volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747.fa563802-002f-4134-a588-956fff4cfcde {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 10 12:50:31 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4732adf-93c0-41fa-b80a-8173c82f1a4c]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:50:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d0e05c2d-2e07-4ec1-b847-6bc28de57556 tempest-VolumesExtendTest-1635708943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747.fa563802-002f-4134-a588-956fff4cfcde {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:31 devstack sudo[100179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747.fa563802-002f-4134-a588-956fff4cfcde
Jul 10 12:50:31 devstack sudo[100179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:32 devstack sudo[100175]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-42e613aa-cd5d-437b-8c1c-5c3b798cd83d tempest-CreateVolumesFromSourceVolumeTest-425015976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-d8109f74-d2a8-42ba-bb26-cde8bb604eae" returned: 0 in 0.721s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:32 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-42e613aa-cd5d-437b-8c1c-5c3b798cd83d tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "cinder-quobyte-d8109f74-d2a8-42ba-bb26-cde8bb604eae" released by "delete_volume" :: held 1.652s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:50:32 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-42e613aa-cd5d-437b-8c1c-5c3b798cd83d tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Created reservations ['8e087ec4-b3cb-4459-acb8-2a051571abe5', 'c6c0140f-05a0-422f-a7c6-6bd992e2dfe8', '7775d716-e8e3-42b5-8185-dce8133b26c8', '124b4720-b299-4031-a381-145e29cdb350'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:50:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-42e613aa-cd5d-437b-8c1c-5c3b798cd83d tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:50:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-42e613aa-cd5d-437b-8c1c-5c3b798cd83d tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:50:32 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-42e613aa-cd5d-437b-8c1c-5c3b798cd83d tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:50:32 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-42e613aa-cd5d-437b-8c1c-5c3b798cd83d tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:50:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-42e613aa-cd5d-437b-8c1c-5c3b798cd83d tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:50:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-42e613aa-cd5d-437b-8c1c-5c3b798cd83d tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:32 devstack sudo[100186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:50:32 devstack sudo[100186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:32 devstack sudo[100177]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d5a156c7-4a9a-42ae-adfc-d21264468d15 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-500c88ae-4171-4bd9-ba9a-3abdf276be49" returned: 0 in 0.853s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d5a156c7-4a9a-42ae-adfc-d21264468d15 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-500c88ae-4171-4bd9-ba9a-3abdf276be49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-500c88ae-4171-4bd9-ba9a-3abdf276be49.ab250450-f8c0-49d0-b083-0ffe4c798045 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:32 devstack sudo[100188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-500c88ae-4171-4bd9-ba9a-3abdf276be49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-500c88ae-4171-4bd9-ba9a-3abdf276be49.ab250450-f8c0-49d0-b083-0ffe4c798045 1G
Jul 10 12:50:32 devstack sudo[100188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:32 devstack sudo[100179]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d0e05c2d-2e07-4ec1-b847-6bc28de57556 tempest-VolumesExtendTest-1635708943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747.fa563802-002f-4134-a588-956fff4cfcde" returned: 0 in 0.809s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:32 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-d0e05c2d-2e07-4ec1-b847-6bc28de57556 tempest-VolumesExtendTest-1635708943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:50:32 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[66357724-2fb6-46ba-8c36-7cebaabb8ab5]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:50:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d0e05c2d-2e07-4ec1-b847-6bc28de57556 tempest-VolumesExtendTest-1635708943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:32 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-6a52cd0d-dfa9-4118-b594-09c2103eea82 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Acquiring lock "cinder-fa65cb37-36c4-456a-8b0a-ebe29d607b09-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:50:32 devstack sudo[100193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747
Jul 10 12:50:32 devstack sudo[100193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:32 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-6a52cd0d-dfa9-4118-b594-09c2103eea82 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "cinder-fa65cb37-36c4-456a-8b0a-ebe29d607b09-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:50:32 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-6a52cd0d-dfa9-4118-b594-09c2103eea82 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Acquiring lock "cinder-quobyte-fa65cb37-36c4-456a-8b0a-ebe29d607b09" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:50:32 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-6a52cd0d-dfa9-4118-b594-09c2103eea82 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "cinder-quobyte-fa65cb37-36c4-456a-8b0a-ebe29d607b09" acquired by "delete_volume" :: waited 0.025s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:50:32 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6cf506-6f81-47cb-ab2e-0a10187a970b]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:50:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6a52cd0d-dfa9-4118-b594-09c2103eea82 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fa65cb37-36c4-456a-8b0a-ebe29d607b09 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:33 devstack sudo[100195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fa65cb37-36c4-456a-8b0a-ebe29d607b09
Jul 10 12:50:33 devstack sudo[100195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:33 devstack sudo[100186]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-42e613aa-cd5d-437b-8c1c-5c3b798cd83d tempest-CreateVolumesFromSourceVolumeTest-425015976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.803s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:33 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-42e613aa-cd5d-437b-8c1c-5c3b798cd83d tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:50:33 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-42e613aa-cd5d-437b-8c1c-5c3b798cd83d tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Deleted volume successfully.
Jul 10 12:50:33 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-42e613aa-cd5d-437b-8c1c-5c3b798cd83d tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "cinder-d8109f74-d2a8-42ba-bb26-cde8bb604eae-delete_volume" released by "delete_volume" :: held 2.692s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:50:33 devstack sudo[100188]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d5a156c7-4a9a-42ae-adfc-d21264468d15 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-500c88ae-4171-4bd9-ba9a-3abdf276be49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-500c88ae-4171-4bd9-ba9a-3abdf276be49.ab250450-f8c0-49d0-b083-0ffe4c798045 1G" returned: 0 in 0.918s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d5a156c7-4a9a-42ae-adfc-d21264468d15 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-500c88ae-4171-4bd9-ba9a-3abdf276be49 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-500c88ae-4171-4bd9-ba9a-3abdf276be49.ab250450-f8c0-49d0-b083-0ffe4c798045 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:33 devstack sudo[100202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-500c88ae-4171-4bd9-ba9a-3abdf276be49 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-500c88ae-4171-4bd9-ba9a-3abdf276be49.ab250450-f8c0-49d0-b083-0ffe4c798045
Jul 10 12:50:33 devstack sudo[100202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:33 devstack sudo[100193]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d0e05c2d-2e07-4ec1-b847-6bc28de57556 tempest-VolumesExtendTest-1635708943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747" returned: 0 in 0.906s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d0e05c2d-2e07-4ec1-b847-6bc28de57556 tempest-VolumesExtendTest-1635708943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747.fa563802-002f-4134-a588-956fff4cfcde {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:33 devstack sudo[100207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747.fa563802-002f-4134-a588-956fff4cfcde
Jul 10 12:50:33 devstack sudo[100207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:33 devstack sudo[100195]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6a52cd0d-dfa9-4118-b594-09c2103eea82 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fa65cb37-36c4-456a-8b0a-ebe29d607b09" returned: 0 in 0.898s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6a52cd0d-dfa9-4118-b594-09c2103eea82 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fa65cb37-36c4-456a-8b0a-ebe29d607b09 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:33 devstack sudo[100212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fa65cb37-36c4-456a-8b0a-ebe29d607b09
Jul 10 12:50:33 devstack sudo[100212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:34 devstack sudo[100202]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d5a156c7-4a9a-42ae-adfc-d21264468d15 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-500c88ae-4171-4bd9-ba9a-3abdf276be49 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-500c88ae-4171-4bd9-ba9a-3abdf276be49.ab250450-f8c0-49d0-b083-0ffe4c798045" returned: 0 in 0.739s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:34 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-d5a156c7-4a9a-42ae-adfc-d21264468d15 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-500c88ae-4171-4bd9-ba9a-3abdf276be49.ab250450-f8c0-49d0-b083-0ffe4c798045 is being set with open permissions: ugo+rw
Jul 10 12:50:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d5a156c7-4a9a-42ae-adfc-d21264468d15 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-500c88ae-4171-4bd9-ba9a-3abdf276be49.ab250450-f8c0-49d0-b083-0ffe4c798045 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:34 devstack sudo[100217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-500c88ae-4171-4bd9-ba9a-3abdf276be49.ab250450-f8c0-49d0-b083-0ffe4c798045
Jul 10 12:50:34 devstack sudo[100217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:34 devstack sudo[100207]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d0e05c2d-2e07-4ec1-b847-6bc28de57556 tempest-VolumesExtendTest-1635708943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747.fa563802-002f-4134-a588-956fff4cfcde" returned: 0 in 0.881s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d0e05c2d-2e07-4ec1-b847-6bc28de57556 tempest-VolumesExtendTest-1635708943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747.fa563802-002f-4134-a588-956fff4cfcde {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:34 devstack sudo[100223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747.fa563802-002f-4134-a588-956fff4cfcde
Jul 10 12:50:34 devstack sudo[100223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:34 devstack sudo[100212]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6a52cd0d-dfa9-4118-b594-09c2103eea82 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fa65cb37-36c4-456a-8b0a-ebe29d607b09" returned: 0 in 0.691s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:34 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-6a52cd0d-dfa9-4118-b594-09c2103eea82 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "cinder-quobyte-fa65cb37-36c4-456a-8b0a-ebe29d607b09" released by "delete_volume" :: held 1.642s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:50:34 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:SELECT=147,cinder:INSERT=56,cinder:UPDATE=203,cinder:DELETE=16 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:50:34 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:UPDATE=214,cinder:SELECT=167,cinder:INSERT=50,cinder:DELETE=17 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:50:34 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-6a52cd0d-dfa9-4118-b594-09c2103eea82 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Created reservations ['dcca0680-25f9-4125-951f-806cac573f7c', 'd2d44af6-d3cb-4c1a-95ec-4021f295b025', 'b583a1dc-3b8e-4423-bba4-8f6b30e2295a', 'e0bc4eed-fad2-4bae-8e84-d2eb0e5ec1de'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:50:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-6a52cd0d-dfa9-4118-b594-09c2103eea82 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:50:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-6a52cd0d-dfa9-4118-b594-09c2103eea82 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:50:34 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-6a52cd0d-dfa9-4118-b594-09c2103eea82 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:50:34 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-6a52cd0d-dfa9-4118-b594-09c2103eea82 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:50:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-6a52cd0d-dfa9-4118-b594-09c2103eea82 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:50:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6a52cd0d-dfa9-4118-b594-09c2103eea82 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:34 devstack sudo[100232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:50:34 devstack sudo[100232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:34 devstack sudo[100217]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d5a156c7-4a9a-42ae-adfc-d21264468d15 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-500c88ae-4171-4bd9-ba9a-3abdf276be49.ab250450-f8c0-49d0-b083-0ffe4c798045" returned: 0 in 0.689s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d5a156c7-4a9a-42ae-adfc-d21264468d15 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-500c88ae-4171-4bd9-ba9a-3abdf276be49.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:34 devstack sudo[100234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-500c88ae-4171-4bd9-ba9a-3abdf276be49.info
Jul 10 12:50:34 devstack sudo[100234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:35 devstack sudo[100223]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d0e05c2d-2e07-4ec1-b847-6bc28de57556 tempest-VolumesExtendTest-1635708943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747.fa563802-002f-4134-a588-956fff4cfcde" returned: 0 in 0.746s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:35 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-d0e05c2d-2e07-4ec1-b847-6bc28de57556 tempest-VolumesExtendTest-1635708943 None] Lock "cinder-quobyte-fa563802-002f-4134-a588-956fff4cfcde" released by "_delete_snapshot" :: held 3.482s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:50:35 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-d0e05c2d-2e07-4ec1-b847-6bc28de57556 tempest-VolumesExtendTest-1635708943 None] Lock "cinder-quobyte-5d3a909c-feec-4faf-8fb0-9fe12f18e747" released by "delete_snapshot" :: held 3.507s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:50:35 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-d0e05c2d-2e07-4ec1-b847-6bc28de57556 tempest-VolumesExtendTest-1635708943 None] Created reservations ['5f98e2b8-90f0-4c0d-9526-418857331975', '540ee40a-ea2a-4eb0-b3e8-5900fdae182e', '9748538b-96e3-4039-abec-374a0768f72c', 'cae46dba-c2bf-42ba-90af-493ca6ee346f'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:50:35 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-d0e05c2d-2e07-4ec1-b847-6bc28de57556 tempest-VolumesExtendTest-1635708943 None] Delete snapshot completed successfully.
Jul 10 12:50:35 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-d0e05c2d-2e07-4ec1-b847-6bc28de57556 tempest-VolumesExtendTest-1635708943 None] Lock "cinder-fa563802-002f-4134-a588-956fff4cfcde-delete_snapshot" released by "delete_snapshot" :: held 3.681s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:50:35 devstack sudo[100232]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6a52cd0d-dfa9-4118-b594-09c2103eea82 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.781s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:35 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-6a52cd0d-dfa9-4118-b594-09c2103eea82 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:50:35 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-6a52cd0d-dfa9-4118-b594-09c2103eea82 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Deleted volume successfully.
Jul 10 12:50:35 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-6a52cd0d-dfa9-4118-b594-09c2103eea82 tempest-CreateVolumesFromSourceVolumeTest-425015976 None] Lock "cinder-fa65cb37-36c4-456a-8b0a-ebe29d607b09-delete_volume" released by "delete_volume" :: held 2.711s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:50:35 devstack sudo[100234]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d5a156c7-4a9a-42ae-adfc-d21264468d15 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-500c88ae-4171-4bd9-ba9a-3abdf276be49.info" returned: 0 in 0.753s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:35 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-d5a156c7-4a9a-42ae-adfc-d21264468d15 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-500c88ae-4171-4bd9-ba9a-3abdf276be49.info is being set with open permissions: ugo+rw
Jul 10 12:50:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d5a156c7-4a9a-42ae-adfc-d21264468d15 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-500c88ae-4171-4bd9-ba9a-3abdf276be49.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:35 devstack sudo[100239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-500c88ae-4171-4bd9-ba9a-3abdf276be49.info
Jul 10 12:50:35 devstack sudo[100239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:36 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8de55172-227d-4d87-930e-8daad7302220 tempest-VolumesExtendTest-1635708943 None] Acquiring lock "cinder-5d3a909c-feec-4faf-8fb0-9fe12f18e747-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:50:36 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8de55172-227d-4d87-930e-8daad7302220 tempest-VolumesExtendTest-1635708943 None] Lock "cinder-5d3a909c-feec-4faf-8fb0-9fe12f18e747-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:50:36 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8de55172-227d-4d87-930e-8daad7302220 tempest-VolumesExtendTest-1635708943 None] Acquiring lock "cinder-quobyte-5d3a909c-feec-4faf-8fb0-9fe12f18e747" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:50:36 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8de55172-227d-4d87-930e-8daad7302220 tempest-VolumesExtendTest-1635708943 None] Lock "cinder-quobyte-5d3a909c-feec-4faf-8fb0-9fe12f18e747" acquired by "delete_volume" :: waited 0.016s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:50:36 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[1350be9f-a363-4915-a670-3e473c90801c]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:50:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8de55172-227d-4d87-930e-8daad7302220 tempest-VolumesExtendTest-1635708943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:36 devstack sudo[100239]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d5a156c7-4a9a-42ae-adfc-d21264468d15 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-500c88ae-4171-4bd9-ba9a-3abdf276be49.info" returned: 0 in 0.744s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:36 devstack sudo[100243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747
Jul 10 12:50:36 devstack sudo[100243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d5a156c7-4a9a-42ae-adfc-d21264468d15 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.798s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:50:36 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-d5a156c7-4a9a-42ae-adfc-d21264468d15 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Create snapshot completed successfully
Jul 10 12:50:37 devstack sudo[100243]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8de55172-227d-4d87-930e-8daad7302220 tempest-VolumesExtendTest-1635708943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747" returned: 0 in 0.837s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8de55172-227d-4d87-930e-8daad7302220 tempest-VolumesExtendTest-1635708943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:37 devstack sudo[100248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747
Jul 10 12:50:37 devstack sudo[100248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:37 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8d9aa145-6e6c-4237-b8fe-38a87ebdb585 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Acquiring lock "cinder-ab250450-f8c0-49d0-b083-0ffe4c798045-delete_snapshot" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:50:37 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8d9aa145-6e6c-4237-b8fe-38a87ebdb585 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Lock "cinder-ab250450-f8c0-49d0-b083-0ffe4c798045-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:50:37 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8d9aa145-6e6c-4237-b8fe-38a87ebdb585 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Acquiring lock "cinder-quobyte-500c88ae-4171-4bd9-ba9a-3abdf276be49" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:50:37 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8d9aa145-6e6c-4237-b8fe-38a87ebdb585 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Lock "cinder-quobyte-500c88ae-4171-4bd9-ba9a-3abdf276be49" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:50:37 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8d9aa145-6e6c-4237-b8fe-38a87ebdb585 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Acquiring lock "cinder-quobyte-ab250450-f8c0-49d0-b083-0ffe4c798045" by "_delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:50:37 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8d9aa145-6e6c-4237-b8fe-38a87ebdb585 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Lock "cinder-quobyte-ab250450-f8c0-49d0-b083-0ffe4c798045" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:50:37 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-8d9aa145-6e6c-4237-b8fe-38a87ebdb585 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Deleting offline snapshot ab250450-f8c0-49d0-b083-0ffe4c798045 of volume 500c88ae-4171-4bd9-ba9a-3abdf276be49 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 10 12:50:37 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-8d9aa145-6e6c-4237-b8fe-38a87ebdb585 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] snapshot_file for this snap is: volume-500c88ae-4171-4bd9-ba9a-3abdf276be49.ab250450-f8c0-49d0-b083-0ffe4c798045 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 10 12:50:37 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c07ce70-2dc7-488e-9c4d-b29497e197e3]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:50:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8d9aa145-6e6c-4237-b8fe-38a87ebdb585 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-500c88ae-4171-4bd9-ba9a-3abdf276be49.ab250450-f8c0-49d0-b083-0ffe4c798045 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:37 devstack sudo[100250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-500c88ae-4171-4bd9-ba9a-3abdf276be49.ab250450-f8c0-49d0-b083-0ffe4c798045
Jul 10 12:50:37 devstack sudo[100250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:37 devstack sudo[100248]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8de55172-227d-4d87-930e-8daad7302220 tempest-VolumesExtendTest-1635708943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d3a909c-feec-4faf-8fb0-9fe12f18e747" returned: 0 in 0.724s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:37 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8de55172-227d-4d87-930e-8daad7302220 tempest-VolumesExtendTest-1635708943 None] Lock "cinder-quobyte-5d3a909c-feec-4faf-8fb0-9fe12f18e747" released by "delete_volume" :: held 1.639s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:50:37 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-8de55172-227d-4d87-930e-8daad7302220 tempest-VolumesExtendTest-1635708943 None] Created reservations ['4008253c-6db4-497f-b9f4-0c6aff791d9a', '4a50dda8-dc64-4069-8da9-008f339aef9c', '8a0b2d65-f879-47d2-9022-5129b1f8f2a1', 'b3295479-d0b4-4bac-bd77-279ea8a2bc98'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:50:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-8de55172-227d-4d87-930e-8daad7302220 tempest-VolumesExtendTest-1635708943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:50:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-8de55172-227d-4d87-930e-8daad7302220 tempest-VolumesExtendTest-1635708943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:50:37 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-8de55172-227d-4d87-930e-8daad7302220 tempest-VolumesExtendTest-1635708943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:50:37 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-8de55172-227d-4d87-930e-8daad7302220 tempest-VolumesExtendTest-1635708943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:50:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-8de55172-227d-4d87-930e-8daad7302220 tempest-VolumesExtendTest-1635708943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:50:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8de55172-227d-4d87-930e-8daad7302220 tempest-VolumesExtendTest-1635708943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:38 devstack sudo[100253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:50:38 devstack sudo[100253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:38 devstack sudo[100250]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8d9aa145-6e6c-4237-b8fe-38a87ebdb585 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-500c88ae-4171-4bd9-ba9a-3abdf276be49.ab250450-f8c0-49d0-b083-0ffe4c798045" returned: 0 in 0.826s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:38 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-8d9aa145-6e6c-4237-b8fe-38a87ebdb585 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-500c88ae-4171-4bd9-ba9a-3abdf276be49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:50:38 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e9e609-34e8-427d-ae3e-7e89a4f5013d]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:50:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8d9aa145-6e6c-4237-b8fe-38a87ebdb585 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-500c88ae-4171-4bd9-ba9a-3abdf276be49 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:38 devstack sudo[100258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-500c88ae-4171-4bd9-ba9a-3abdf276be49
Jul 10 12:50:38 devstack sudo[100258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:38 devstack sudo[100253]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8de55172-227d-4d87-930e-8daad7302220 tempest-VolumesExtendTest-1635708943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.695s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:38 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-8de55172-227d-4d87-930e-8daad7302220 tempest-VolumesExtendTest-1635708943 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:50:38 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-8de55172-227d-4d87-930e-8daad7302220 tempest-VolumesExtendTest-1635708943 None] Deleted volume successfully.
Jul 10 12:50:38 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8de55172-227d-4d87-930e-8daad7302220 tempest-VolumesExtendTest-1635708943 None] Lock "cinder-5d3a909c-feec-4faf-8fb0-9fe12f18e747-delete_volume" released by "delete_volume" :: held 2.593s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:50:39 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-20cc490d-04b3-44a4-8154-db5aa814cc47 tempest-ProjectReaderTests-1342462369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:50:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-20cc490d-04b3-44a4-8154-db5aa814cc47 tempest-ProjectReaderTests-1342462369 None] Flow 'volume_create_manager' (26303e67-9bd5-4521-a04b-338b9631f60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:50:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-20cc490d-04b3-44a4-8154-db5aa814cc47 tempest-ProjectReaderTests-1342462369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31dcdfb5-d771-4135-9f07-b085228c242e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-20cc490d-04b3-44a4-8154-db5aa814cc47 tempest-ProjectReaderTests-1342462369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31dcdfb5-d771-4135-9f07-b085228c242e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:50:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-778441389',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad3840ce-27ad-4b40-ad01-e6c518844ff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a90c65edf5964ca79555fa35e94bbde9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:50:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:50:39Z,use_quota=True,user_id='6099091a69d44d3f9cc5385e04a5f84b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-20cc490d-04b3-44a4-8154-db5aa814cc47 tempest-ProjectReaderTests-1342462369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6acb109a-6dd0-4def-8a5c-fc009e366dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-20cc490d-04b3-44a4-8154-db5aa814cc47 tempest-ProjectReaderTests-1342462369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6acb109a-6dd0-4def-8a5c-fc009e366dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-20cc490d-04b3-44a4-8154-db5aa814cc47 tempest-ProjectReaderTests-1342462369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eab8ace0-caa4-4980-a1b0-84701675bc6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-20cc490d-04b3-44a4-8154-db5aa814cc47 tempest-ProjectReaderTests-1342462369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eab8ace0-caa4-4980-a1b0-84701675bc6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad3840ce-27ad-4b40-ad01-e6c518844ff0', 'volume_name': 'volume-ad3840ce-27ad-4b40-ad01-e6c518844ff0', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-20cc490d-04b3-44a4-8154-db5aa814cc47 tempest-ProjectReaderTests-1342462369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24b3dcaa-8875-459b-9ab7-069e4e7b1cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-20cc490d-04b3-44a4-8154-db5aa814cc47 tempest-ProjectReaderTests-1342462369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24b3dcaa-8875-459b-9ab7-069e4e7b1cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-20cc490d-04b3-44a4-8154-db5aa814cc47 tempest-ProjectReaderTests-1342462369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b081ed50-6232-4428-8d8f-32d43e6511dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:39 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-20cc490d-04b3-44a4-8154-db5aa814cc47 tempest-ProjectReaderTests-1342462369 None] Volume ad3840ce-27ad-4b40-ad01-e6c518844ff0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad3840ce-27ad-4b40-ad01-e6c518844ff0', 'volume_size': 1}
Jul 10 12:50:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-20cc490d-04b3-44a4-8154-db5aa814cc47 tempest-ProjectReaderTests-1342462369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:50:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-20cc490d-04b3-44a4-8154-db5aa814cc47 tempest-ProjectReaderTests-1342462369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:50:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-20cc490d-04b3-44a4-8154-db5aa814cc47 tempest-ProjectReaderTests-1342462369 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:50:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-778441389',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad3840ce-27ad-4b40-ad01-e6c518844ff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a90c65edf5964ca79555fa35e94bbde9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:50:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:50:39Z,use_quota=True,user_id='6099091a69d44d3f9cc5385e04a5f84b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:50:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-20cc490d-04b3-44a4-8154-db5aa814cc47 tempest-ProjectReaderTests-1342462369 None] Creating volume ad3840ce-27ad-4b40-ad01-e6c518844ff0 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:50:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-20cc490d-04b3-44a4-8154-db5aa814cc47 tempest-ProjectReaderTests-1342462369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:50:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-20cc490d-04b3-44a4-8154-db5aa814cc47 tempest-ProjectReaderTests-1342462369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:50:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-20cc490d-04b3-44a4-8154-db5aa814cc47 tempest-ProjectReaderTests-1342462369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:50:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-20cc490d-04b3-44a4-8154-db5aa814cc47 tempest-ProjectReaderTests-1342462369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:50:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-20cc490d-04b3-44a4-8154-db5aa814cc47 tempest-ProjectReaderTests-1342462369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:50:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-20cc490d-04b3-44a4-8154-db5aa814cc47 tempest-ProjectReaderTests-1342462369 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:50:39 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-20cc490d-04b3-44a4-8154-db5aa814cc47 tempest-ProjectReaderTests-1342462369 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:50:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-20cc490d-04b3-44a4-8154-db5aa814cc47 tempest-ProjectReaderTests-1342462369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ad3840ce-27ad-4b40-ad01-e6c518844ff0 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:39 devstack sudo[100265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ad3840ce-27ad-4b40-ad01-e6c518844ff0 1073741824
Jul 10 12:50:39 devstack sudo[100265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:39 devstack sudo[100258]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8d9aa145-6e6c-4237-b8fe-38a87ebdb585 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-500c88ae-4171-4bd9-ba9a-3abdf276be49" returned: 0 in 0.974s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8d9aa145-6e6c-4237-b8fe-38a87ebdb585 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-500c88ae-4171-4bd9-ba9a-3abdf276be49.ab250450-f8c0-49d0-b083-0ffe4c798045 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:39 devstack sudo[100267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-500c88ae-4171-4bd9-ba9a-3abdf276be49.ab250450-f8c0-49d0-b083-0ffe4c798045
Jul 10 12:50:39 devstack sudo[100267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:40 devstack sudo[100267]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8d9aa145-6e6c-4237-b8fe-38a87ebdb585 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-500c88ae-4171-4bd9-ba9a-3abdf276be49.ab250450-f8c0-49d0-b083-0ffe4c798045" returned: 0 in 0.822s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8d9aa145-6e6c-4237-b8fe-38a87ebdb585 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-500c88ae-4171-4bd9-ba9a-3abdf276be49.ab250450-f8c0-49d0-b083-0ffe4c798045 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:40 devstack sudo[100277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-500c88ae-4171-4bd9-ba9a-3abdf276be49.ab250450-f8c0-49d0-b083-0ffe4c798045
Jul 10 12:50:40 devstack sudo[100277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:40 devstack sudo[100265]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-20cc490d-04b3-44a4-8154-db5aa814cc47 tempest-ProjectReaderTests-1342462369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ad3840ce-27ad-4b40-ad01-e6c518844ff0 1073741824" returned: 0 in 0.949s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-20cc490d-04b3-44a4-8154-db5aa814cc47 tempest-ProjectReaderTests-1342462369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ad3840ce-27ad-4b40-ad01-e6c518844ff0 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:40 devstack sudo[100279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ad3840ce-27ad-4b40-ad01-e6c518844ff0
Jul 10 12:50:40 devstack sudo[100279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:40 devstack sudo[100277]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8d9aa145-6e6c-4237-b8fe-38a87ebdb585 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-500c88ae-4171-4bd9-ba9a-3abdf276be49.ab250450-f8c0-49d0-b083-0ffe4c798045" returned: 0 in 0.683s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:40 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8d9aa145-6e6c-4237-b8fe-38a87ebdb585 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Lock "cinder-quobyte-ab250450-f8c0-49d0-b083-0ffe4c798045" released by "_delete_snapshot" :: held 3.462s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:50:40 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8d9aa145-6e6c-4237-b8fe-38a87ebdb585 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Lock "cinder-quobyte-500c88ae-4171-4bd9-ba9a-3abdf276be49" released by "delete_snapshot" :: held 3.488s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:50:40 devstack sudo[100279]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-20cc490d-04b3-44a4-8154-db5aa814cc47 tempest-ProjectReaderTests-1342462369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ad3840ce-27ad-4b40-ad01-e6c518844ff0" returned: 0 in 0.681s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:40 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-20cc490d-04b3-44a4-8154-db5aa814cc47 tempest-ProjectReaderTests-1342462369 None] <== create_volume: return (1678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:50:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-20cc490d-04b3-44a4-8154-db5aa814cc47 tempest-ProjectReaderTests-1342462369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.680s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:50:40 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-20cc490d-04b3-44a4-8154-db5aa814cc47 tempest-ProjectReaderTests-1342462369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b081ed50-6232-4428-8d8f-32d43e6511dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad3840ce-27ad-4b40-ad01-e6c518844ff0', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:40 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-20cc490d-04b3-44a4-8154-db5aa814cc47 tempest-ProjectReaderTests-1342462369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (593490c1-01cc-4abf-8517-68a93e6874c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:40 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-20cc490d-04b3-44a4-8154-db5aa814cc47 tempest-ProjectReaderTests-1342462369 None] Volume volume-ad3840ce-27ad-4b40-ad01-e6c518844ff0 (ad3840ce-27ad-4b40-ad01-e6c518844ff0): created successfully
Jul 10 12:50:40 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-20cc490d-04b3-44a4-8154-db5aa814cc47 tempest-ProjectReaderTests-1342462369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (593490c1-01cc-4abf-8517-68a93e6874c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:40 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-20cc490d-04b3-44a4-8154-db5aa814cc47 tempest-ProjectReaderTests-1342462369 None] Flow 'volume_create_manager' (26303e67-9bd5-4521-a04b-338b9631f60b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:50:40 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-20cc490d-04b3-44a4-8154-db5aa814cc47 tempest-ProjectReaderTests-1342462369 None] Created volume successfully.
Jul 10 12:50:40 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-8d9aa145-6e6c-4237-b8fe-38a87ebdb585 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Created reservations ['5f838c33-f849-4d86-842a-8f774e7924af', 'bdf83d9b-6462-4ae0-9764-5a92607f0e66', 'd03a884d-268c-48c9-88bc-5f974447a8b2', 'd3a6037b-050e-4d96-b52a-58dc42e5bd6a'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:50:41 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-8d9aa145-6e6c-4237-b8fe-38a87ebdb585 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Delete snapshot completed successfully.
Jul 10 12:50:41 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8d9aa145-6e6c-4237-b8fe-38a87ebdb585 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Lock "cinder-ab250450-f8c0-49d0-b083-0ffe4c798045-delete_snapshot" released by "delete_snapshot" :: held 3.697s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:50:41 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9385381b-1451-475f-9d98-46ea62e37d60 tempest-ProjectReaderTests-1342462369 None] Acquiring lock "cinder-ad3840ce-27ad-4b40-ad01-e6c518844ff0-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:50:41 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9385381b-1451-475f-9d98-46ea62e37d60 tempest-ProjectReaderTests-1342462369 None] Lock "cinder-ad3840ce-27ad-4b40-ad01-e6c518844ff0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:50:41 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-24fcf0fa-44d4-4744-ad5a-d886ff023658 tempest-VolumesGetTest-712653248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:50:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-24fcf0fa-44d4-4744-ad5a-d886ff023658 tempest-VolumesGetTest-712653248 None] Flow 'volume_create_manager' (22435293-8389-456a-a502-045c0d9439f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:50:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-24fcf0fa-44d4-4744-ad5a-d886ff023658 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4765b83f-a748-4a78-b969-4e856aa19801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-24fcf0fa-44d4-4744-ad5a-d886ff023658 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4765b83f-a748-4a78-b969-4e856aa19801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-254903836',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0f2a14a-0385-45e9-8c9e-f9664f35130c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='94859412ce094e45ae424b684b73d5b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:50:41Z,use_quota=True,user_id='fdd7b612fdb047f7908e44fa9926ecd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-24fcf0fa-44d4-4744-ad5a-d886ff023658 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fd68a3a-34b3-4b33-8ea6-d6ca5dbcac4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-24fcf0fa-44d4-4744-ad5a-d886ff023658 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fd68a3a-34b3-4b33-8ea6-d6ca5dbcac4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-24fcf0fa-44d4-4744-ad5a-d886ff023658 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e18add9e-27a8-4157-9cab-65d86b71e92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-24fcf0fa-44d4-4744-ad5a-d886ff023658 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e18add9e-27a8-4157-9cab-65d86b71e92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0f2a14a-0385-45e9-8c9e-f9664f35130c', 'volume_name': 'volume-f0f2a14a-0385-45e9-8c9e-f9664f35130c', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-24fcf0fa-44d4-4744-ad5a-d886ff023658 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3860df2-e1ff-4d84-b7b3-3203dc29b89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-24fcf0fa-44d4-4744-ad5a-d886ff023658 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3860df2-e1ff-4d84-b7b3-3203dc29b89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-24fcf0fa-44d4-4744-ad5a-d886ff023658 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6fec4d0-1376-4e51-a790-c177c73ac7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:41 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-24fcf0fa-44d4-4744-ad5a-d886ff023658 tempest-VolumesGetTest-712653248 None] Volume f0f2a14a-0385-45e9-8c9e-f9664f35130c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0f2a14a-0385-45e9-8c9e-f9664f35130c', 'volume_size': 1}
Jul 10 12:50:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-24fcf0fa-44d4-4744-ad5a-d886ff023658 tempest-VolumesGetTest-712653248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:50:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-24fcf0fa-44d4-4744-ad5a-d886ff023658 tempest-VolumesGetTest-712653248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:50:41 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-24fcf0fa-44d4-4744-ad5a-d886ff023658 tempest-VolumesGetTest-712653248 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-254903836',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0f2a14a-0385-45e9-8c9e-f9664f35130c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='94859412ce094e45ae424b684b73d5b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:50:41Z,use_quota=True,user_id='fdd7b612fdb047f7908e44fa9926ecd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:50:41 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-24fcf0fa-44d4-4744-ad5a-d886ff023658 tempest-VolumesGetTest-712653248 None] Creating volume f0f2a14a-0385-45e9-8c9e-f9664f35130c {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:50:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-24fcf0fa-44d4-4744-ad5a-d886ff023658 tempest-VolumesGetTest-712653248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:50:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-24fcf0fa-44d4-4744-ad5a-d886ff023658 tempest-VolumesGetTest-712653248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:50:41 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-24fcf0fa-44d4-4744-ad5a-d886ff023658 tempest-VolumesGetTest-712653248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:50:41 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-24fcf0fa-44d4-4744-ad5a-d886ff023658 tempest-VolumesGetTest-712653248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:50:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-24fcf0fa-44d4-4744-ad5a-d886ff023658 tempest-VolumesGetTest-712653248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:50:41 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-24fcf0fa-44d4-4744-ad5a-d886ff023658 tempest-VolumesGetTest-712653248 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:50:41 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-24fcf0fa-44d4-4744-ad5a-d886ff023658 tempest-VolumesGetTest-712653248 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:50:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-24fcf0fa-44d4-4744-ad5a-d886ff023658 tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f0f2a14a-0385-45e9-8c9e-f9664f35130c 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:41 devstack sudo[100283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f0f2a14a-0385-45e9-8c9e-f9664f35130c 1073741824
Jul 10 12:50:41 devstack sudo[100283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:41 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9385381b-1451-475f-9d98-46ea62e37d60 tempest-ProjectReaderTests-1342462369 None] Acquiring lock "cinder-quobyte-ad3840ce-27ad-4b40-ad01-e6c518844ff0" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:50:41 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9385381b-1451-475f-9d98-46ea62e37d60 tempest-ProjectReaderTests-1342462369 None] Lock "cinder-quobyte-ad3840ce-27ad-4b40-ad01-e6c518844ff0" acquired by "delete_volume" :: waited 0.018s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:50:41 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[48916e42-be83-46ae-8d49-4b5c42543a10]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:50:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9385381b-1451-475f-9d98-46ea62e37d60 tempest-ProjectReaderTests-1342462369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ad3840ce-27ad-4b40-ad01-e6c518844ff0 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:41 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-680bb851-8c28-41ad-abe2-eccc954de371 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Acquiring lock "cinder-500c88ae-4171-4bd9-ba9a-3abdf276be49-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:50:41 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-680bb851-8c28-41ad-abe2-eccc954de371 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Lock "cinder-500c88ae-4171-4bd9-ba9a-3abdf276be49-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:50:41 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-680bb851-8c28-41ad-abe2-eccc954de371 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Acquiring lock "cinder-quobyte-500c88ae-4171-4bd9-ba9a-3abdf276be49" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:50:41 devstack sudo[100285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ad3840ce-27ad-4b40-ad01-e6c518844ff0
Jul 10 12:50:41 devstack sudo[100285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:41 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-680bb851-8c28-41ad-abe2-eccc954de371 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Lock "cinder-quobyte-500c88ae-4171-4bd9-ba9a-3abdf276be49" acquired by "delete_volume" :: waited 0.024s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:50:41 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ac7483-7e91-4e57-be15-bce24559a56e]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:50:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-680bb851-8c28-41ad-abe2-eccc954de371 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-500c88ae-4171-4bd9-ba9a-3abdf276be49 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:41 devstack sudo[100287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-500c88ae-4171-4bd9-ba9a-3abdf276be49
Jul 10 12:50:41 devstack sudo[100287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:42 devstack sudo[100283]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-24fcf0fa-44d4-4744-ad5a-d886ff023658 tempest-VolumesGetTest-712653248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f0f2a14a-0385-45e9-8c9e-f9664f35130c 1073741824" returned: 0 in 0.861s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-24fcf0fa-44d4-4744-ad5a-d886ff023658 tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f0f2a14a-0385-45e9-8c9e-f9664f35130c {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:42 devstack sudo[100296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f0f2a14a-0385-45e9-8c9e-f9664f35130c
Jul 10 12:50:42 devstack sudo[100296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:42 devstack sudo[100285]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9385381b-1451-475f-9d98-46ea62e37d60 tempest-ProjectReaderTests-1342462369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ad3840ce-27ad-4b40-ad01-e6c518844ff0" returned: 0 in 0.908s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9385381b-1451-475f-9d98-46ea62e37d60 tempest-ProjectReaderTests-1342462369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ad3840ce-27ad-4b40-ad01-e6c518844ff0 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:42 devstack sudo[100302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ad3840ce-27ad-4b40-ad01-e6c518844ff0
Jul 10 12:50:42 devstack sudo[100302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:42 devstack sudo[100287]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-680bb851-8c28-41ad-abe2-eccc954de371 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-500c88ae-4171-4bd9-ba9a-3abdf276be49" returned: 0 in 0.841s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-680bb851-8c28-41ad-abe2-eccc954de371 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-500c88ae-4171-4bd9-ba9a-3abdf276be49 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:42 devstack sudo[100304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-500c88ae-4171-4bd9-ba9a-3abdf276be49
Jul 10 12:50:42 devstack sudo[100304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:43 devstack sudo[100296]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-24fcf0fa-44d4-4744-ad5a-d886ff023658 tempest-VolumesGetTest-712653248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f0f2a14a-0385-45e9-8c9e-f9664f35130c" returned: 0 in 0.726s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:43 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-24fcf0fa-44d4-4744-ad5a-d886ff023658 tempest-VolumesGetTest-712653248 None] <== create_volume: return (1634ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:50:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-24fcf0fa-44d4-4744-ad5a-d886ff023658 tempest-VolumesGetTest-712653248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.636s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:50:43 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-24fcf0fa-44d4-4744-ad5a-d886ff023658 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6fec4d0-1376-4e51-a790-c177c73ac7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0f2a14a-0385-45e9-8c9e-f9664f35130c', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:43 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-24fcf0fa-44d4-4744-ad5a-d886ff023658 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2ab3ecd-ae34-41cc-ab25-029b660f61b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:43 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-24fcf0fa-44d4-4744-ad5a-d886ff023658 tempest-VolumesGetTest-712653248 None] Volume volume-f0f2a14a-0385-45e9-8c9e-f9664f35130c (f0f2a14a-0385-45e9-8c9e-f9664f35130c): created successfully
Jul 10 12:50:43 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-24fcf0fa-44d4-4744-ad5a-d886ff023658 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2ab3ecd-ae34-41cc-ab25-029b660f61b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:43 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-24fcf0fa-44d4-4744-ad5a-d886ff023658 tempest-VolumesGetTest-712653248 None] Flow 'volume_create_manager' (22435293-8389-456a-a502-045c0d9439f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:50:43 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-24fcf0fa-44d4-4744-ad5a-d886ff023658 tempest-VolumesGetTest-712653248 None] Created volume successfully.
Jul 10 12:50:43 devstack sudo[100302]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9385381b-1451-475f-9d98-46ea62e37d60 tempest-ProjectReaderTests-1342462369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ad3840ce-27ad-4b40-ad01-e6c518844ff0" returned: 0 in 0.708s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:43 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9385381b-1451-475f-9d98-46ea62e37d60 tempest-ProjectReaderTests-1342462369 None] Lock "cinder-quobyte-ad3840ce-27ad-4b40-ad01-e6c518844ff0" released by "delete_volume" :: held 1.661s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:50:43 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-9385381b-1451-475f-9d98-46ea62e37d60 tempest-ProjectReaderTests-1342462369 None] Created reservations ['69c1c2e1-39e7-4603-bccb-4e850d09c9fe', '304ff76b-bcd4-4c6a-907b-1cfd0e94d44a', '63ba0b79-feb6-4602-aa00-adfbbc0c72c7', 'f2d819ab-417e-4154-a996-5f638aeff1e4'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:50:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-9385381b-1451-475f-9d98-46ea62e37d60 tempest-ProjectReaderTests-1342462369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:50:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-9385381b-1451-475f-9d98-46ea62e37d60 tempest-ProjectReaderTests-1342462369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:50:43 devstack sudo[100304]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:43 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-9385381b-1451-475f-9d98-46ea62e37d60 tempest-ProjectReaderTests-1342462369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:50:43 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-9385381b-1451-475f-9d98-46ea62e37d60 tempest-ProjectReaderTests-1342462369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:50:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-9385381b-1451-475f-9d98-46ea62e37d60 tempest-ProjectReaderTests-1342462369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:50:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9385381b-1451-475f-9d98-46ea62e37d60 tempest-ProjectReaderTests-1342462369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-680bb851-8c28-41ad-abe2-eccc954de371 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-500c88ae-4171-4bd9-ba9a-3abdf276be49" returned: 0 in 0.701s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:43 devstack sudo[100309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:50:43 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-680bb851-8c28-41ad-abe2-eccc954de371 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Lock "cinder-quobyte-500c88ae-4171-4bd9-ba9a-3abdf276be49" released by "delete_volume" :: held 1.601s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:50:43 devstack sudo[100309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:43 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-680bb851-8c28-41ad-abe2-eccc954de371 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Created reservations ['a808b625-db49-4b09-b98c-bdbedfec7ac5', 'db4c19e3-18f2-441a-87fa-8ff54435aae3', '23800a2d-5cd6-480b-a7a8-cd454fb77745', 'cbd15141-0f11-48a8-bf1a-cc2f8da6af8b'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:50:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-680bb851-8c28-41ad-abe2-eccc954de371 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:50:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-680bb851-8c28-41ad-abe2-eccc954de371 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:50:43 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-680bb851-8c28-41ad-abe2-eccc954de371 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:50:43 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-680bb851-8c28-41ad-abe2-eccc954de371 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:50:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-680bb851-8c28-41ad-abe2-eccc954de371 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:50:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-680bb851-8c28-41ad-abe2-eccc954de371 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:43 devstack sudo[100311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:50:43 devstack sudo[100311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:44 devstack sudo[100311]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-680bb851-8c28-41ad-abe2-eccc954de371 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.779s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:44 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-680bb851-8c28-41ad-abe2-eccc954de371 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:50:44 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-680bb851-8c28-41ad-abe2-eccc954de371 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Deleted volume successfully.
Jul 10 12:50:44 devstack sudo[100309]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9385381b-1451-475f-9d98-46ea62e37d60 tempest-ProjectReaderTests-1342462369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.957s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:44 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-9385381b-1451-475f-9d98-46ea62e37d60 tempest-ProjectReaderTests-1342462369 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:50:44 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-9385381b-1451-475f-9d98-46ea62e37d60 tempest-ProjectReaderTests-1342462369 None] Deleted volume successfully.
Jul 10 12:50:44 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-680bb851-8c28-41ad-abe2-eccc954de371 tempest-VolumeSnapshotQuotasNegativeTestJSON-2017021126 None] Lock "cinder-500c88ae-4171-4bd9-ba9a-3abdf276be49-delete_volume" released by "delete_volume" :: held 2.614s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:50:44 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9385381b-1451-475f-9d98-46ea62e37d60 tempest-ProjectReaderTests-1342462369 None] Lock "cinder-ad3840ce-27ad-4b40-ad01-e6c518844ff0-delete_volume" released by "delete_volume" :: held 2.933s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:50:44 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f81b731-f72f-4529-9cf5-16e951044eba tempest-ProjectReaderTests-1342462369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:50:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0f81b731-f72f-4529-9cf5-16e951044eba tempest-ProjectReaderTests-1342462369 None] Flow 'volume_create_manager' (fdb05586-1e44-474f-ba60-1c6b127e076e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:50:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0f81b731-f72f-4529-9cf5-16e951044eba tempest-ProjectReaderTests-1342462369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76fcbf72-620b-45a3-81cd-d39ef61f2c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0f81b731-f72f-4529-9cf5-16e951044eba tempest-ProjectReaderTests-1342462369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76fcbf72-620b-45a3-81cd-d39ef61f2c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:50:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1899436508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56786c46-7ff2-4b4d-b616-da15519bb185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a90c65edf5964ca79555fa35e94bbde9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:50:44Z,use_quota=True,user_id='6099091a69d44d3f9cc5385e04a5f84b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0f81b731-f72f-4529-9cf5-16e951044eba tempest-ProjectReaderTests-1342462369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e1f8d9f-2139-4ef4-a39f-ba380a2d4ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0f81b731-f72f-4529-9cf5-16e951044eba tempest-ProjectReaderTests-1342462369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e1f8d9f-2139-4ef4-a39f-ba380a2d4ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0f81b731-f72f-4529-9cf5-16e951044eba tempest-ProjectReaderTests-1342462369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a21de41-61cf-4493-8f6c-ed54ba5178a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0f81b731-f72f-4529-9cf5-16e951044eba tempest-ProjectReaderTests-1342462369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a21de41-61cf-4493-8f6c-ed54ba5178a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56786c46-7ff2-4b4d-b616-da15519bb185', 'volume_name': 'volume-56786c46-7ff2-4b4d-b616-da15519bb185', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0f81b731-f72f-4529-9cf5-16e951044eba tempest-ProjectReaderTests-1342462369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ac1b290-0cb8-4134-8395-2d7479edc828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0f81b731-f72f-4529-9cf5-16e951044eba tempest-ProjectReaderTests-1342462369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ac1b290-0cb8-4134-8395-2d7479edc828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0f81b731-f72f-4529-9cf5-16e951044eba tempest-ProjectReaderTests-1342462369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2506352-64e1-4661-8b1e-dfb981340b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:44 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-0f81b731-f72f-4529-9cf5-16e951044eba tempest-ProjectReaderTests-1342462369 None] Volume 56786c46-7ff2-4b4d-b616-da15519bb185: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56786c46-7ff2-4b4d-b616-da15519bb185', 'volume_size': 1}
Jul 10 12:50:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0f81b731-f72f-4529-9cf5-16e951044eba tempest-ProjectReaderTests-1342462369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:50:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0f81b731-f72f-4529-9cf5-16e951044eba tempest-ProjectReaderTests-1342462369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:50:44 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-0f81b731-f72f-4529-9cf5-16e951044eba tempest-ProjectReaderTests-1342462369 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:50:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1899436508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56786c46-7ff2-4b4d-b616-da15519bb185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a90c65edf5964ca79555fa35e94bbde9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:50:44Z,use_quota=True,user_id='6099091a69d44d3f9cc5385e04a5f84b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:50:44 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-0f81b731-f72f-4529-9cf5-16e951044eba tempest-ProjectReaderTests-1342462369 None] Creating volume 56786c46-7ff2-4b4d-b616-da15519bb185 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:50:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0f81b731-f72f-4529-9cf5-16e951044eba tempest-ProjectReaderTests-1342462369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:50:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0f81b731-f72f-4529-9cf5-16e951044eba tempest-ProjectReaderTests-1342462369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:50:44 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-0f81b731-f72f-4529-9cf5-16e951044eba tempest-ProjectReaderTests-1342462369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:50:44 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-0f81b731-f72f-4529-9cf5-16e951044eba tempest-ProjectReaderTests-1342462369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:50:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0f81b731-f72f-4529-9cf5-16e951044eba tempest-ProjectReaderTests-1342462369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:50:44 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-0f81b731-f72f-4529-9cf5-16e951044eba tempest-ProjectReaderTests-1342462369 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:50:44 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-0f81b731-f72f-4529-9cf5-16e951044eba tempest-ProjectReaderTests-1342462369 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:50:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0f81b731-f72f-4529-9cf5-16e951044eba tempest-ProjectReaderTests-1342462369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-56786c46-7ff2-4b4d-b616-da15519bb185 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:44 devstack sudo[100315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-56786c46-7ff2-4b4d-b616-da15519bb185 1073741824
Jul 10 12:50:44 devstack sudo[100315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:44 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0e76c60-45dd-4b93-8406-c67fe9f90d9f tempest-VolumesGetTest-712653248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:50:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f0e76c60-45dd-4b93-8406-c67fe9f90d9f tempest-VolumesGetTest-712653248 None] Flow 'volume_create_manager' (1eefde60-fa7d-49aa-a921-0c3544b3dc97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:50:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f0e76c60-45dd-4b93-8406-c67fe9f90d9f tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc0ace07-5f6d-4db9-beec-758dda984ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f0e76c60-45dd-4b93-8406-c67fe9f90d9f tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc0ace07-5f6d-4db9-beec-758dda984ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:50:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1642109970',display_name='tempest-VolumesGetTest-Volume-1157067753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23017fa6-9ebf-4297-a8c2-4d94a1232456,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94859412ce094e45ae424b684b73d5b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:50:44Z,use_quota=True,user_id='fdd7b612fdb047f7908e44fa9926ecd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f0e76c60-45dd-4b93-8406-c67fe9f90d9f tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87de6953-1b12-4a04-a1af-7868155350c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f0e76c60-45dd-4b93-8406-c67fe9f90d9f tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87de6953-1b12-4a04-a1af-7868155350c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f0e76c60-45dd-4b93-8406-c67fe9f90d9f tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d19a4f82-36a3-4b5a-8f36-a51aab9d5516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f0e76c60-45dd-4b93-8406-c67fe9f90d9f tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d19a4f82-36a3-4b5a-8f36-a51aab9d5516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23017fa6-9ebf-4297-a8c2-4d94a1232456', 'volume_name': 'volume-23017fa6-9ebf-4297-a8c2-4d94a1232456', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f0e76c60-45dd-4b93-8406-c67fe9f90d9f tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4efa8da4-f1d3-4aef-b28b-118f5d0852c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f0e76c60-45dd-4b93-8406-c67fe9f90d9f tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4efa8da4-f1d3-4aef-b28b-118f5d0852c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f0e76c60-45dd-4b93-8406-c67fe9f90d9f tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a643a455-5f36-4f02-adce-0386c69c709d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:44 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-f0e76c60-45dd-4b93-8406-c67fe9f90d9f tempest-VolumesGetTest-712653248 None] Volume 23017fa6-9ebf-4297-a8c2-4d94a1232456: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23017fa6-9ebf-4297-a8c2-4d94a1232456', 'volume_size': 1}
Jul 10 12:50:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f0e76c60-45dd-4b93-8406-c67fe9f90d9f tempest-VolumesGetTest-712653248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:50:45 devstack sudo[100315]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0f81b731-f72f-4529-9cf5-16e951044eba tempest-ProjectReaderTests-1342462369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-56786c46-7ff2-4b4d-b616-da15519bb185 1073741824" returned: 0 in 0.922s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0f81b731-f72f-4529-9cf5-16e951044eba tempest-ProjectReaderTests-1342462369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-56786c46-7ff2-4b4d-b616-da15519bb185 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:45 devstack sudo[100321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-56786c46-7ff2-4b4d-b616-da15519bb185
Jul 10 12:50:45 devstack sudo[100321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:46 devstack sudo[100321]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0f81b731-f72f-4529-9cf5-16e951044eba tempest-ProjectReaderTests-1342462369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-56786c46-7ff2-4b4d-b616-da15519bb185" returned: 0 in 0.686s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:46 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-0f81b731-f72f-4529-9cf5-16e951044eba tempest-ProjectReaderTests-1342462369 None] <== create_volume: return (1650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:50:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0f81b731-f72f-4529-9cf5-16e951044eba tempest-ProjectReaderTests-1342462369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:50:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f0e76c60-45dd-4b93-8406-c67fe9f90d9f tempest-VolumesGetTest-712653248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.510s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:50:46 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-f0e76c60-45dd-4b93-8406-c67fe9f90d9f tempest-VolumesGetTest-712653248 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:50:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1642109970',display_name='tempest-VolumesGetTest-Volume-1157067753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23017fa6-9ebf-4297-a8c2-4d94a1232456,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94859412ce094e45ae424b684b73d5b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:50:44Z,use_quota=True,user_id='fdd7b612fdb047f7908e44fa9926ecd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:50:46 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-f0e76c60-45dd-4b93-8406-c67fe9f90d9f tempest-VolumesGetTest-712653248 None] Creating volume 23017fa6-9ebf-4297-a8c2-4d94a1232456 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:50:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f0e76c60-45dd-4b93-8406-c67fe9f90d9f tempest-VolumesGetTest-712653248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:50:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f0e76c60-45dd-4b93-8406-c67fe9f90d9f tempest-VolumesGetTest-712653248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:50:46 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-f0e76c60-45dd-4b93-8406-c67fe9f90d9f tempest-VolumesGetTest-712653248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:50:46 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-f0e76c60-45dd-4b93-8406-c67fe9f90d9f tempest-VolumesGetTest-712653248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:50:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f0e76c60-45dd-4b93-8406-c67fe9f90d9f tempest-VolumesGetTest-712653248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:50:46 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-f0e76c60-45dd-4b93-8406-c67fe9f90d9f tempest-VolumesGetTest-712653248 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:50:46 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-f0e76c60-45dd-4b93-8406-c67fe9f90d9f tempest-VolumesGetTest-712653248 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:50:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f0e76c60-45dd-4b93-8406-c67fe9f90d9f tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-23017fa6-9ebf-4297-a8c2-4d94a1232456 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:46 devstack sudo[100324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-23017fa6-9ebf-4297-a8c2-4d94a1232456 1073741824
Jul 10 12:50:46 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0f81b731-f72f-4529-9cf5-16e951044eba tempest-ProjectReaderTests-1342462369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2506352-64e1-4661-8b1e-dfb981340b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56786c46-7ff2-4b4d-b616-da15519bb185', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:46 devstack sudo[100324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:46 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0f81b731-f72f-4529-9cf5-16e951044eba tempest-ProjectReaderTests-1342462369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84022824-cdf3-4dba-9031-fcd49282d14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:46 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-0f81b731-f72f-4529-9cf5-16e951044eba tempest-ProjectReaderTests-1342462369 None] Volume volume-56786c46-7ff2-4b4d-b616-da15519bb185 (56786c46-7ff2-4b4d-b616-da15519bb185): created successfully
Jul 10 12:50:46 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0f81b731-f72f-4529-9cf5-16e951044eba tempest-ProjectReaderTests-1342462369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84022824-cdf3-4dba-9031-fcd49282d14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:46 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0f81b731-f72f-4529-9cf5-16e951044eba tempest-ProjectReaderTests-1342462369 None] Flow 'volume_create_manager' (fdb05586-1e44-474f-ba60-1c6b127e076e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:50:46 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-0f81b731-f72f-4529-9cf5-16e951044eba tempest-ProjectReaderTests-1342462369 None] Created volume successfully.
Jul 10 12:50:46 devstack sudo[100324]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f0e76c60-45dd-4b93-8406-c67fe9f90d9f tempest-VolumesGetTest-712653248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-23017fa6-9ebf-4297-a8c2-4d94a1232456 1073741824" returned: 0 in 0.910s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f0e76c60-45dd-4b93-8406-c67fe9f90d9f tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-23017fa6-9ebf-4297-a8c2-4d94a1232456 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:47 devstack sudo[100330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-23017fa6-9ebf-4297-a8c2-4d94a1232456
Jul 10 12:50:47 devstack sudo[100330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:47 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-0f3392c7-d688-439c-b1cb-38c31b62c189 tempest-ProjectReaderTests-1342462369 None] Acquiring lock "cinder-56786c46-7ff2-4b4d-b616-da15519bb185-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:50:47 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-0f3392c7-d688-439c-b1cb-38c31b62c189 tempest-ProjectReaderTests-1342462369 None] Lock "cinder-56786c46-7ff2-4b4d-b616-da15519bb185-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:50:47 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-0f3392c7-d688-439c-b1cb-38c31b62c189 tempest-ProjectReaderTests-1342462369 None] Acquiring lock "cinder-quobyte-56786c46-7ff2-4b4d-b616-da15519bb185" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:50:47 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-0f3392c7-d688-439c-b1cb-38c31b62c189 tempest-ProjectReaderTests-1342462369 None] Lock "cinder-quobyte-56786c46-7ff2-4b4d-b616-da15519bb185" acquired by "delete_volume" :: waited 0.026s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:50:47 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a60ac4d-0e4e-4717-abdc-dd3ce4085cde]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:50:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0f3392c7-d688-439c-b1cb-38c31b62c189 tempest-ProjectReaderTests-1342462369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-56786c46-7ff2-4b4d-b616-da15519bb185 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:47 devstack sudo[100332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-56786c46-7ff2-4b4d-b616-da15519bb185
Jul 10 12:50:47 devstack sudo[100332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:47 devstack sudo[100330]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f0e76c60-45dd-4b93-8406-c67fe9f90d9f tempest-VolumesGetTest-712653248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-23017fa6-9ebf-4297-a8c2-4d94a1232456" returned: 0 in 0.699s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:47 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-f0e76c60-45dd-4b93-8406-c67fe9f90d9f tempest-VolumesGetTest-712653248 None] <== create_volume: return (1653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:50:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f0e76c60-45dd-4b93-8406-c67fe9f90d9f tempest-VolumesGetTest-712653248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.656s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:50:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f0e76c60-45dd-4b93-8406-c67fe9f90d9f tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a643a455-5f36-4f02-adce-0386c69c709d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23017fa6-9ebf-4297-a8c2-4d94a1232456', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f0e76c60-45dd-4b93-8406-c67fe9f90d9f tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc27449d-735a-4b15-981d-d47ad3611dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:47 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-f0e76c60-45dd-4b93-8406-c67fe9f90d9f tempest-VolumesGetTest-712653248 None] Volume volume-23017fa6-9ebf-4297-a8c2-4d94a1232456 (23017fa6-9ebf-4297-a8c2-4d94a1232456): created successfully
Jul 10 12:50:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f0e76c60-45dd-4b93-8406-c67fe9f90d9f tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc27449d-735a-4b15-981d-d47ad3611dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f0e76c60-45dd-4b93-8406-c67fe9f90d9f tempest-VolumesGetTest-712653248 None] Flow 'volume_create_manager' (1eefde60-fa7d-49aa-a921-0c3544b3dc97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:50:47 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-f0e76c60-45dd-4b93-8406-c67fe9f90d9f tempest-VolumesGetTest-712653248 None] Created volume successfully.
Jul 10 12:50:48 devstack sudo[100332]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0f3392c7-d688-439c-b1cb-38c31b62c189 tempest-ProjectReaderTests-1342462369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-56786c46-7ff2-4b4d-b616-da15519bb185" returned: 0 in 0.770s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0f3392c7-d688-439c-b1cb-38c31b62c189 tempest-ProjectReaderTests-1342462369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-56786c46-7ff2-4b4d-b616-da15519bb185 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:48 devstack sudo[100338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-56786c46-7ff2-4b4d-b616-da15519bb185
Jul 10 12:50:48 devstack sudo[100338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:48 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-18359aba-9f6a-4bcb-a2ae-d452cd740580 tempest-VolumesGetTest-712653248 None] Acquiring lock "cinder-23017fa6-9ebf-4297-a8c2-4d94a1232456-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:50:48 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-18359aba-9f6a-4bcb-a2ae-d452cd740580 tempest-VolumesGetTest-712653248 None] Lock "cinder-23017fa6-9ebf-4297-a8c2-4d94a1232456-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:50:48 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-18359aba-9f6a-4bcb-a2ae-d452cd740580 tempest-VolumesGetTest-712653248 None] Acquiring lock "cinder-quobyte-23017fa6-9ebf-4297-a8c2-4d94a1232456" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:50:48 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-18359aba-9f6a-4bcb-a2ae-d452cd740580 tempest-VolumesGetTest-712653248 None] Lock "cinder-quobyte-23017fa6-9ebf-4297-a8c2-4d94a1232456" acquired by "delete_volume" :: waited 0.017s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:50:48 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b01f7c3-81f9-4993-aa5f-6e3f64c9f33a]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:50:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-18359aba-9f6a-4bcb-a2ae-d452cd740580 tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-23017fa6-9ebf-4297-a8c2-4d94a1232456 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:48 devstack sudo[100338]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0f3392c7-d688-439c-b1cb-38c31b62c189 tempest-ProjectReaderTests-1342462369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-56786c46-7ff2-4b4d-b616-da15519bb185" returned: 0 in 0.667s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:48 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-0f3392c7-d688-439c-b1cb-38c31b62c189 tempest-ProjectReaderTests-1342462369 None] Lock "cinder-quobyte-56786c46-7ff2-4b4d-b616-da15519bb185" released by "delete_volume" :: held 1.495s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:50:48 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-0f3392c7-d688-439c-b1cb-38c31b62c189 tempest-ProjectReaderTests-1342462369 None] Created reservations ['31d25ffe-8488-4b81-8639-65bc240b9081', 'de2ae057-045b-459c-aed9-e87eb9d5417d', '34b8de29-b76c-49dd-98f6-590dc2c1e0e4', 'dd7d4b64-c781-481e-99e6-a11754a67bfe'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:50:48 devstack sudo[100341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-23017fa6-9ebf-4297-a8c2-4d94a1232456
Jul 10 12:50:48 devstack sudo[100341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0f3392c7-d688-439c-b1cb-38c31b62c189 tempest-ProjectReaderTests-1342462369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:50:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0f3392c7-d688-439c-b1cb-38c31b62c189 tempest-ProjectReaderTests-1342462369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:50:49 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-0f3392c7-d688-439c-b1cb-38c31b62c189 tempest-ProjectReaderTests-1342462369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:50:49 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-0f3392c7-d688-439c-b1cb-38c31b62c189 tempest-ProjectReaderTests-1342462369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:50:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0f3392c7-d688-439c-b1cb-38c31b62c189 tempest-ProjectReaderTests-1342462369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:50:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0f3392c7-d688-439c-b1cb-38c31b62c189 tempest-ProjectReaderTests-1342462369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:49 devstack sudo[100344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:50:49 devstack sudo[100344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:49 devstack sudo[100341]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-18359aba-9f6a-4bcb-a2ae-d452cd740580 tempest-VolumesGetTest-712653248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-23017fa6-9ebf-4297-a8c2-4d94a1232456" returned: 0 in 0.906s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-18359aba-9f6a-4bcb-a2ae-d452cd740580 tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-23017fa6-9ebf-4297-a8c2-4d94a1232456 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:49 devstack sudo[100344]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0f3392c7-d688-439c-b1cb-38c31b62c189 tempest-ProjectReaderTests-1342462369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.715s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:49 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-0f3392c7-d688-439c-b1cb-38c31b62c189 tempest-ProjectReaderTests-1342462369 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:50:49 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-0f3392c7-d688-439c-b1cb-38c31b62c189 tempest-ProjectReaderTests-1342462369 None] Deleted volume successfully.
Jul 10 12:50:49 devstack sudo[100350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-23017fa6-9ebf-4297-a8c2-4d94a1232456
Jul 10 12:50:49 devstack sudo[100350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:49 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-0f3392c7-d688-439c-b1cb-38c31b62c189 tempest-ProjectReaderTests-1342462369 None] Lock "cinder-56786c46-7ff2-4b4d-b616-da15519bb185-delete_volume" released by "delete_volume" :: held 2.516s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:50:50 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf8c8e1d-8c7b-4a8a-b165-ba155f42dc97 tempest-VolumeTypesAccessTest-1533532036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:50:50 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bf8c8e1d-8c7b-4a8a-b165-ba155f42dc97 tempest-VolumeTypesAccessTest-1533532036 None] Flow 'volume_create_manager' (d9416570-1d5a-49f5-85cc-3042034f89ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:50:50 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bf8c8e1d-8c7b-4a8a-b165-ba155f42dc97 tempest-VolumeTypesAccessTest-1533532036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13314c09-2a94-4b5d-b405-a4794b1d5c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:50 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bf8c8e1d-8c7b-4a8a-b165-ba155f42dc97 tempest-VolumeTypesAccessTest-1533532036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13314c09-2a94-4b5d-b405-a4794b1d5c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1477956567',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0196dacc-ae71-49b4-b1ae-5945b2ef0743,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9369eae168384c229727c9df5823d7c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:50:50Z,use_quota=True,user_id='d8fb18b87af24674ac49189c3103204a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e04f85dc-4420-42d1-a0f7-bc5b8b9816c8),volume_type_id=e04f85dc-4420-42d1-a0f7-bc5b8b9816c8)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:50 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bf8c8e1d-8c7b-4a8a-b165-ba155f42dc97 tempest-VolumeTypesAccessTest-1533532036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d85beac0-cff8-49d1-b4bd-d2dcae455924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:50 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bf8c8e1d-8c7b-4a8a-b165-ba155f42dc97 tempest-VolumeTypesAccessTest-1533532036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d85beac0-cff8-49d1-b4bd-d2dcae455924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:50 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bf8c8e1d-8c7b-4a8a-b165-ba155f42dc97 tempest-VolumeTypesAccessTest-1533532036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2792c15-fb07-4dfb-82af-743e3273f115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:50 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bf8c8e1d-8c7b-4a8a-b165-ba155f42dc97 tempest-VolumeTypesAccessTest-1533532036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2792c15-fb07-4dfb-82af-743e3273f115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0196dacc-ae71-49b4-b1ae-5945b2ef0743', 'volume_name': 'volume-0196dacc-ae71-49b4-b1ae-5945b2ef0743', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:50 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bf8c8e1d-8c7b-4a8a-b165-ba155f42dc97 tempest-VolumeTypesAccessTest-1533532036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1407e26c-5ec1-413d-8443-d6076bffa9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:50 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bf8c8e1d-8c7b-4a8a-b165-ba155f42dc97 tempest-VolumeTypesAccessTest-1533532036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1407e26c-5ec1-413d-8443-d6076bffa9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:50 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bf8c8e1d-8c7b-4a8a-b165-ba155f42dc97 tempest-VolumeTypesAccessTest-1533532036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2f7c320-e140-4add-a3fa-d20e3cc7cf2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:50 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-bf8c8e1d-8c7b-4a8a-b165-ba155f42dc97 tempest-VolumeTypesAccessTest-1533532036 None] Volume 0196dacc-ae71-49b4-b1ae-5945b2ef0743: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0196dacc-ae71-49b4-b1ae-5945b2ef0743', 'volume_size': 1}
Jul 10 12:50:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-bf8c8e1d-8c7b-4a8a-b165-ba155f42dc97 tempest-VolumeTypesAccessTest-1533532036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:50:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-bf8c8e1d-8c7b-4a8a-b165-ba155f42dc97 tempest-VolumeTypesAccessTest-1533532036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:50:50 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-bf8c8e1d-8c7b-4a8a-b165-ba155f42dc97 tempest-VolumeTypesAccessTest-1533532036 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1477956567',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0196dacc-ae71-49b4-b1ae-5945b2ef0743,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9369eae168384c229727c9df5823d7c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:50:50Z,use_quota=True,user_id='d8fb18b87af24674ac49189c3103204a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e04f85dc-4420-42d1-a0f7-bc5b8b9816c8),volume_type_id=e04f85dc-4420-42d1-a0f7-bc5b8b9816c8)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:50:50 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-bf8c8e1d-8c7b-4a8a-b165-ba155f42dc97 tempest-VolumeTypesAccessTest-1533532036 None] Creating volume 0196dacc-ae71-49b4-b1ae-5945b2ef0743 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:50:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-bf8c8e1d-8c7b-4a8a-b165-ba155f42dc97 tempest-VolumeTypesAccessTest-1533532036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:50:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-bf8c8e1d-8c7b-4a8a-b165-ba155f42dc97 tempest-VolumeTypesAccessTest-1533532036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:50:50 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-bf8c8e1d-8c7b-4a8a-b165-ba155f42dc97 tempest-VolumeTypesAccessTest-1533532036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:50:50 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-bf8c8e1d-8c7b-4a8a-b165-ba155f42dc97 tempest-VolumeTypesAccessTest-1533532036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:50:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-bf8c8e1d-8c7b-4a8a-b165-ba155f42dc97 tempest-VolumeTypesAccessTest-1533532036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:50:50 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-bf8c8e1d-8c7b-4a8a-b165-ba155f42dc97 tempest-VolumeTypesAccessTest-1533532036 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:50:50 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-bf8c8e1d-8c7b-4a8a-b165-ba155f42dc97 tempest-VolumeTypesAccessTest-1533532036 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:50:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-bf8c8e1d-8c7b-4a8a-b165-ba155f42dc97 tempest-VolumeTypesAccessTest-1533532036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0196dacc-ae71-49b4-b1ae-5945b2ef0743 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:50 devstack sudo[100353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0196dacc-ae71-49b4-b1ae-5945b2ef0743 1073741824
Jul 10 12:50:50 devstack sudo[100353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:50 devstack sudo[100350]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-18359aba-9f6a-4bcb-a2ae-d452cd740580 tempest-VolumesGetTest-712653248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-23017fa6-9ebf-4297-a8c2-4d94a1232456" returned: 0 in 0.792s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:50 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-18359aba-9f6a-4bcb-a2ae-d452cd740580 tempest-VolumesGetTest-712653248 None] Lock "cinder-quobyte-23017fa6-9ebf-4297-a8c2-4d94a1232456" released by "delete_volume" :: held 1.772s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:50:50 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-18359aba-9f6a-4bcb-a2ae-d452cd740580 tempest-VolumesGetTest-712653248 None] Created reservations ['50e477dc-656b-4b29-8585-6ec3d6cb9847', 'eeb1ccad-c354-4080-aad6-4ed49de95332', '96b49a29-a001-4030-96d9-72b3304afb22', '839c499c-29c7-43e7-b0ea-88204deeacda'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:50:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-18359aba-9f6a-4bcb-a2ae-d452cd740580 tempest-VolumesGetTest-712653248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:50:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-18359aba-9f6a-4bcb-a2ae-d452cd740580 tempest-VolumesGetTest-712653248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:50:50 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-18359aba-9f6a-4bcb-a2ae-d452cd740580 tempest-VolumesGetTest-712653248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:50:50 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-18359aba-9f6a-4bcb-a2ae-d452cd740580 tempest-VolumesGetTest-712653248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:50:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-18359aba-9f6a-4bcb-a2ae-d452cd740580 tempest-VolumesGetTest-712653248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:50:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-18359aba-9f6a-4bcb-a2ae-d452cd740580 tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:50 devstack sudo[100355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:50:50 devstack sudo[100355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:51 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9f838aea-d90b-4976-a351-c690677d27a1 tempest-VolumesGetTest-712653248 None] Acquiring lock "cinder-f0f2a14a-0385-45e9-8c9e-f9664f35130c-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:50:51 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9f838aea-d90b-4976-a351-c690677d27a1 tempest-VolumesGetTest-712653248 None] Lock "cinder-f0f2a14a-0385-45e9-8c9e-f9664f35130c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:50:51 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9f838aea-d90b-4976-a351-c690677d27a1 tempest-VolumesGetTest-712653248 None] Acquiring lock "cinder-quobyte-f0f2a14a-0385-45e9-8c9e-f9664f35130c" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:50:51 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9f838aea-d90b-4976-a351-c690677d27a1 tempest-VolumesGetTest-712653248 None] Lock "cinder-quobyte-f0f2a14a-0385-45e9-8c9e-f9664f35130c" acquired by "delete_volume" :: waited 0.020s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:50:51 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50fc9f0-77f1-440f-94da-434611390b2c]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:50:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9f838aea-d90b-4976-a351-c690677d27a1 tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f0f2a14a-0385-45e9-8c9e-f9664f35130c {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:51 devstack sudo[100361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f0f2a14a-0385-45e9-8c9e-f9664f35130c
Jul 10 12:50:51 devstack sudo[100361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:51 devstack sudo[100353]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-bf8c8e1d-8c7b-4a8a-b165-ba155f42dc97 tempest-VolumeTypesAccessTest-1533532036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0196dacc-ae71-49b4-b1ae-5945b2ef0743 1073741824" returned: 0 in 0.983s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-bf8c8e1d-8c7b-4a8a-b165-ba155f42dc97 tempest-VolumeTypesAccessTest-1533532036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0196dacc-ae71-49b4-b1ae-5945b2ef0743 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:51 devstack sudo[100364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0196dacc-ae71-49b4-b1ae-5945b2ef0743
Jul 10 12:50:51 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:51 devstack sudo[100355]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-18359aba-9f6a-4bcb-a2ae-d452cd740580 tempest-VolumesGetTest-712653248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.809s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:51 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-18359aba-9f6a-4bcb-a2ae-d452cd740580 tempest-VolumesGetTest-712653248 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:50:51 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-18359aba-9f6a-4bcb-a2ae-d452cd740580 tempest-VolumesGetTest-712653248 None] Deleted volume successfully.
Jul 10 12:50:51 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-18359aba-9f6a-4bcb-a2ae-d452cd740580 tempest-VolumesGetTest-712653248 None] Lock "cinder-23017fa6-9ebf-4297-a8c2-4d94a1232456-delete_volume" released by "delete_volume" :: held 2.842s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:50:52 devstack sudo[100361]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9f838aea-d90b-4976-a351-c690677d27a1 tempest-VolumesGetTest-712653248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f0f2a14a-0385-45e9-8c9e-f9664f35130c" returned: 0 in 0.848s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9f838aea-d90b-4976-a351-c690677d27a1 tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f0f2a14a-0385-45e9-8c9e-f9664f35130c {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:52 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-bf8c8e1d-8c7b-4a8a-b165-ba155f42dc97 tempest-VolumeTypesAccessTest-1533532036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0196dacc-ae71-49b4-b1ae-5945b2ef0743" returned: 0 in 0.678s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:52 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-bf8c8e1d-8c7b-4a8a-b165-ba155f42dc97 tempest-VolumeTypesAccessTest-1533532036 None] <== create_volume: return (1718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:50:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-bf8c8e1d-8c7b-4a8a-b165-ba155f42dc97 tempest-VolumeTypesAccessTest-1533532036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.721s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:50:52 devstack sudo[100370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f0f2a14a-0385-45e9-8c9e-f9664f35130c
Jul 10 12:50:52 devstack sudo[100370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:52 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bf8c8e1d-8c7b-4a8a-b165-ba155f42dc97 tempest-VolumeTypesAccessTest-1533532036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2f7c320-e140-4add-a3fa-d20e3cc7cf2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0196dacc-ae71-49b4-b1ae-5945b2ef0743', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:52 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bf8c8e1d-8c7b-4a8a-b165-ba155f42dc97 tempest-VolumeTypesAccessTest-1533532036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be3969aa-f832-4343-8322-7bed6cf04273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:52 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-bf8c8e1d-8c7b-4a8a-b165-ba155f42dc97 tempest-VolumeTypesAccessTest-1533532036 None] Volume volume-0196dacc-ae71-49b4-b1ae-5945b2ef0743 (0196dacc-ae71-49b4-b1ae-5945b2ef0743): created successfully
Jul 10 12:50:52 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bf8c8e1d-8c7b-4a8a-b165-ba155f42dc97 tempest-VolumeTypesAccessTest-1533532036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be3969aa-f832-4343-8322-7bed6cf04273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:52 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-bf8c8e1d-8c7b-4a8a-b165-ba155f42dc97 tempest-VolumeTypesAccessTest-1533532036 None] Flow 'volume_create_manager' (d9416570-1d5a-49f5-85cc-3042034f89ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:50:52 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-bf8c8e1d-8c7b-4a8a-b165-ba155f42dc97 tempest-VolumeTypesAccessTest-1533532036 None] Created volume successfully.
Jul 10 12:50:52 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3ffbd691-f0bc-4046-b1da-cbedced1369e tempest-VolumeTypesAccessTest-1533532036 None] Acquiring lock "cinder-0196dacc-ae71-49b4-b1ae-5945b2ef0743-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:50:52 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3ffbd691-f0bc-4046-b1da-cbedced1369e tempest-VolumeTypesAccessTest-1533532036 None] Lock "cinder-0196dacc-ae71-49b4-b1ae-5945b2ef0743-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:50:52 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3ffbd691-f0bc-4046-b1da-cbedced1369e tempest-VolumeTypesAccessTest-1533532036 None] Acquiring lock "cinder-quobyte-0196dacc-ae71-49b4-b1ae-5945b2ef0743" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:50:52 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3ffbd691-f0bc-4046-b1da-cbedced1369e tempest-VolumeTypesAccessTest-1533532036 None] Lock "cinder-quobyte-0196dacc-ae71-49b4-b1ae-5945b2ef0743" acquired by "delete_volume" :: waited 0.017s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:50:52 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[9638eb42-8de4-47bf-80b9-1d213570adec]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:50:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3ffbd691-f0bc-4046-b1da-cbedced1369e tempest-VolumeTypesAccessTest-1533532036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0196dacc-ae71-49b4-b1ae-5945b2ef0743 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:52 devstack sudo[100372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0196dacc-ae71-49b4-b1ae-5945b2ef0743
Jul 10 12:50:52 devstack sudo[100372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:52 devstack sudo[100370]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9f838aea-d90b-4976-a351-c690677d27a1 tempest-VolumesGetTest-712653248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f0f2a14a-0385-45e9-8c9e-f9664f35130c" returned: 0 in 0.713s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:52 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9f838aea-d90b-4976-a351-c690677d27a1 tempest-VolumesGetTest-712653248 None] Lock "cinder-quobyte-f0f2a14a-0385-45e9-8c9e-f9664f35130c" released by "delete_volume" :: held 1.630s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:50:52 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-9f838aea-d90b-4976-a351-c690677d27a1 tempest-VolumesGetTest-712653248 None] Created reservations ['40b3ac5c-1fbe-45ca-a0ed-d30ea1ef994c', '7117a654-ba8a-4d92-b037-de6c84f8c615', '623a4c00-a15c-402e-ae04-663adce5376d', 'd701af4e-8de5-451e-af9c-e9514d14fe19'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:50:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-9f838aea-d90b-4976-a351-c690677d27a1 tempest-VolumesGetTest-712653248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:50:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-9f838aea-d90b-4976-a351-c690677d27a1 tempest-VolumesGetTest-712653248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:50:52 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-9f838aea-d90b-4976-a351-c690677d27a1 tempest-VolumesGetTest-712653248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:50:52 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-9f838aea-d90b-4976-a351-c690677d27a1 tempest-VolumesGetTest-712653248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:50:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-9f838aea-d90b-4976-a351-c690677d27a1 tempest-VolumesGetTest-712653248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:50:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9f838aea-d90b-4976-a351-c690677d27a1 tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:53 devstack sudo[100375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:50:53 devstack sudo[100375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:53 devstack sudo[100372]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3ffbd691-f0bc-4046-b1da-cbedced1369e tempest-VolumeTypesAccessTest-1533532036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0196dacc-ae71-49b4-b1ae-5945b2ef0743" returned: 0 in 0.909s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3ffbd691-f0bc-4046-b1da-cbedced1369e tempest-VolumeTypesAccessTest-1533532036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0196dacc-ae71-49b4-b1ae-5945b2ef0743 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:53 devstack sudo[100380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0196dacc-ae71-49b4-b1ae-5945b2ef0743
Jul 10 12:50:53 devstack sudo[100380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:53 devstack sudo[100375]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9f838aea-d90b-4976-a351-c690677d27a1 tempest-VolumesGetTest-712653248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.763s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:53 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-9f838aea-d90b-4976-a351-c690677d27a1 tempest-VolumesGetTest-712653248 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:50:53 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-9f838aea-d90b-4976-a351-c690677d27a1 tempest-VolumesGetTest-712653248 None] Deleted volume successfully.
Jul 10 12:50:53 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9f838aea-d90b-4976-a351-c690677d27a1 tempest-VolumesGetTest-712653248 None] Lock "cinder-f0f2a14a-0385-45e9-8c9e-f9664f35130c-delete_volume" released by "delete_volume" :: held 2.681s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:50:54 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1b6f573-9759-438f-a243-b8556c11bd0b tempest-VolumesGetTest-712653248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:50:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f1b6f573-9759-438f-a243-b8556c11bd0b tempest-VolumesGetTest-712653248 None] Flow 'volume_create_manager' (57f762a2-2f14-41cc-8b17-d2c4cefc92c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:50:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f1b6f573-9759-438f-a243-b8556c11bd0b tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a7893a4-73ee-421c-a327-a0a96f876226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f1b6f573-9759-438f-a243-b8556c11bd0b tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a7893a4-73ee-421c-a327-a0a96f876226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:50:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-867515113',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70339dc2-6688-4be3-8562-d0ee77fe14a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94859412ce094e45ae424b684b73d5b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:50:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:50:54Z,use_quota=True,user_id='fdd7b612fdb047f7908e44fa9926ecd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f1b6f573-9759-438f-a243-b8556c11bd0b tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2784c3b6-7b3d-4d34-8852-732a27b74d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f1b6f573-9759-438f-a243-b8556c11bd0b tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2784c3b6-7b3d-4d34-8852-732a27b74d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f1b6f573-9759-438f-a243-b8556c11bd0b tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e70f72de-6775-49cd-95b2-78accb0a7082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f1b6f573-9759-438f-a243-b8556c11bd0b tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e70f72de-6775-49cd-95b2-78accb0a7082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70339dc2-6688-4be3-8562-d0ee77fe14a9', 'volume_name': 'volume-70339dc2-6688-4be3-8562-d0ee77fe14a9', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f1b6f573-9759-438f-a243-b8556c11bd0b tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba97a076-fb0f-4648-b672-12468dcfe9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f1b6f573-9759-438f-a243-b8556c11bd0b tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba97a076-fb0f-4648-b672-12468dcfe9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f1b6f573-9759-438f-a243-b8556c11bd0b tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af236e7d-b160-47f2-8d79-4b34d91c0e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:54 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-f1b6f573-9759-438f-a243-b8556c11bd0b tempest-VolumesGetTest-712653248 None] Volume 70339dc2-6688-4be3-8562-d0ee77fe14a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70339dc2-6688-4be3-8562-d0ee77fe14a9', 'volume_size': 1}
Jul 10 12:50:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f1b6f573-9759-438f-a243-b8556c11bd0b tempest-VolumesGetTest-712653248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:50:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f1b6f573-9759-438f-a243-b8556c11bd0b tempest-VolumesGetTest-712653248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:50:54 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-f1b6f573-9759-438f-a243-b8556c11bd0b tempest-VolumesGetTest-712653248 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:50:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-867515113',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70339dc2-6688-4be3-8562-d0ee77fe14a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94859412ce094e45ae424b684b73d5b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:50:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:50:54Z,use_quota=True,user_id='fdd7b612fdb047f7908e44fa9926ecd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:50:54 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-f1b6f573-9759-438f-a243-b8556c11bd0b tempest-VolumesGetTest-712653248 None] Creating volume 70339dc2-6688-4be3-8562-d0ee77fe14a9 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:50:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f1b6f573-9759-438f-a243-b8556c11bd0b tempest-VolumesGetTest-712653248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:50:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f1b6f573-9759-438f-a243-b8556c11bd0b tempest-VolumesGetTest-712653248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:50:54 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-f1b6f573-9759-438f-a243-b8556c11bd0b tempest-VolumesGetTest-712653248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:50:54 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-f1b6f573-9759-438f-a243-b8556c11bd0b tempest-VolumesGetTest-712653248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:50:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f1b6f573-9759-438f-a243-b8556c11bd0b tempest-VolumesGetTest-712653248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:50:54 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-f1b6f573-9759-438f-a243-b8556c11bd0b tempest-VolumesGetTest-712653248 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:50:54 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-f1b6f573-9759-438f-a243-b8556c11bd0b tempest-VolumesGetTest-712653248 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:50:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f1b6f573-9759-438f-a243-b8556c11bd0b tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:54 devstack sudo[100383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9 1073741824
Jul 10 12:50:54 devstack sudo[100383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:54 devstack sudo[100380]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3ffbd691-f0bc-4046-b1da-cbedced1369e tempest-VolumeTypesAccessTest-1533532036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0196dacc-ae71-49b4-b1ae-5945b2ef0743" returned: 0 in 0.868s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:54 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3ffbd691-f0bc-4046-b1da-cbedced1369e tempest-VolumeTypesAccessTest-1533532036 None] Lock "cinder-quobyte-0196dacc-ae71-49b4-b1ae-5945b2ef0743" released by "delete_volume" :: held 1.829s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:50:54 devstack cinder-volume[87378]: WARNING cinder.quota [None req-3ffbd691-f0bc-4046-b1da-cbedced1369e tempest-VolumeTypesAccessTest-1533532036 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1763038616 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1763038616, it is now deprecated. Please use the default quota class for default quota.
Jul 10 12:50:54 devstack cinder-volume[87378]: WARNING cinder.quota [None req-3ffbd691-f0bc-4046-b1da-cbedced1369e tempest-VolumeTypesAccessTest-1533532036 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1763038616 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1763038616, it is now deprecated. Please use the default quota class for default quota.
Jul 10 12:50:54 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-3ffbd691-f0bc-4046-b1da-cbedced1369e tempest-VolumeTypesAccessTest-1533532036 None] Created reservations ['4cf542a1-a800-4a6f-aa0c-c6f68fb89f5c', '22d5d954-7bb7-4a2d-b301-21fef43e2eca', 'f0af55f5-40ac-476b-b64d-be90e5a7fbf4', '15355dea-bcb6-40e8-b62f-6f1b87f0aebb'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:50:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3ffbd691-f0bc-4046-b1da-cbedced1369e tempest-VolumeTypesAccessTest-1533532036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:50:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3ffbd691-f0bc-4046-b1da-cbedced1369e tempest-VolumeTypesAccessTest-1533532036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:50:54 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3ffbd691-f0bc-4046-b1da-cbedced1369e tempest-VolumeTypesAccessTest-1533532036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:50:54 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3ffbd691-f0bc-4046-b1da-cbedced1369e tempest-VolumeTypesAccessTest-1533532036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:50:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3ffbd691-f0bc-4046-b1da-cbedced1369e tempest-VolumeTypesAccessTest-1533532036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:50:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3ffbd691-f0bc-4046-b1da-cbedced1369e tempest-VolumeTypesAccessTest-1533532036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:54 devstack sudo[100386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:50:54 devstack sudo[100386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:55 devstack sudo[100383]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f1b6f573-9759-438f-a243-b8556c11bd0b tempest-VolumesGetTest-712653248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9 1073741824" returned: 0 in 1.021s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f1b6f573-9759-438f-a243-b8556c11bd0b tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:55 devstack sudo[100393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9
Jul 10 12:50:55 devstack sudo[100393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:55 devstack sudo[100386]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3ffbd691-f0bc-4046-b1da-cbedced1369e tempest-VolumeTypesAccessTest-1533532036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.782s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:55 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-3ffbd691-f0bc-4046-b1da-cbedced1369e tempest-VolumeTypesAccessTest-1533532036 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:50:55 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-3ffbd691-f0bc-4046-b1da-cbedced1369e tempest-VolumeTypesAccessTest-1533532036 None] Deleted volume successfully.
Jul 10 12:50:55 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3ffbd691-f0bc-4046-b1da-cbedced1369e tempest-VolumeTypesAccessTest-1533532036 None] Lock "cinder-0196dacc-ae71-49b4-b1ae-5945b2ef0743-delete_volume" released by "delete_volume" :: held 2.852s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:50:55 devstack sudo[100393]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f1b6f573-9759-438f-a243-b8556c11bd0b tempest-VolumesGetTest-712653248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9" returned: 0 in 0.683s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:55 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-f1b6f573-9759-438f-a243-b8556c11bd0b tempest-VolumesGetTest-712653248 None] <== create_volume: return (1756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:50:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f1b6f573-9759-438f-a243-b8556c11bd0b tempest-VolumesGetTest-712653248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.758s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:50:55 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f1b6f573-9759-438f-a243-b8556c11bd0b tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af236e7d-b160-47f2-8d79-4b34d91c0e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70339dc2-6688-4be3-8562-d0ee77fe14a9', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:55 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f1b6f573-9759-438f-a243-b8556c11bd0b tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68d817d4-e5a5-4280-a60f-6eca8d0a9fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:55 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-f1b6f573-9759-438f-a243-b8556c11bd0b tempest-VolumesGetTest-712653248 None] Volume volume-70339dc2-6688-4be3-8562-d0ee77fe14a9 (70339dc2-6688-4be3-8562-d0ee77fe14a9): created successfully
Jul 10 12:50:55 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f1b6f573-9759-438f-a243-b8556c11bd0b tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68d817d4-e5a5-4280-a60f-6eca8d0a9fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:55 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f1b6f573-9759-438f-a243-b8556c11bd0b tempest-VolumesGetTest-712653248 None] Flow 'volume_create_manager' (57f762a2-2f14-41cc-8b17-d2c4cefc92c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:50:55 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-f1b6f573-9759-438f-a243-b8556c11bd0b tempest-VolumesGetTest-712653248 None] Created volume successfully.
Jul 10 12:50:56 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:50:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Flow 'volume_create_manager' (f5415ec0-0d8e-4b9e-8df9-6021c4c4a6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:50:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (635ee922-23e9-40fc-9727-3344c30f4627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (635ee922-23e9-40fc-9727-3344c30f4627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:50:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-596518436',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57687ecc-bffd-46bc-b53b-53d6cb1e9a49,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='94859412ce094e45ae424b684b73d5b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:50:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=70339dc2-6688-4be3-8562-d0ee77fe14a9,status='creating',terminated_at=None,updated_at=2026-07-10T10:50:57Z,use_quota=True,user_id='fdd7b612fdb047f7908e44fa9926ecd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (622e9f2c-5eb0-43fc-a913-7a2d2d858818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (622e9f2c-5eb0-43fc-a913-7a2d2d858818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10379f45-409d-4f65-83ec-b33131e80681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10379f45-409d-4f65-83ec-b33131e80681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '57687ecc-bffd-46bc-b53b-53d6cb1e9a49', 'volume_name': 'volume-57687ecc-bffd-46bc-b53b-53d6cb1e9a49', 'volume_size': 1, 'source_volid': '70339dc2-6688-4be3-8562-d0ee77fe14a9', 'source_volstatus': 'available'}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14afb1df-d38b-4f23-b487-67f36ed111d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14afb1df-d38b-4f23-b487-67f36ed111d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:50:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (215421ce-a00d-43b2-b5c6-91da9c84662b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:50:56 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Volume 57687ecc-bffd-46bc-b53b-53d6cb1e9a49: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-57687ecc-bffd-46bc-b53b-53d6cb1e9a49', 'volume_size': 1, 'source_volid': '70339dc2-6688-4be3-8562-d0ee77fe14a9', 'source_volstatus': 'available'}
Jul 10 12:50:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:50:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:50:56 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Cloning volume 70339dc2-6688-4be3-8562-d0ee77fe14a9 to volume 57687ecc-bffd-46bc-b53b-53d6cb1e9a49
Jul 10 12:50:56 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Creating offline snapshot 8fd08a2d-5873-4812-ac34-772b0d4eb43d of volume 70339dc2-6688-4be3-8562-d0ee77fe14a9 {{(pid=87378) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 10 12:50:56 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d16e93-d9a8-43d9-b1e9-4e8271c8c5e1]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:50:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:57 devstack sudo[100397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9
Jul 10 12:50:57 devstack sudo[100397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:57 devstack sudo[100397]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9" returned: 0 in 0.852s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9.8fd08a2d-5873-4812-ac34-772b0d4eb43d 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:57 devstack sudo[100402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9.8fd08a2d-5873-4812-ac34-772b0d4eb43d 1G
Jul 10 12:50:57 devstack sudo[100402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:58 devstack sudo[100402]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9.8fd08a2d-5873-4812-ac34-772b0d4eb43d 1G" returned: 0 in 0.979s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70339dc2-6688-4be3-8562-d0ee77fe14a9 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9.8fd08a2d-5873-4812-ac34-772b0d4eb43d {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:58 devstack sudo[100408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70339dc2-6688-4be3-8562-d0ee77fe14a9 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9.8fd08a2d-5873-4812-ac34-772b0d4eb43d
Jul 10 12:50:58 devstack sudo[100408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:50:59 devstack sudo[100408]: pam_unix(sudo:session): session closed for user root
Jul 10 12:50:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70339dc2-6688-4be3-8562-d0ee77fe14a9 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9.8fd08a2d-5873-4812-ac34-772b0d4eb43d" returned: 0 in 0.859s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:50:59 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9.8fd08a2d-5873-4812-ac34-772b0d4eb43d is being set with open permissions: ugo+rw
Jul 10 12:50:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9.8fd08a2d-5873-4812-ac34-772b0d4eb43d {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:50:59 devstack sudo[100418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9.8fd08a2d-5873-4812-ac34-772b0d4eb43d
Jul 10 12:50:59 devstack sudo[100418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:00 devstack sudo[100418]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9.8fd08a2d-5873-4812-ac34-772b0d4eb43d" returned: 0 in 0.701s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:00 devstack sudo[100421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9.info
Jul 10 12:51:00 devstack sudo[100421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:01 devstack sudo[100421]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9.info" returned: 0 in 0.718s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:01 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9.info is being set with open permissions: ugo+rw
Jul 10 12:51:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:01 devstack sudo[100424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9.info
Jul 10 12:51:01 devstack sudo[100424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:01 devstack sudo[100424]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9.info" returned: 0 in 0.730s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:01 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Acquiring lock "cinder-quobyte-57687ecc-bffd-46bc-b53b-53d6cb1e9a49" by "_copy_volume_from_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:51:01 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Lock "cinder-quobyte-57687ecc-bffd-46bc-b53b-53d6cb1e9a49" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:51:01 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] snapshot: 8fd08a2d-5873-4812-ac34-772b0d4eb43d, volume: 57687ecc-bffd-46bc-b53b-53d6cb1e9a49,  {{(pid=87378) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 10 12:51:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:51:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:51:01 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:51:01 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:51:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:51:01 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[1154c584-dfea-4ac8-80f3-23c9683a0db9]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:51:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9.8fd08a2d-5873-4812-ac34-772b0d4eb43d {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:02 devstack sudo[100427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9.8fd08a2d-5873-4812-ac34-772b0d4eb43d
Jul 10 12:51:02 devstack sudo[100427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:02 devstack sudo[100427]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9.8fd08a2d-5873-4812-ac34-772b0d4eb43d" returned: 0 in 0.811s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:02 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70339dc2-6688-4be3-8562-d0ee77fe14a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:51:02 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] will copy from snapshot at /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9 {{(pid=87378) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 10 12:51:02 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Creating direct copy from snapshot {{(pid=87378) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 10 12:51:02 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[233bf6ee-ce2a-41ec-9c23-dacb1e7a14b7]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:51:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:02 devstack sudo[100432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9
Jul 10 12:51:02 devstack sudo[100432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:03 devstack sudo[100432]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9" returned: 0 in 1.057s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:03 devstack cinder-volume[87378]: DEBUG cinder.utils [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Path /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57687ecc-bffd-46bc-b53b-53d6cb1e9a49 not found in is_blk_device check {{(pid=87378) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 10 12:51:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57687ecc-bffd-46bc-b53b-53d6cb1e9a49 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:03 devstack sudo[100437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57687ecc-bffd-46bc-b53b-53d6cb1e9a49
Jul 10 12:51:03 devstack sudo[100437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:09 devstack sudo[100437]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57687ecc-bffd-46bc-b53b-53d6cb1e9a49" returned: 0 in 6.012s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:09 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab014953-d6c1-43d1-935b-7308e9be682f]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:51:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:09 devstack sudo[100450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9
Jul 10 12:51:09 devstack sudo[100450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:10 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:UPDATE=91,cinder:SELECT=71,cinder:INSERT=20,cinder:DELETE=9 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:51:10 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:SELECT=64,cinder:INSERT=29,cinder:UPDATE=98,cinder:DELETE=6 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:51:10 devstack sudo[100450]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9" returned: 0 in 1.074s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:10 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Image conversion details: src /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9, size 1024.00 MB, duration 6.01 sec, destination /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57687ecc-bffd-46bc-b53b-53d6cb1e9a49 {{(pid=87378) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 10 12:51:10 devstack cinder-volume[87378]: INFO cinder.image.image_utils [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Converted 1024.00 MB image at 170.29 MB/s
Jul 10 12:51:10 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57687ecc-bffd-46bc-b53b-53d6cb1e9a49 is being set with open permissions: ugo+rw
Jul 10 12:51:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57687ecc-bffd-46bc-b53b-53d6cb1e9a49 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:10 devstack sudo[100456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57687ecc-bffd-46bc-b53b-53d6cb1e9a49
Jul 10 12:51:10 devstack sudo[100456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:11 devstack sudo[100456]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57687ecc-bffd-46bc-b53b-53d6cb1e9a49" returned: 0 in 0.705s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:11 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Lock "cinder-quobyte-57687ecc-bffd-46bc-b53b-53d6cb1e9a49" released by "_copy_volume_from_snapshot" :: held 9.795s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:51:11 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Acquiring lock "cinder-quobyte-8fd08a2d-5873-4812-ac34-772b0d4eb43d" by "_delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:51:11 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Lock "cinder-quobyte-8fd08a2d-5873-4812-ac34-772b0d4eb43d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:51:11 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Deleting offline snapshot 8fd08a2d-5873-4812-ac34-772b0d4eb43d of volume 70339dc2-6688-4be3-8562-d0ee77fe14a9 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 10 12:51:11 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] snapshot_file for this snap is: volume-70339dc2-6688-4be3-8562-d0ee77fe14a9.8fd08a2d-5873-4812-ac34-772b0d4eb43d {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 10 12:51:11 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e1d533-503c-47db-9bc6-69abaf3d8645]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:51:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9.8fd08a2d-5873-4812-ac34-772b0d4eb43d {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:11 devstack sudo[100460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9.8fd08a2d-5873-4812-ac34-772b0d4eb43d
Jul 10 12:51:11 devstack sudo[100460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:12 devstack sudo[100460]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9.8fd08a2d-5873-4812-ac34-772b0d4eb43d" returned: 0 in 0.989s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70339dc2-6688-4be3-8562-d0ee77fe14a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:51:12 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b450e876-c966-403a-8ccf-254724288cf8]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:51:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:12 devstack sudo[100465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9
Jul 10 12:51:12 devstack sudo[100465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:12 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:51:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:51:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:51:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:51:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:51:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:51:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:13 devstack sudo[100467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:51:13 devstack sudo[100467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:13 devstack sudo[100465]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9" returned: 0 in 0.867s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9.8fd08a2d-5873-4812-ac34-772b0d4eb43d {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:13 devstack sudo[100472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9.8fd08a2d-5873-4812-ac34-772b0d4eb43d
Jul 10 12:51:13 devstack sudo[100472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:13 devstack sudo[100467]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.858s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:13 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:51:13 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager._thread_info {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:51:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread count: 28 {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 10 12:51:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread info: [<_MainThread(MainThread, started 128233544536192)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128233445424704)>, <Thread(Thread-3 (stat_writer), started daemon 128233435118528)>, <Thread(Rabbit-heartbeat, started daemon 128233435718016)>, <Thread(Thread-5 (_runner), started daemon 128233432624448)>, <Thread(Thread-7 (_runner), started daemon 128233432674688)>, <Thread(fd_logger, started daemon 128233428569472)>, <Thread(privsep_reader, started daemon 128233429417088)>, <Thread(tpool_thread_0, started daemon 128233421182656)>, <Thread(tpool_thread_1, started daemon 128233412789952)>, <Thread(tpool_thread_2, started daemon 128233404397248)>, <Thread(tpool_thread_3, started daemon 128233396004544)>, <Thread(tpool_thread_4, started daemon 128233387611840)>, <Thread(tpool_thread_5, started daemon 128233379219136)>, <Thread(tpool_thread_6, started daemon 128233370826432)>, <Thread(tpool_thread_7, started daemon 128233362433728)>, <Thread(tpool_thread_8, started daemon 128233354041024)>, <Thread(tpool_thread_9, started daemon 128233345631936)>, <Thread(tpool_thread_10, started daemon 128233337222848)>, <Thread(tpool_thread_11, started daemon 128233328813760)>, <Thread(tpool_thread_12, started daemon 128233320404672)>, <Thread(tpool_thread_13, started daemon 128233311995584)>, <Thread(tpool_thread_14, started daemon 128233303586496)>, <Thread(tpool_thread_15, started daemon 128233295177408)>, <Thread(tpool_thread_16, started daemon 128233286768320)>, <Thread(tpool_thread_17, started daemon 128233278359232)>, <Thread(tpool_thread_18, started daemon 128233269950144)>, <Thread(tpool_thread_19, started daemon 128233261541056)>] {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 10 12:51:14 devstack sudo[100472]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9.8fd08a2d-5873-4812-ac34-772b0d4eb43d" returned: 0 in 0.911s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9.8fd08a2d-5873-4812-ac34-772b0d4eb43d {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:14 devstack sudo[100478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9.8fd08a2d-5873-4812-ac34-772b0d4eb43d
Jul 10 12:51:14 devstack sudo[100478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:15 devstack sudo[100478]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9.8fd08a2d-5873-4812-ac34-772b0d4eb43d" returned: 0 in 0.751s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:15 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Lock "cinder-quobyte-8fd08a2d-5873-4812-ac34-772b0d4eb43d" released by "_delete_snapshot" :: held 3.662s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:51:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.538s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:51:15 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (215421ce-a00d-43b2-b5c6-91da9c84662b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57687ecc-bffd-46bc-b53b-53d6cb1e9a49', 'volume_size': 1, 'source_volid': '70339dc2-6688-4be3-8562-d0ee77fe14a9', 'source_volstatus': 'available'}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:51:15 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d18eced1-437a-469f-b4b1-c8ccfadb9a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:51:15 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Volume volume-57687ecc-bffd-46bc-b53b-53d6cb1e9a49 (57687ecc-bffd-46bc-b53b-53d6cb1e9a49): created successfully
Jul 10 12:51:15 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d18eced1-437a-469f-b4b1-c8ccfadb9a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:51:15 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Flow 'volume_create_manager' (f5415ec0-0d8e-4b9e-8df9-6021c4c4a6e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:51:15 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-1dc54b6e-d0bb-4715-9eec-eb088f92d018 tempest-VolumesGetTest-712653248 None] Created volume successfully.
Jul 10 12:51:17 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba4a4ed3-9df9-4f08-bdee-8fce05c405e3 tempest-VolumesGetTest-712653248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:51:17 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ba4a4ed3-9df9-4f08-bdee-8fce05c405e3 tempest-VolumesGetTest-712653248 None] Flow 'volume_create_manager' (0852daa2-2a24-43f3-abe1-57ee701c8286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:51:17 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ba4a4ed3-9df9-4f08-bdee-8fce05c405e3 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2913084d-0e35-41d5-8327-dc8ecc36179f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:51:17 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ba4a4ed3-9df9-4f08-bdee-8fce05c405e3 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2913084d-0e35-41d5-8327-dc8ecc36179f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:51:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-504509186',display_name='tempest-VolumesGetTest-Volume-69321540',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c8eff47-8ef2-4421-81d7-19c7de4aaace,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94859412ce094e45ae424b684b73d5b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:51:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:51:17Z,use_quota=True,user_id='fdd7b612fdb047f7908e44fa9926ecd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:51:17 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ba4a4ed3-9df9-4f08-bdee-8fce05c405e3 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0af99a3-6c43-4984-a9e5-fcf964e4a664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:51:17 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ba4a4ed3-9df9-4f08-bdee-8fce05c405e3 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0af99a3-6c43-4984-a9e5-fcf964e4a664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:51:17 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ba4a4ed3-9df9-4f08-bdee-8fce05c405e3 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfb7dbcc-5694-4e05-b707-a35e9b216ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:51:17 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ba4a4ed3-9df9-4f08-bdee-8fce05c405e3 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfb7dbcc-5694-4e05-b707-a35e9b216ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c8eff47-8ef2-4421-81d7-19c7de4aaace', 'volume_name': 'volume-6c8eff47-8ef2-4421-81d7-19c7de4aaace', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:51:17 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ba4a4ed3-9df9-4f08-bdee-8fce05c405e3 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47a97bd9-d232-4e5a-aabd-f3afdc0e30a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:51:17 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ba4a4ed3-9df9-4f08-bdee-8fce05c405e3 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47a97bd9-d232-4e5a-aabd-f3afdc0e30a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:51:17 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ba4a4ed3-9df9-4f08-bdee-8fce05c405e3 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7820bb6a-b227-44d3-b41b-2db5b6925ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:51:17 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-ba4a4ed3-9df9-4f08-bdee-8fce05c405e3 tempest-VolumesGetTest-712653248 None] Volume 6c8eff47-8ef2-4421-81d7-19c7de4aaace: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c8eff47-8ef2-4421-81d7-19c7de4aaace', 'volume_size': 1}
Jul 10 12:51:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ba4a4ed3-9df9-4f08-bdee-8fce05c405e3 tempest-VolumesGetTest-712653248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:51:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ba4a4ed3-9df9-4f08-bdee-8fce05c405e3 tempest-VolumesGetTest-712653248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:51:17 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-ba4a4ed3-9df9-4f08-bdee-8fce05c405e3 tempest-VolumesGetTest-712653248 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:51:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-504509186',display_name='tempest-VolumesGetTest-Volume-69321540',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c8eff47-8ef2-4421-81d7-19c7de4aaace,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94859412ce094e45ae424b684b73d5b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:51:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:51:17Z,use_quota=True,user_id='fdd7b612fdb047f7908e44fa9926ecd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:51:17 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-ba4a4ed3-9df9-4f08-bdee-8fce05c405e3 tempest-VolumesGetTest-712653248 None] Creating volume 6c8eff47-8ef2-4421-81d7-19c7de4aaace {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:51:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ba4a4ed3-9df9-4f08-bdee-8fce05c405e3 tempest-VolumesGetTest-712653248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:51:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ba4a4ed3-9df9-4f08-bdee-8fce05c405e3 tempest-VolumesGetTest-712653248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:51:17 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-ba4a4ed3-9df9-4f08-bdee-8fce05c405e3 tempest-VolumesGetTest-712653248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:51:17 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-ba4a4ed3-9df9-4f08-bdee-8fce05c405e3 tempest-VolumesGetTest-712653248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:51:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ba4a4ed3-9df9-4f08-bdee-8fce05c405e3 tempest-VolumesGetTest-712653248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:51:17 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-ba4a4ed3-9df9-4f08-bdee-8fce05c405e3 tempest-VolumesGetTest-712653248 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:51:17 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-ba4a4ed3-9df9-4f08-bdee-8fce05c405e3 tempest-VolumesGetTest-712653248 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:51:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ba4a4ed3-9df9-4f08-bdee-8fce05c405e3 tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6c8eff47-8ef2-4421-81d7-19c7de4aaace 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:17 devstack sudo[100481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6c8eff47-8ef2-4421-81d7-19c7de4aaace 1073741824
Jul 10 12:51:17 devstack sudo[100481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:18 devstack sudo[100481]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ba4a4ed3-9df9-4f08-bdee-8fce05c405e3 tempest-VolumesGetTest-712653248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6c8eff47-8ef2-4421-81d7-19c7de4aaace 1073741824" returned: 0 in 1.070s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ba4a4ed3-9df9-4f08-bdee-8fce05c405e3 tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6c8eff47-8ef2-4421-81d7-19c7de4aaace {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:18 devstack sudo[100487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6c8eff47-8ef2-4421-81d7-19c7de4aaace
Jul 10 12:51:18 devstack sudo[100487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:19 devstack sudo[100487]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ba4a4ed3-9df9-4f08-bdee-8fce05c405e3 tempest-VolumesGetTest-712653248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6c8eff47-8ef2-4421-81d7-19c7de4aaace" returned: 0 in 0.707s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:19 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-ba4a4ed3-9df9-4f08-bdee-8fce05c405e3 tempest-VolumesGetTest-712653248 None] <== create_volume: return (1837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:51:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ba4a4ed3-9df9-4f08-bdee-8fce05c405e3 tempest-VolumesGetTest-712653248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.840s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:51:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ba4a4ed3-9df9-4f08-bdee-8fce05c405e3 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7820bb6a-b227-44d3-b41b-2db5b6925ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c8eff47-8ef2-4421-81d7-19c7de4aaace', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:51:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ba4a4ed3-9df9-4f08-bdee-8fce05c405e3 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70d3b8c4-4dfd-4a92-9afe-d13df5cdf44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:51:19 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-ba4a4ed3-9df9-4f08-bdee-8fce05c405e3 tempest-VolumesGetTest-712653248 None] Volume volume-6c8eff47-8ef2-4421-81d7-19c7de4aaace (6c8eff47-8ef2-4421-81d7-19c7de4aaace): created successfully
Jul 10 12:51:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ba4a4ed3-9df9-4f08-bdee-8fce05c405e3 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70d3b8c4-4dfd-4a92-9afe-d13df5cdf44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:51:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ba4a4ed3-9df9-4f08-bdee-8fce05c405e3 tempest-VolumesGetTest-712653248 None] Flow 'volume_create_manager' (0852daa2-2a24-43f3-abe1-57ee701c8286) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:51:19 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-ba4a4ed3-9df9-4f08-bdee-8fce05c405e3 tempest-VolumesGetTest-712653248 None] Created volume successfully.
Jul 10 12:51:20 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-dc7bd79b-ca66-4edf-8b19-0e26fb2cce56 tempest-VolumesGetTest-712653248 None] Acquiring lock "cinder-6c8eff47-8ef2-4421-81d7-19c7de4aaace-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:51:20 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-dc7bd79b-ca66-4edf-8b19-0e26fb2cce56 tempest-VolumesGetTest-712653248 None] Lock "cinder-6c8eff47-8ef2-4421-81d7-19c7de4aaace-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:51:20 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-dc7bd79b-ca66-4edf-8b19-0e26fb2cce56 tempest-VolumesGetTest-712653248 None] Acquiring lock "cinder-quobyte-6c8eff47-8ef2-4421-81d7-19c7de4aaace" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:51:20 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-dc7bd79b-ca66-4edf-8b19-0e26fb2cce56 tempest-VolumesGetTest-712653248 None] Lock "cinder-quobyte-6c8eff47-8ef2-4421-81d7-19c7de4aaace" acquired by "delete_volume" :: waited 0.023s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:51:21 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3d66fd-bfb9-4acc-81e4-523e672d4a71]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:51:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-dc7bd79b-ca66-4edf-8b19-0e26fb2cce56 tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6c8eff47-8ef2-4421-81d7-19c7de4aaace {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:21 devstack sudo[100491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6c8eff47-8ef2-4421-81d7-19c7de4aaace
Jul 10 12:51:21 devstack sudo[100491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:21 devstack sudo[100491]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-dc7bd79b-ca66-4edf-8b19-0e26fb2cce56 tempest-VolumesGetTest-712653248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6c8eff47-8ef2-4421-81d7-19c7de4aaace" returned: 0 in 0.963s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-dc7bd79b-ca66-4edf-8b19-0e26fb2cce56 tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6c8eff47-8ef2-4421-81d7-19c7de4aaace {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:22 devstack sudo[100496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6c8eff47-8ef2-4421-81d7-19c7de4aaace
Jul 10 12:51:22 devstack sudo[100496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:22 devstack sudo[100496]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-dc7bd79b-ca66-4edf-8b19-0e26fb2cce56 tempest-VolumesGetTest-712653248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6c8eff47-8ef2-4421-81d7-19c7de4aaace" returned: 0 in 0.952s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:22 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-dc7bd79b-ca66-4edf-8b19-0e26fb2cce56 tempest-VolumesGetTest-712653248 None] Lock "cinder-quobyte-6c8eff47-8ef2-4421-81d7-19c7de4aaace" released by "delete_volume" :: held 1.997s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:51:23 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-dc7bd79b-ca66-4edf-8b19-0e26fb2cce56 tempest-VolumesGetTest-712653248 None] Created reservations ['9b657d55-b941-4834-ab2d-b0a349971ef6', 'edc844fa-5b2c-44dc-a588-c8c908d5c48b', 'c0d90108-0263-4a92-b6cb-8adcd9ca7fab', '27ec487e-8f52-482c-aea9-d3bb268bfcf9'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:51:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-dc7bd79b-ca66-4edf-8b19-0e26fb2cce56 tempest-VolumesGetTest-712653248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:51:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-dc7bd79b-ca66-4edf-8b19-0e26fb2cce56 tempest-VolumesGetTest-712653248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:51:23 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-dc7bd79b-ca66-4edf-8b19-0e26fb2cce56 tempest-VolumesGetTest-712653248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:51:23 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-dc7bd79b-ca66-4edf-8b19-0e26fb2cce56 tempest-VolumesGetTest-712653248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:51:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-dc7bd79b-ca66-4edf-8b19-0e26fb2cce56 tempest-VolumesGetTest-712653248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:51:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-dc7bd79b-ca66-4edf-8b19-0e26fb2cce56 tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:23 devstack sudo[100533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:51:23 devstack sudo[100533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:24 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-534fbce7-e03c-488a-8120-37bca62ffbbc tempest-SnapshotDependencyTests-1482164512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:51:24 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-534fbce7-e03c-488a-8120-37bca62ffbbc tempest-SnapshotDependencyTests-1482164512 None] Flow 'volume_create_manager' (c0be7ab3-2095-4e50-84bd-705a9ebdca3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:51:24 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-534fbce7-e03c-488a-8120-37bca62ffbbc tempest-SnapshotDependencyTests-1482164512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59798e79-48a8-4a70-b745-f8a4baf4879d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:51:24 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-534fbce7-e03c-488a-8120-37bca62ffbbc tempest-SnapshotDependencyTests-1482164512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59798e79-48a8-4a70-b745-f8a4baf4879d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:51:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-105978841',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34f37766-0c00-4b9d-9158-3357518de597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6af01ba3ac8b48a1824ba2dc52b49b15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:51:24Z,use_quota=True,user_id='677588dbd8904cee8cd250a04408ba9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:51:24 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-534fbce7-e03c-488a-8120-37bca62ffbbc tempest-SnapshotDependencyTests-1482164512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0031060c-277c-4559-8b42-336a24f52592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:51:24 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-534fbce7-e03c-488a-8120-37bca62ffbbc tempest-SnapshotDependencyTests-1482164512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0031060c-277c-4559-8b42-336a24f52592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:51:24 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-534fbce7-e03c-488a-8120-37bca62ffbbc tempest-SnapshotDependencyTests-1482164512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58dce0a3-02d8-4b14-9526-a8dee9cb587e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:51:24 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-534fbce7-e03c-488a-8120-37bca62ffbbc tempest-SnapshotDependencyTests-1482164512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58dce0a3-02d8-4b14-9526-a8dee9cb587e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34f37766-0c00-4b9d-9158-3357518de597', 'volume_name': 'volume-34f37766-0c00-4b9d-9158-3357518de597', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:51:24 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-534fbce7-e03c-488a-8120-37bca62ffbbc tempest-SnapshotDependencyTests-1482164512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (006d43bf-1b73-4d7e-9a38-873c4fc61f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:51:24 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-534fbce7-e03c-488a-8120-37bca62ffbbc tempest-SnapshotDependencyTests-1482164512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (006d43bf-1b73-4d7e-9a38-873c4fc61f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:51:24 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-534fbce7-e03c-488a-8120-37bca62ffbbc tempest-SnapshotDependencyTests-1482164512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11cf7323-63e8-46aa-9a24-b4abdf153675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:51:24 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-534fbce7-e03c-488a-8120-37bca62ffbbc tempest-SnapshotDependencyTests-1482164512 None] Volume 34f37766-0c00-4b9d-9158-3357518de597: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34f37766-0c00-4b9d-9158-3357518de597', 'volume_size': 1}
Jul 10 12:51:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-534fbce7-e03c-488a-8120-37bca62ffbbc tempest-SnapshotDependencyTests-1482164512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:51:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-534fbce7-e03c-488a-8120-37bca62ffbbc tempest-SnapshotDependencyTests-1482164512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:51:24 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-534fbce7-e03c-488a-8120-37bca62ffbbc tempest-SnapshotDependencyTests-1482164512 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:51:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-105978841',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34f37766-0c00-4b9d-9158-3357518de597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6af01ba3ac8b48a1824ba2dc52b49b15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:51:24Z,use_quota=True,user_id='677588dbd8904cee8cd250a04408ba9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:51:24 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-534fbce7-e03c-488a-8120-37bca62ffbbc tempest-SnapshotDependencyTests-1482164512 None] Creating volume 34f37766-0c00-4b9d-9158-3357518de597 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:51:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-534fbce7-e03c-488a-8120-37bca62ffbbc tempest-SnapshotDependencyTests-1482164512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:51:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-534fbce7-e03c-488a-8120-37bca62ffbbc tempest-SnapshotDependencyTests-1482164512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:51:24 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-534fbce7-e03c-488a-8120-37bca62ffbbc tempest-SnapshotDependencyTests-1482164512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:51:24 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-534fbce7-e03c-488a-8120-37bca62ffbbc tempest-SnapshotDependencyTests-1482164512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:51:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-534fbce7-e03c-488a-8120-37bca62ffbbc tempest-SnapshotDependencyTests-1482164512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:51:24 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-534fbce7-e03c-488a-8120-37bca62ffbbc tempest-SnapshotDependencyTests-1482164512 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:51:24 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-534fbce7-e03c-488a-8120-37bca62ffbbc tempest-SnapshotDependencyTests-1482164512 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:51:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-534fbce7-e03c-488a-8120-37bca62ffbbc tempest-SnapshotDependencyTests-1482164512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:24 devstack sudo[100538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597 1073741824
Jul 10 12:51:24 devstack sudo[100538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:24 devstack sudo[100533]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-dc7bd79b-ca66-4edf-8b19-0e26fb2cce56 tempest-VolumesGetTest-712653248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.934s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:24 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-dc7bd79b-ca66-4edf-8b19-0e26fb2cce56 tempest-VolumesGetTest-712653248 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:51:24 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-dc7bd79b-ca66-4edf-8b19-0e26fb2cce56 tempest-VolumesGetTest-712653248 None] Deleted volume successfully.
Jul 10 12:51:24 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-dc7bd79b-ca66-4edf-8b19-0e26fb2cce56 tempest-VolumesGetTest-712653248 None] Lock "cinder-6c8eff47-8ef2-4421-81d7-19c7de4aaace-delete_volume" released by "delete_volume" :: held 3.443s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:51:24 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-39193a53-5e41-4e6b-bb87-8224b5256e0d tempest-VolumesGetTest-712653248 None] Acquiring lock "cinder-57687ecc-bffd-46bc-b53b-53d6cb1e9a49-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:51:24 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-39193a53-5e41-4e6b-bb87-8224b5256e0d tempest-VolumesGetTest-712653248 None] Lock "cinder-57687ecc-bffd-46bc-b53b-53d6cb1e9a49-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:51:24 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-39193a53-5e41-4e6b-bb87-8224b5256e0d tempest-VolumesGetTest-712653248 None] Acquiring lock "cinder-quobyte-57687ecc-bffd-46bc-b53b-53d6cb1e9a49" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:51:24 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-39193a53-5e41-4e6b-bb87-8224b5256e0d tempest-VolumesGetTest-712653248 None] Lock "cinder-quobyte-57687ecc-bffd-46bc-b53b-53d6cb1e9a49" acquired by "delete_volume" :: waited 0.021s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:51:24 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[939436c8-bf6f-4555-8bbe-75dafac94c1d]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:51:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-39193a53-5e41-4e6b-bb87-8224b5256e0d tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57687ecc-bffd-46bc-b53b-53d6cb1e9a49 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:24 devstack sudo[100540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57687ecc-bffd-46bc-b53b-53d6cb1e9a49
Jul 10 12:51:24 devstack sudo[100540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:25 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-9aafb7fb-be52-4589-8fa3-71a260a46bcb tempest-VolumesTransfersTest-2091501894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:51:25 devstack sudo[100538]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:25 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9aafb7fb-be52-4589-8fa3-71a260a46bcb tempest-VolumesTransfersTest-2091501894 None] Flow 'volume_create_manager' (c26466ab-460d-4b4a-ba5a-d840a61576d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:51:25 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9aafb7fb-be52-4589-8fa3-71a260a46bcb tempest-VolumesTransfersTest-2091501894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21c9b4a0-5fb7-45c1-bde1-d3e380c81c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:51:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-534fbce7-e03c-488a-8120-37bca62ffbbc tempest-SnapshotDependencyTests-1482164512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597 1073741824" returned: 0 in 1.216s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:25 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9aafb7fb-be52-4589-8fa3-71a260a46bcb tempest-VolumesTransfersTest-2091501894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21c9b4a0-5fb7-45c1-bde1-d3e380c81c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1356889542',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29dc0b77-ec3b-47c3-8ae1-a40532f18adc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83330ae8f3724cedae9e8435eab4076d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:51:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:51:25Z,use_quota=True,user_id='e6888e52d9db460fa55402b227fbb883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:51:25 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9aafb7fb-be52-4589-8fa3-71a260a46bcb tempest-VolumesTransfersTest-2091501894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b80425ec-f8e4-4ac5-a4f1-6c56be24b182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:51:25 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9aafb7fb-be52-4589-8fa3-71a260a46bcb tempest-VolumesTransfersTest-2091501894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b80425ec-f8e4-4ac5-a4f1-6c56be24b182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:51:25 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9aafb7fb-be52-4589-8fa3-71a260a46bcb tempest-VolumesTransfersTest-2091501894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (506ecaa5-3460-483b-9d04-a90c96855bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:51:25 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9aafb7fb-be52-4589-8fa3-71a260a46bcb tempest-VolumesTransfersTest-2091501894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (506ecaa5-3460-483b-9d04-a90c96855bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29dc0b77-ec3b-47c3-8ae1-a40532f18adc', 'volume_name': 'volume-29dc0b77-ec3b-47c3-8ae1-a40532f18adc', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:51:25 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9aafb7fb-be52-4589-8fa3-71a260a46bcb tempest-VolumesTransfersTest-2091501894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f745f782-70d4-45f4-98d5-ae1265d2393d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:51:25 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9aafb7fb-be52-4589-8fa3-71a260a46bcb tempest-VolumesTransfersTest-2091501894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f745f782-70d4-45f4-98d5-ae1265d2393d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:51:25 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9aafb7fb-be52-4589-8fa3-71a260a46bcb tempest-VolumesTransfersTest-2091501894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9c8f618-42e4-4cf0-8496-92affc1bf563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:51:25 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-9aafb7fb-be52-4589-8fa3-71a260a46bcb tempest-VolumesTransfersTest-2091501894 None] Volume 29dc0b77-ec3b-47c3-8ae1-a40532f18adc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29dc0b77-ec3b-47c3-8ae1-a40532f18adc', 'volume_size': 1}
Jul 10 12:51:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-9aafb7fb-be52-4589-8fa3-71a260a46bcb tempest-VolumesTransfersTest-2091501894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:51:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-534fbce7-e03c-488a-8120-37bca62ffbbc tempest-SnapshotDependencyTests-1482164512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:25 devstack sudo[100548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597
Jul 10 12:51:25 devstack sudo[100548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:25 devstack sudo[100540]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-39193a53-5e41-4e6b-bb87-8224b5256e0d tempest-VolumesGetTest-712653248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57687ecc-bffd-46bc-b53b-53d6cb1e9a49" returned: 0 in 0.973s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-39193a53-5e41-4e6b-bb87-8224b5256e0d tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57687ecc-bffd-46bc-b53b-53d6cb1e9a49 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:25 devstack sudo[100551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57687ecc-bffd-46bc-b53b-53d6cb1e9a49
Jul 10 12:51:25 devstack sudo[100551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:26 devstack sudo[100548]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-534fbce7-e03c-488a-8120-37bca62ffbbc tempest-SnapshotDependencyTests-1482164512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597" returned: 0 in 0.701s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:26 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-534fbce7-e03c-488a-8120-37bca62ffbbc tempest-SnapshotDependencyTests-1482164512 None] <== create_volume: return (2011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:51:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-534fbce7-e03c-488a-8120-37bca62ffbbc tempest-SnapshotDependencyTests-1482164512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.013s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:51:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-9aafb7fb-be52-4589-8fa3-71a260a46bcb tempest-VolumesTransfersTest-2091501894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.723s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:51:26 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-9aafb7fb-be52-4589-8fa3-71a260a46bcb tempest-VolumesTransfersTest-2091501894 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1356889542',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29dc0b77-ec3b-47c3-8ae1-a40532f18adc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83330ae8f3724cedae9e8435eab4076d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:51:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:51:25Z,use_quota=True,user_id='e6888e52d9db460fa55402b227fbb883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:51:26 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-9aafb7fb-be52-4589-8fa3-71a260a46bcb tempest-VolumesTransfersTest-2091501894 None] Creating volume 29dc0b77-ec3b-47c3-8ae1-a40532f18adc {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:51:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-9aafb7fb-be52-4589-8fa3-71a260a46bcb tempest-VolumesTransfersTest-2091501894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:51:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-9aafb7fb-be52-4589-8fa3-71a260a46bcb tempest-VolumesTransfersTest-2091501894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:51:26 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-9aafb7fb-be52-4589-8fa3-71a260a46bcb tempest-VolumesTransfersTest-2091501894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:51:26 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-9aafb7fb-be52-4589-8fa3-71a260a46bcb tempest-VolumesTransfersTest-2091501894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:51:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-9aafb7fb-be52-4589-8fa3-71a260a46bcb tempest-VolumesTransfersTest-2091501894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:51:26 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-9aafb7fb-be52-4589-8fa3-71a260a46bcb tempest-VolumesTransfersTest-2091501894 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:51:26 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-9aafb7fb-be52-4589-8fa3-71a260a46bcb tempest-VolumesTransfersTest-2091501894 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:51:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9aafb7fb-be52-4589-8fa3-71a260a46bcb tempest-VolumesTransfersTest-2091501894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-29dc0b77-ec3b-47c3-8ae1-a40532f18adc 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-534fbce7-e03c-488a-8120-37bca62ffbbc tempest-SnapshotDependencyTests-1482164512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11cf7323-63e8-46aa-9a24-b4abdf153675) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34f37766-0c00-4b9d-9158-3357518de597', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:51:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-534fbce7-e03c-488a-8120-37bca62ffbbc tempest-SnapshotDependencyTests-1482164512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd04aaec-7aeb-486e-8187-7a6480a2f8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:51:26 devstack sudo[100555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-29dc0b77-ec3b-47c3-8ae1-a40532f18adc 1073741824
Jul 10 12:51:26 devstack sudo[100555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:26 devstack sudo[100551]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:26 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-534fbce7-e03c-488a-8120-37bca62ffbbc tempest-SnapshotDependencyTests-1482164512 None] Volume volume-34f37766-0c00-4b9d-9158-3357518de597 (34f37766-0c00-4b9d-9158-3357518de597): created successfully
Jul 10 12:51:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-534fbce7-e03c-488a-8120-37bca62ffbbc tempest-SnapshotDependencyTests-1482164512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd04aaec-7aeb-486e-8187-7a6480a2f8e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:51:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-534fbce7-e03c-488a-8120-37bca62ffbbc tempest-SnapshotDependencyTests-1482164512 None] Flow 'volume_create_manager' (c0be7ab3-2095-4e50-84bd-705a9ebdca3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:51:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-39193a53-5e41-4e6b-bb87-8224b5256e0d tempest-VolumesGetTest-712653248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57687ecc-bffd-46bc-b53b-53d6cb1e9a49" returned: 0 in 0.657s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:26 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-39193a53-5e41-4e6b-bb87-8224b5256e0d tempest-VolumesGetTest-712653248 None] Lock "cinder-quobyte-57687ecc-bffd-46bc-b53b-53d6cb1e9a49" released by "delete_volume" :: held 1.692s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:51:26 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-534fbce7-e03c-488a-8120-37bca62ffbbc tempest-SnapshotDependencyTests-1482164512 None] Created volume successfully.
Jul 10 12:51:26 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-39193a53-5e41-4e6b-bb87-8224b5256e0d tempest-VolumesGetTest-712653248 None] Created reservations ['f387a464-c24e-476d-a359-29d925c5214b', '3c558aff-a500-4001-a897-f5161dfb9642', 'b6de2af5-ec96-4a2a-849a-5e9cac914cf6', '47ff57d8-b42b-4230-a1e8-46238e07f8fe'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:51:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-39193a53-5e41-4e6b-bb87-8224b5256e0d tempest-VolumesGetTest-712653248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:51:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-39193a53-5e41-4e6b-bb87-8224b5256e0d tempest-VolumesGetTest-712653248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:51:26 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-39193a53-5e41-4e6b-bb87-8224b5256e0d tempest-VolumesGetTest-712653248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:51:26 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-39193a53-5e41-4e6b-bb87-8224b5256e0d tempest-VolumesGetTest-712653248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:51:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-39193a53-5e41-4e6b-bb87-8224b5256e0d tempest-VolumesGetTest-712653248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:51:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-39193a53-5e41-4e6b-bb87-8224b5256e0d tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:26 devstack sudo[100557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:51:26 devstack sudo[100557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:26 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-c4bfcb94-7ef3-4416-917e-20e91a418c93 tempest-VolumesGetTest-712653248 None] Acquiring lock "cinder-70339dc2-6688-4be3-8562-d0ee77fe14a9-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:51:26 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-c4bfcb94-7ef3-4416-917e-20e91a418c93 tempest-VolumesGetTest-712653248 None] Lock "cinder-70339dc2-6688-4be3-8562-d0ee77fe14a9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:51:26 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-c4bfcb94-7ef3-4416-917e-20e91a418c93 tempest-VolumesGetTest-712653248 None] Acquiring lock "cinder-quobyte-70339dc2-6688-4be3-8562-d0ee77fe14a9" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:51:26 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-c4bfcb94-7ef3-4416-917e-20e91a418c93 tempest-VolumesGetTest-712653248 None] Lock "cinder-quobyte-70339dc2-6688-4be3-8562-d0ee77fe14a9" acquired by "delete_volume" :: waited 0.017s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:51:26 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f6d6e6-1ba4-42fa-95dd-76f822957607]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:51:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c4bfcb94-7ef3-4416-917e-20e91a418c93 tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:26 devstack sudo[100562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9
Jul 10 12:51:26 devstack sudo[100562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:27 devstack sudo[100555]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9aafb7fb-be52-4589-8fa3-71a260a46bcb tempest-VolumesTransfersTest-2091501894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-29dc0b77-ec3b-47c3-8ae1-a40532f18adc 1073741824" returned: 0 in 0.885s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:27 devstack sudo[100557]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9aafb7fb-be52-4589-8fa3-71a260a46bcb tempest-VolumesTransfersTest-2091501894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-29dc0b77-ec3b-47c3-8ae1-a40532f18adc {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-39193a53-5e41-4e6b-bb87-8224b5256e0d tempest-VolumesGetTest-712653248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.743s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:27 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-39193a53-5e41-4e6b-bb87-8224b5256e0d tempest-VolumesGetTest-712653248 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:51:27 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-39193a53-5e41-4e6b-bb87-8224b5256e0d tempest-VolumesGetTest-712653248 None] Deleted volume successfully.
Jul 10 12:51:27 devstack sudo[100566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-29dc0b77-ec3b-47c3-8ae1-a40532f18adc
Jul 10 12:51:27 devstack sudo[100566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:27 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-39193a53-5e41-4e6b-bb87-8224b5256e0d tempest-VolumesGetTest-712653248 None] Lock "cinder-57687ecc-bffd-46bc-b53b-53d6cb1e9a49-delete_volume" released by "delete_volume" :: held 2.669s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:51:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ba8a7886-a6dc-44c4-b5d1-b73a5186b3d1 tempest-SnapshotDependencyTests-1482164512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:51:27 devstack sudo[100562]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c4bfcb94-7ef3-4416-917e-20e91a418c93 tempest-VolumesGetTest-712653248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9" returned: 0 in 0.841s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c4bfcb94-7ef3-4416-917e-20e91a418c93 tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:27 devstack sudo[100572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9
Jul 10 12:51:27 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:27 devstack sudo[100566]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9aafb7fb-be52-4589-8fa3-71a260a46bcb tempest-VolumesTransfersTest-2091501894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-29dc0b77-ec3b-47c3-8ae1-a40532f18adc" returned: 0 in 0.694s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:27 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-9aafb7fb-be52-4589-8fa3-71a260a46bcb tempest-VolumesTransfersTest-2091501894 None] <== create_volume: return (1639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:51:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-9aafb7fb-be52-4589-8fa3-71a260a46bcb tempest-VolumesTransfersTest-2091501894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.644s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:51:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ba8a7886-a6dc-44c4-b5d1-b73a5186b3d1 tempest-SnapshotDependencyTests-1482164512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.333s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:51:27 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-ba8a7886-a6dc-44c4-b5d1-b73a5186b3d1 tempest-SnapshotDependencyTests-1482164512 None] Creating offline snapshot 72b37049-5704-4169-8b20-62b261913a5a of volume 34f37766-0c00-4b9d-9158-3357518de597 {{(pid=87378) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 10 12:51:27 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9aafb7fb-be52-4589-8fa3-71a260a46bcb tempest-VolumesTransfersTest-2091501894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9c8f618-42e4-4cf0-8496-92affc1bf563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29dc0b77-ec3b-47c3-8ae1-a40532f18adc', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:51:27 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9aafb7fb-be52-4589-8fa3-71a260a46bcb tempest-VolumesTransfersTest-2091501894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (326e73de-9b07-4659-b748-263355036108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:51:27 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[256e580b-355d-4cb1-8f33-b3ac354daf28]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:51:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ba8a7886-a6dc-44c4-b5d1-b73a5186b3d1 tempest-SnapshotDependencyTests-1482164512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:27 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-9aafb7fb-be52-4589-8fa3-71a260a46bcb tempest-VolumesTransfersTest-2091501894 None] Volume volume-29dc0b77-ec3b-47c3-8ae1-a40532f18adc (29dc0b77-ec3b-47c3-8ae1-a40532f18adc): created successfully
Jul 10 12:51:27 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9aafb7fb-be52-4589-8fa3-71a260a46bcb tempest-VolumesTransfersTest-2091501894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (326e73de-9b07-4659-b748-263355036108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:51:27 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9aafb7fb-be52-4589-8fa3-71a260a46bcb tempest-VolumesTransfersTest-2091501894 None] Flow 'volume_create_manager' (c26466ab-460d-4b4a-ba5a-d840a61576d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:51:27 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-9aafb7fb-be52-4589-8fa3-71a260a46bcb tempest-VolumesTransfersTest-2091501894 None] Created volume successfully.
Jul 10 12:51:27 devstack sudo[100574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597
Jul 10 12:51:27 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:28 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c4bfcb94-7ef3-4416-917e-20e91a418c93 tempest-VolumesGetTest-712653248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-70339dc2-6688-4be3-8562-d0ee77fe14a9" returned: 0 in 0.679s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:28 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-c4bfcb94-7ef3-4416-917e-20e91a418c93 tempest-VolumesGetTest-712653248 None] Lock "cinder-quobyte-70339dc2-6688-4be3-8562-d0ee77fe14a9" released by "delete_volume" :: held 1.582s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:51:28 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-c4bfcb94-7ef3-4416-917e-20e91a418c93 tempest-VolumesGetTest-712653248 None] Created reservations ['0f9bcd85-c21e-4cde-bbdf-93cd89df2efe', '28f64015-8bda-4b5f-b4ef-6c5b154737ae', 'cfc4e8b0-64f9-4d67-9923-4cea29a1f7f7', 'd3112557-1a82-499e-9c26-11e07b8410cc'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:51:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c4bfcb94-7ef3-4416-917e-20e91a418c93 tempest-VolumesGetTest-712653248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:51:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c4bfcb94-7ef3-4416-917e-20e91a418c93 tempest-VolumesGetTest-712653248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:51:28 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-c4bfcb94-7ef3-4416-917e-20e91a418c93 tempest-VolumesGetTest-712653248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:51:28 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-c4bfcb94-7ef3-4416-917e-20e91a418c93 tempest-VolumesGetTest-712653248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:51:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c4bfcb94-7ef3-4416-917e-20e91a418c93 tempest-VolumesGetTest-712653248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:51:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c4bfcb94-7ef3-4416-917e-20e91a418c93 tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:28 devstack sudo[100580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:51:28 devstack sudo[100580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:28 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ba8a7886-a6dc-44c4-b5d1-b73a5186b3d1 tempest-SnapshotDependencyTests-1482164512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597" returned: 0 in 0.812s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ba8a7886-a6dc-44c4-b5d1-b73a5186b3d1 tempest-SnapshotDependencyTests-1482164512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597.72b37049-5704-4169-8b20-62b261913a5a 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:28 devstack sudo[100582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597.72b37049-5704-4169-8b20-62b261913a5a 1G
Jul 10 12:51:28 devstack sudo[100582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:29 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-f10936a4-68b7-4631-b55a-eebbbd594fb4 tempest-VolumesTransfersTest-2121605245 None] Transfer volume completed successfully.
Jul 10 12:51:29 devstack sudo[100580]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c4bfcb94-7ef3-4416-917e-20e91a418c93 tempest-VolumesGetTest-712653248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.798s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:29 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-c4bfcb94-7ef3-4416-917e-20e91a418c93 tempest-VolumesGetTest-712653248 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:51:29 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-c4bfcb94-7ef3-4416-917e-20e91a418c93 tempest-VolumesGetTest-712653248 None] Deleted volume successfully.
Jul 10 12:51:29 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-c4bfcb94-7ef3-4416-917e-20e91a418c93 tempest-VolumesGetTest-712653248 None] Lock "cinder-70339dc2-6688-4be3-8562-d0ee77fe14a9-delete_volume" released by "delete_volume" :: held 2.628s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:51:29 devstack sudo[100582]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ba8a7886-a6dc-44c4-b5d1-b73a5186b3d1 tempest-SnapshotDependencyTests-1482164512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597.72b37049-5704-4169-8b20-62b261913a5a 1G" returned: 0 in 0.915s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ba8a7886-a6dc-44c4-b5d1-b73a5186b3d1 tempest-SnapshotDependencyTests-1482164512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34f37766-0c00-4b9d-9158-3357518de597 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597.72b37049-5704-4169-8b20-62b261913a5a {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:29 devstack sudo[100591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34f37766-0c00-4b9d-9158-3357518de597 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597.72b37049-5704-4169-8b20-62b261913a5a
Jul 10 12:51:29 devstack sudo[100591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:30 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:51:30 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] Flow 'volume_create_manager' (b5f40aec-d934-4ee7-9a0a-654a7b96cdb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:51:30 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61cf48c0-1016-474c-b493-770bd56118ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:51:30 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61cf48c0-1016-474c-b493-770bd56118ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2012089809',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b371ff4b-f6b6-4521-beff-2eb272093c8b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='94859412ce094e45ae424b684b73d5b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:51:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:51:30Z,use_quota=True,user_id='fdd7b612fdb047f7908e44fa9926ecd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:51:30 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b6ee6f8-df75-4dff-b2a8-d1577e2c0ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:51:30 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b6ee6f8-df75-4dff-b2a8-d1577e2c0ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:51:30 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b63a1fc-1f7a-4022-9c42-b704fd5bf94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:51:30 devstack cinder-volume[87378]: DEBUG cinder.image.glance [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] Creating Keystone auth plugin from conf {{(pid=87378) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 10 12:51:30 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-d4751785-9e1f-4dfb-b747-7ddce521610b tempest-VolumesTransfersTest-319069514 None] Acquiring lock "cinder-29dc0b77-ec3b-47c3-8ae1-a40532f18adc-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:51:30 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-d4751785-9e1f-4dfb-b747-7ddce521610b tempest-VolumesTransfersTest-319069514 None] Lock "cinder-29dc0b77-ec3b-47c3-8ae1-a40532f18adc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:51:30 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-d4751785-9e1f-4dfb-b747-7ddce521610b tempest-VolumesTransfersTest-319069514 None] Acquiring lock "cinder-quobyte-29dc0b77-ec3b-47c3-8ae1-a40532f18adc" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:51:30 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-d4751785-9e1f-4dfb-b747-7ddce521610b tempest-VolumesTransfersTest-319069514 None] Lock "cinder-quobyte-29dc0b77-ec3b-47c3-8ae1-a40532f18adc" acquired by "delete_volume" :: waited 0.016s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:51:30 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea10c86-6437-4ae8-bfbc-ce26621825c2]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:51:30 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d4751785-9e1f-4dfb-b747-7ddce521610b tempest-VolumesTransfersTest-319069514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-29dc0b77-ec3b-47c3-8ae1-a40532f18adc {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:30 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b63a1fc-1f7a-4022-9c42-b704fd5bf94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b371ff4b-f6b6-4521-beff-2eb272093c8b', 'volume_name': 'volume-b371ff4b-f6b6-4521-beff-2eb272093c8b', 'volume_size': 1, 'image_id': 'c73e431b-92e2-4ca0-8142-903361296a8f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c73e431b-92e2-4ca0-8142-903361296a8f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ea129ca6c904ec8b3827a458726b692', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c73e431b-92e2-4ca0-8142-903361296a8f', 'created_at': datetime.datetime(2026, 7, 10, 10, 26, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 10, 26, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c73e431b-92e2-4ca0-8142-903361296a8f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74a0a1750a10>}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:51:30 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6d37d30-b202-4cdc-ba64-9c857ee5b63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:51:30 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6d37d30-b202-4cdc-ba64-9c857ee5b63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:51:30 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (787d5f69-75c2-4a92-adb9-c9dba665045b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:51:30 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] Volume b371ff4b-f6b6-4521-beff-2eb272093c8b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b371ff4b-f6b6-4521-beff-2eb272093c8b', 'volume_size': 1, 'image_id': 'c73e431b-92e2-4ca0-8142-903361296a8f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c73e431b-92e2-4ca0-8142-903361296a8f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ea129ca6c904ec8b3827a458726b692', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c73e431b-92e2-4ca0-8142-903361296a8f', 'created_at': datetime.datetime(2026, 7, 10, 10, 26, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 10, 26, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c73e431b-92e2-4ca0-8142-903361296a8f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74a0a1750a10>}
Jul 10 12:51:30 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] Trying to clone b371ff4b-f6b6-4521-beff-2eb272093c8b from image c73e431b-92e2-4ca0-8142-903361296a8f at location (None, [{'url': 'file:///opt/stack/data/glance/images/c73e431b-92e2-4ca0-8142-903361296a8f', 'metadata': {}}]). {{(pid=87378) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 10 12:51:30 devstack sudo[100591]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:30 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ba8a7886-a6dc-44c4-b5d1-b73a5186b3d1 tempest-SnapshotDependencyTests-1482164512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34f37766-0c00-4b9d-9158-3357518de597 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597.72b37049-5704-4169-8b20-62b261913a5a" returned: 0 in 0.837s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:30 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-ba8a7886-a6dc-44c4-b5d1-b73a5186b3d1 tempest-SnapshotDependencyTests-1482164512 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597.72b37049-5704-4169-8b20-62b261913a5a is being set with open permissions: ugo+rw
Jul 10 12:51:30 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ba8a7886-a6dc-44c4-b5d1-b73a5186b3d1 tempest-SnapshotDependencyTests-1482164512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597.72b37049-5704-4169-8b20-62b261913a5a {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:30 devstack sudo[100597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-29dc0b77-ec3b-47c3-8ae1-a40532f18adc
Jul 10 12:51:30 devstack sudo[100597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:30 devstack sudo[100598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597.72b37049-5704-4169-8b20-62b261913a5a
Jul 10 12:51:30 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:30 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_0a1mwddwdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87378) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 10 12:51:30 devstack cinder-volume[87378]: INFO cinder.image.image_utils [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] Image download 20.69 MB at 20.69 MB/s
Jul 10 12:51:30 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c32395-cf02-4292-9693-76b6f7cc7b1c]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:51:30 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_0a1mwddwdevstack@QuobyteHD {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:30 devstack sudo[100602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_0a1mwddwdevstack@QuobyteHD
Jul 10 12:51:30 devstack sudo[100602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:31 devstack sudo[100597]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d4751785-9e1f-4dfb-b747-7ddce521610b tempest-VolumesTransfersTest-319069514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-29dc0b77-ec3b-47c3-8ae1-a40532f18adc" returned: 0 in 0.847s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d4751785-9e1f-4dfb-b747-7ddce521610b tempest-VolumesTransfersTest-319069514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-29dc0b77-ec3b-47c3-8ae1-a40532f18adc {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:31 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ba8a7886-a6dc-44c4-b5d1-b73a5186b3d1 tempest-SnapshotDependencyTests-1482164512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597.72b37049-5704-4169-8b20-62b261913a5a" returned: 0 in 0.764s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:31 devstack sudo[100608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-29dc0b77-ec3b-47c3-8ae1-a40532f18adc
Jul 10 12:51:31 devstack sudo[100608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ba8a7886-a6dc-44c4-b5d1-b73a5186b3d1 tempest-SnapshotDependencyTests-1482164512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:31 devstack sudo[100610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597.info
Jul 10 12:51:31 devstack sudo[100610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:31 devstack sudo[100602]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_0a1mwddwdevstack@QuobyteHD" returned: 0 in 0.855s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:31 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] Temporary image c73e431b-92e2-4ca0-8142-903361296a8f is fetched for user fdd7b612fdb047f7908e44fa9926ecd3. {{(pid=87378) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 10 12:51:31 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca15254e-99ac-4bd4-b9f1-373222b2a59f]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:51:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_0a1mwddwdevstack@QuobyteHD {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:31 devstack sudo[100608]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:31 devstack sudo[100616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_0a1mwddwdevstack@QuobyteHD
Jul 10 12:51:31 devstack sudo[100616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d4751785-9e1f-4dfb-b747-7ddce521610b tempest-VolumesTransfersTest-319069514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-29dc0b77-ec3b-47c3-8ae1-a40532f18adc" returned: 0 in 0.705s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:31 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-d4751785-9e1f-4dfb-b747-7ddce521610b tempest-VolumesTransfersTest-319069514 None] Lock "cinder-quobyte-29dc0b77-ec3b-47c3-8ae1-a40532f18adc" released by "delete_volume" :: held 1.609s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:51:31 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-d4751785-9e1f-4dfb-b747-7ddce521610b tempest-VolumesTransfersTest-319069514 None] Created reservations ['860ce8df-6f05-40db-8c91-131621102406', 'fdf7bdc3-6014-4e60-bf48-01c6207b9da3', 'fbac0096-444a-4b0f-9391-5510a2c9ce07', 'd5a33a3f-7ead-47db-bad4-5e48e2d2f155'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:51:31 devstack sudo[100610]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ba8a7886-a6dc-44c4-b5d1-b73a5186b3d1 tempest-SnapshotDependencyTests-1482164512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597.info" returned: 0 in 0.786s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:31 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-ba8a7886-a6dc-44c4-b5d1-b73a5186b3d1 tempest-SnapshotDependencyTests-1482164512 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597.info is being set with open permissions: ugo+rw
Jul 10 12:51:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ba8a7886-a6dc-44c4-b5d1-b73a5186b3d1 tempest-SnapshotDependencyTests-1482164512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:32 devstack sudo[100619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597.info
Jul 10 12:51:32 devstack sudo[100619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d4751785-9e1f-4dfb-b747-7ddce521610b tempest-VolumesTransfersTest-319069514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:51:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d4751785-9e1f-4dfb-b747-7ddce521610b tempest-VolumesTransfersTest-319069514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:51:32 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-d4751785-9e1f-4dfb-b747-7ddce521610b tempest-VolumesTransfersTest-319069514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:51:32 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-d4751785-9e1f-4dfb-b747-7ddce521610b tempest-VolumesTransfersTest-319069514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:51:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d4751785-9e1f-4dfb-b747-7ddce521610b tempest-VolumesTransfersTest-319069514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:51:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d4751785-9e1f-4dfb-b747-7ddce521610b tempest-VolumesTransfersTest-319069514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:32 devstack sudo[100621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:51:32 devstack sudo[100621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:32 devstack sudo[100616]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_0a1mwddwdevstack@QuobyteHD" returned: 0 in 0.853s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:51:32 devstack sudo[100619]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ba8a7886-a6dc-44c4-b5d1-b73a5186b3d1 tempest-SnapshotDependencyTests-1482164512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597.info" returned: 0 in 0.679s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ba8a7886-a6dc-44c4-b5d1-b73a5186b3d1 tempest-SnapshotDependencyTests-1482164512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.917s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:51:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.125s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:51:32 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2012089809',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b371ff4b-f6b6-4521-beff-2eb272093c8b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='94859412ce094e45ae424b684b73d5b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:51:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:51:30Z,use_quota=True,user_id='fdd7b612fdb047f7908e44fa9926ecd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:51:32 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] Creating volume b371ff4b-f6b6-4521-beff-2eb272093c8b {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:51:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:51:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:51:32 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:51:32 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:51:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:51:32 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:51:32 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:51:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b371ff4b-f6b6-4521-beff-2eb272093c8b 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:32 devstack sudo[100629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b371ff4b-f6b6-4521-beff-2eb272093c8b 1073741824
Jul 10 12:51:32 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:32 devstack sudo[100621]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d4751785-9e1f-4dfb-b747-7ddce521610b tempest-VolumesTransfersTest-319069514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.706s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:32 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-d4751785-9e1f-4dfb-b747-7ddce521610b tempest-VolumesTransfersTest-319069514 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:51:32 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-ba8a7886-a6dc-44c4-b5d1-b73a5186b3d1 tempest-SnapshotDependencyTests-1482164512 None] Create snapshot completed successfully
Jul 10 12:51:32 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-d4751785-9e1f-4dfb-b747-7ddce521610b tempest-VolumesTransfersTest-319069514 None] Deleted volume successfully.
Jul 10 12:51:32 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-d4751785-9e1f-4dfb-b747-7ddce521610b tempest-VolumesTransfersTest-319069514 None] Lock "cinder-29dc0b77-ec3b-47c3-8ae1-a40532f18adc-delete_volume" released by "delete_volume" :: held 2.608s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:51:33 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-4be2f13a-8dc7-4fa1-94a3-687ed55d6ca8 tempest-VolumesTransfersTest-2091501894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:51:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4be2f13a-8dc7-4fa1-94a3-687ed55d6ca8 tempest-VolumesTransfersTest-2091501894 None] Flow 'volume_create_manager' (6572c5e4-baff-4a95-95da-20b793490575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:51:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4be2f13a-8dc7-4fa1-94a3-687ed55d6ca8 tempest-VolumesTransfersTest-2091501894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af8677e4-5799-428c-bdfd-7a11b141ec71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:51:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4be2f13a-8dc7-4fa1-94a3-687ed55d6ca8 tempest-VolumesTransfersTest-2091501894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af8677e4-5799-428c-bdfd-7a11b141ec71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:51:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-728736551',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e2e6bde-b7d3-4a45-b083-b345c375f7a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83330ae8f3724cedae9e8435eab4076d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:51:33Z,use_quota=True,user_id='e6888e52d9db460fa55402b227fbb883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:51:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4be2f13a-8dc7-4fa1-94a3-687ed55d6ca8 tempest-VolumesTransfersTest-2091501894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48e12a79-828b-4f4f-9941-4cbd6fd35fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:51:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4be2f13a-8dc7-4fa1-94a3-687ed55d6ca8 tempest-VolumesTransfersTest-2091501894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48e12a79-828b-4f4f-9941-4cbd6fd35fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:51:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4be2f13a-8dc7-4fa1-94a3-687ed55d6ca8 tempest-VolumesTransfersTest-2091501894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d7771dd-b1bf-46e3-bcbf-35f9d266095c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:51:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4be2f13a-8dc7-4fa1-94a3-687ed55d6ca8 tempest-VolumesTransfersTest-2091501894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d7771dd-b1bf-46e3-bcbf-35f9d266095c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e2e6bde-b7d3-4a45-b083-b345c375f7a1', 'volume_name': 'volume-8e2e6bde-b7d3-4a45-b083-b345c375f7a1', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:51:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4be2f13a-8dc7-4fa1-94a3-687ed55d6ca8 tempest-VolumesTransfersTest-2091501894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (631ef29e-9251-4603-b984-3d8d6a67dc60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:51:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4be2f13a-8dc7-4fa1-94a3-687ed55d6ca8 tempest-VolumesTransfersTest-2091501894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (631ef29e-9251-4603-b984-3d8d6a67dc60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:51:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4be2f13a-8dc7-4fa1-94a3-687ed55d6ca8 tempest-VolumesTransfersTest-2091501894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dc3b930-6933-4647-97fa-91765c0be95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:51:33 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-4be2f13a-8dc7-4fa1-94a3-687ed55d6ca8 tempest-VolumesTransfersTest-2091501894 None] Volume 8e2e6bde-b7d3-4a45-b083-b345c375f7a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e2e6bde-b7d3-4a45-b083-b345c375f7a1', 'volume_size': 1}
Jul 10 12:51:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-4be2f13a-8dc7-4fa1-94a3-687ed55d6ca8 tempest-VolumesTransfersTest-2091501894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:51:33 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b371ff4b-f6b6-4521-beff-2eb272093c8b 1073741824" returned: 0 in 0.947s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b371ff4b-f6b6-4521-beff-2eb272093c8b {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:33 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:51:33 devstack sudo[100635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b371ff4b-f6b6-4521-beff-2eb272093c8b
Jul 10 12:51:33 devstack sudo[100635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] Flow 'volume_create_manager' (ecba2c51-c983-4876-bcc3-f06f12f3e8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:51:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d232a428-7843-441b-8715-771867240920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:51:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d232a428-7843-441b-8715-771867240920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:51:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b0e5f7a-00cc-4969-a585-45020e47b4b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6af01ba3ac8b48a1824ba2dc52b49b15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:51:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=72b37049-5704-4169-8b20-62b261913a5a,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:51:34Z,use_quota=True,user_id='677588dbd8904cee8cd250a04408ba9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:51:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17bd7df6-a15c-4b7a-8f2c-6c60bf76d225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:51:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17bd7df6-a15c-4b7a-8f2c-6c60bf76d225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:51:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61925b93-3135-4d99-b3b1-d6b9f7a6c7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:51:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61925b93-3135-4d99-b3b1-d6b9f7a6c7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5b0e5f7a-00cc-4969-a585-45020e47b4b2', 'volume_name': 'volume-5b0e5f7a-00cc-4969-a585-45020e47b4b2', 'volume_size': 1, 'snapshot_id': '72b37049-5704-4169-8b20-62b261913a5a'}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:51:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7cbe8d4-a28b-4f74-8328-aa223a3c32e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:51:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7cbe8d4-a28b-4f74-8328-aa223a3c32e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:51:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71967622-08a3-40be-96f4-8fae9a676d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:51:33 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] Volume 5b0e5f7a-00cc-4969-a585-45020e47b4b2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5b0e5f7a-00cc-4969-a585-45020e47b4b2', 'volume_size': 1, 'snapshot_id': '72b37049-5704-4169-8b20-62b261913a5a'}
Jul 10 12:51:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:51:34 devstack sudo[100635]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b371ff4b-f6b6-4521-beff-2eb272093c8b" returned: 0 in 0.670s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:34 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] <== create_volume: return (1670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:51:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:51:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-4be2f13a-8dc7-4fa1-94a3-687ed55d6ca8 tempest-VolumesTransfersTest-2091501894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.254s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:51:34 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-4be2f13a-8dc7-4fa1-94a3-687ed55d6ca8 tempest-VolumesTransfersTest-2091501894 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:51:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-728736551',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e2e6bde-b7d3-4a45-b083-b345c375f7a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83330ae8f3724cedae9e8435eab4076d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:51:33Z,use_quota=True,user_id='e6888e52d9db460fa55402b227fbb883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:51:34 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-4be2f13a-8dc7-4fa1-94a3-687ed55d6ca8 tempest-VolumesTransfersTest-2091501894 None] Creating volume 8e2e6bde-b7d3-4a45-b083-b345c375f7a1 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:51:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-4be2f13a-8dc7-4fa1-94a3-687ed55d6ca8 tempest-VolumesTransfersTest-2091501894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:51:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-4be2f13a-8dc7-4fa1-94a3-687ed55d6ca8 tempest-VolumesTransfersTest-2091501894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:51:34 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-4be2f13a-8dc7-4fa1-94a3-687ed55d6ca8 tempest-VolumesTransfersTest-2091501894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:51:34 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-4be2f13a-8dc7-4fa1-94a3-687ed55d6ca8 tempest-VolumesTransfersTest-2091501894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:51:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-4be2f13a-8dc7-4fa1-94a3-687ed55d6ca8 tempest-VolumesTransfersTest-2091501894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:51:34 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-4be2f13a-8dc7-4fa1-94a3-687ed55d6ca8 tempest-VolumesTransfersTest-2091501894 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:51:34 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-4be2f13a-8dc7-4fa1-94a3-687ed55d6ca8 tempest-VolumesTransfersTest-2091501894 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:51:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4be2f13a-8dc7-4fa1-94a3-687ed55d6ca8 tempest-VolumesTransfersTest-2091501894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8e2e6bde-b7d3-4a45-b083-b345c375f7a1 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:34 devstack sudo[100638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8e2e6bde-b7d3-4a45-b083-b345c375f7a1 1073741824
Jul 10 12:51:34 devstack sudo[100638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:34 devstack cinder-volume[87378]: DEBUG cinder.volume.volume_utils [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] Attempting download of c73e431b-92e2-4ca0-8142-903361296a8f ((None, [{'url': 'file:///opt/stack/data/glance/images/c73e431b-92e2-4ca0-8142-903361296a8f', 'metadata': {}}])) to volume b371ff4b-f6b6-4521-beff-2eb272093c8b. {{(pid=87378) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 10 12:51:34 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b3cbad-8036-4569-a603-0d962f6894fd]: (4, 'raw') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:51:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c73e431b-92e2-4ca0-8142-903361296a8f_ntwankdg {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:34 devstack sudo[100640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c73e431b-92e2-4ca0-8142-903361296a8f_ntwankdg
Jul 10 12:51:34 devstack sudo[100640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:35 devstack sudo[100640]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c73e431b-92e2-4ca0-8142-903361296a8f_ntwankdg" returned: 0 in 0.766s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c73e431b-92e2-4ca0-8142-903361296a8f_ntwankdg {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:35 devstack sudo[100638]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4be2f13a-8dc7-4fa1-94a3-687ed55d6ca8 tempest-VolumesTransfersTest-2091501894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8e2e6bde-b7d3-4a45-b083-b345c375f7a1 1073741824" returned: 0 in 0.882s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4be2f13a-8dc7-4fa1-94a3-687ed55d6ca8 tempest-VolumesTransfersTest-2091501894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8e2e6bde-b7d3-4a45-b083-b345c375f7a1 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:35 devstack sudo[100654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8e2e6bde-b7d3-4a45-b083-b345c375f7a1
Jul 10 12:51:35 devstack sudo[100654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:35 devstack sudo[100653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c73e431b-92e2-4ca0-8142-903361296a8f_ntwankdg
Jul 10 12:51:35 devstack sudo[100653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:35 devstack sudo[100654]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4be2f13a-8dc7-4fa1-94a3-687ed55d6ca8 tempest-VolumesTransfersTest-2091501894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8e2e6bde-b7d3-4a45-b083-b345c375f7a1" returned: 0 in 0.679s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:35 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-4be2f13a-8dc7-4fa1-94a3-687ed55d6ca8 tempest-VolumesTransfersTest-2091501894 None] <== create_volume: return (1603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:51:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-4be2f13a-8dc7-4fa1-94a3-687ed55d6ca8 tempest-VolumesTransfersTest-2091501894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.606s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:51:35 devstack sudo[100653]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.152s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:51:35 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] Acquiring lock "cinder-quobyte-72b37049-5704-4169-8b20-62b261913a5a-5b0e5f7a-00cc-4969-a585-45020e47b4b2" by "_create_volume_from_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:51:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c73e431b-92e2-4ca0-8142-903361296a8f_ntwankdg" returned: 1 in 0.746s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c73e431b-92e2-4ca0-8142-903361296a8f_ntwankdg' failed. Not Retrying. {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 10 12:51:35 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac64deb-0973-4385-bef4-7e258558eb62]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:51:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_0a1mwddwdevstack@QuobyteHD {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:36 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4be2f13a-8dc7-4fa1-94a3-687ed55d6ca8 tempest-VolumesTransfersTest-2091501894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dc3b930-6933-4647-97fa-91765c0be95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e2e6bde-b7d3-4a45-b083-b345c375f7a1', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:51:36 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4be2f13a-8dc7-4fa1-94a3-687ed55d6ca8 tempest-VolumesTransfersTest-2091501894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c16fa84-bfca-439e-bc4b-5c57fc182fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:51:36 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] Lock "cinder-quobyte-72b37049-5704-4169-8b20-62b261913a5a-5b0e5f7a-00cc-4969-a585-45020e47b4b2" acquired by "_create_volume_from_snapshot" :: waited 0.046s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:51:36 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] Creating volume 5b0e5f7a-00cc-4969-a585-45020e47b4b2 from snapshot 72b37049-5704-4169-8b20-62b261913a5a {{(pid=87378) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 10 12:51:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:51:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:51:36 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:51:36 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:51:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:51:36 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:51:36 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] Acquiring lock "cinder-quobyte-5b0e5f7a-00cc-4969-a585-45020e47b4b2" by "_copy_volume_from_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:51:36 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-4be2f13a-8dc7-4fa1-94a3-687ed55d6ca8 tempest-VolumesTransfersTest-2091501894 None] Volume volume-8e2e6bde-b7d3-4a45-b083-b345c375f7a1 (8e2e6bde-b7d3-4a45-b083-b345c375f7a1): created successfully
Jul 10 12:51:36 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4be2f13a-8dc7-4fa1-94a3-687ed55d6ca8 tempest-VolumesTransfersTest-2091501894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c16fa84-bfca-439e-bc4b-5c57fc182fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:51:36 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4be2f13a-8dc7-4fa1-94a3-687ed55d6ca8 tempest-VolumesTransfersTest-2091501894 None] Flow 'volume_create_manager' (6572c5e4-baff-4a95-95da-20b793490575) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:51:36 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] Lock "cinder-quobyte-5b0e5f7a-00cc-4969-a585-45020e47b4b2" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:51:36 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] snapshot: 72b37049-5704-4169-8b20-62b261913a5a, volume: 5b0e5f7a-00cc-4969-a585-45020e47b4b2,  {{(pid=87378) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 10 12:51:36 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-4be2f13a-8dc7-4fa1-94a3-687ed55d6ca8 tempest-VolumesTransfersTest-2091501894 None] Created volume successfully.
Jul 10 12:51:36 devstack sudo[100660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_0a1mwddwdevstack@QuobyteHD
Jul 10 12:51:36 devstack sudo[100660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:51:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:51:36 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:51:36 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:51:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:51:36 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aadd84b-3e2a-4a0b-a968-bd6ab54ce885]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:51:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597.72b37049-5704-4169-8b20-62b261913a5a {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:36 devstack sudo[100662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597.72b37049-5704-4169-8b20-62b261913a5a
Jul 10 12:51:36 devstack sudo[100662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:36 devstack sudo[100660]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_0a1mwddwdevstack@QuobyteHD" returned: 0 in 0.731s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:36 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] c73e431b-92e2-4ca0-8142-903361296a8f was qcow2, converting to raw {{(pid=87378) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 10 12:51:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_0a1mwddwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b371ff4b-f6b6-4521-beff-2eb272093c8b {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:36 devstack sudo[100667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_0a1mwddwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b371ff4b-f6b6-4521-beff-2eb272093c8b
Jul 10 12:51:36 devstack sudo[100667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:36 devstack sudo[100662]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597.72b37049-5704-4169-8b20-62b261913a5a" returned: 0 in 0.796s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:36 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34f37766-0c00-4b9d-9158-3357518de597(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:51:36 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] will copy from snapshot at /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597 {{(pid=87378) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 10 12:51:36 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] Creating direct copy from snapshot {{(pid=87378) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 10 12:51:36 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b2cf55-e39a-45de-8eba-12280bda6873]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:51:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:37 devstack sudo[100672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597
Jul 10 12:51:37 devstack sudo[100672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:37 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-abfbae06-f63a-459d-a609-817a0d08c594 tempest-VolumesTransfersTest-319069514 None] Acquiring lock "cinder-8e2e6bde-b7d3-4a45-b083-b345c375f7a1-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:51:37 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-abfbae06-f63a-459d-a609-817a0d08c594 tempest-VolumesTransfersTest-319069514 None] Lock "cinder-8e2e6bde-b7d3-4a45-b083-b345c375f7a1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:51:37 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-abfbae06-f63a-459d-a609-817a0d08c594 tempest-VolumesTransfersTest-319069514 None] Acquiring lock "cinder-quobyte-8e2e6bde-b7d3-4a45-b083-b345c375f7a1" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:51:37 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-abfbae06-f63a-459d-a609-817a0d08c594 tempest-VolumesTransfersTest-319069514 None] Lock "cinder-quobyte-8e2e6bde-b7d3-4a45-b083-b345c375f7a1" acquired by "delete_volume" :: waited 0.017s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:51:37 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab03e48f-a4e4-483c-8bf0-f282183dbfef]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:51:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-abfbae06-f63a-459d-a609-817a0d08c594 tempest-VolumesTransfersTest-319069514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8e2e6bde-b7d3-4a45-b083-b345c375f7a1 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:37 devstack sudo[100672]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597" returned: 0 in 0.916s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:37 devstack cinder-volume[87378]: DEBUG cinder.utils [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] Path /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5b0e5f7a-00cc-4969-a585-45020e47b4b2 not found in is_blk_device check {{(pid=87378) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 10 12:51:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5b0e5f7a-00cc-4969-a585-45020e47b4b2 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:37 devstack sudo[100683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8e2e6bde-b7d3-4a45-b083-b345c375f7a1
Jul 10 12:51:37 devstack sudo[100683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:37 devstack sudo[100685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5b0e5f7a-00cc-4969-a585-45020e47b4b2
Jul 10 12:51:37 devstack sudo[100685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:38 devstack sudo[100683]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-abfbae06-f63a-459d-a609-817a0d08c594 tempest-VolumesTransfersTest-319069514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8e2e6bde-b7d3-4a45-b083-b345c375f7a1" returned: 0 in 0.891s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-abfbae06-f63a-459d-a609-817a0d08c594 tempest-VolumesTransfersTest-319069514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8e2e6bde-b7d3-4a45-b083-b345c375f7a1 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:38 devstack sudo[100693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8e2e6bde-b7d3-4a45-b083-b345c375f7a1
Jul 10 12:51:38 devstack sudo[100693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:38 devstack sudo[100667]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_0a1mwddwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b371ff4b-f6b6-4521-beff-2eb272093c8b" returned: 0 in 2.068s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:38 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_0a1mwddwdevstack@QuobyteHD, size 112.00 MB, duration 2.07 sec, destination /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b371ff4b-f6b6-4521-beff-2eb272093c8b {{(pid=87378) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 10 12:51:38 devstack cinder-volume[87378]: INFO cinder.image.image_utils [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] Converted 112.00 MB image at 54.12 MB/s
Jul 10 12:51:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b371ff4b-f6b6-4521-beff-2eb272093c8b 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:38 devstack sudo[100696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b371ff4b-f6b6-4521-beff-2eb272093c8b 1G
Jul 10 12:51:38 devstack sudo[100696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:40 devstack sudo[100693]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-abfbae06-f63a-459d-a609-817a0d08c594 tempest-VolumesTransfersTest-319069514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8e2e6bde-b7d3-4a45-b083-b345c375f7a1" returned: 0 in 1.447s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:40 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-abfbae06-f63a-459d-a609-817a0d08c594 tempest-VolumesTransfersTest-319069514 None] Lock "cinder-quobyte-8e2e6bde-b7d3-4a45-b083-b345c375f7a1" released by "delete_volume" :: held 2.427s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:51:40 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-abfbae06-f63a-459d-a609-817a0d08c594 tempest-VolumesTransfersTest-319069514 None] Created reservations ['6676aadf-52d8-46f7-98d5-5e53ef852c30', '1962881c-2dd9-46be-85b8-53439a5eb60f', '458091ab-c399-4c68-8eb6-e579c5d01583', '6cf48300-c275-4caa-bfdd-79d88f905e2d'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:51:40 devstack sudo[100696]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b371ff4b-f6b6-4521-beff-2eb272093c8b 1G" returned: 0 in 1.597s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-abfbae06-f63a-459d-a609-817a0d08c594 tempest-VolumesTransfersTest-319069514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:51:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-abfbae06-f63a-459d-a609-817a0d08c594 tempest-VolumesTransfersTest-319069514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:51:40 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-abfbae06-f63a-459d-a609-817a0d08c594 tempest-VolumesTransfersTest-319069514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:51:40 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-abfbae06-f63a-459d-a609-817a0d08c594 tempest-VolumesTransfersTest-319069514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:51:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-abfbae06-f63a-459d-a609-817a0d08c594 tempest-VolumesTransfersTest-319069514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:51:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-abfbae06-f63a-459d-a609-817a0d08c594 tempest-VolumesTransfersTest-319069514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:40 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f923782c-2b9c-49ac-8bf9-d43ee01bdc6b]: (4, 'raw') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:51:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b371ff4b-f6b6-4521-beff-2eb272093c8b {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:40 devstack sudo[100710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:51:40 devstack sudo[100710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:40 devstack sudo[100711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b371ff4b-f6b6-4521-beff-2eb272093c8b
Jul 10 12:51:40 devstack sudo[100711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:42 devstack sudo[100710]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-abfbae06-f63a-459d-a609-817a0d08c594 tempest-VolumesTransfersTest-319069514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 1.589s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:42 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-abfbae06-f63a-459d-a609-817a0d08c594 tempest-VolumesTransfersTest-319069514 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:51:42 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-abfbae06-f63a-459d-a609-817a0d08c594 tempest-VolumesTransfersTest-319069514 None] Deleted volume successfully.
Jul 10 12:51:42 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-abfbae06-f63a-459d-a609-817a0d08c594 tempest-VolumesTransfersTest-319069514 None] Lock "cinder-8e2e6bde-b7d3-4a45-b083-b345c375f7a1-delete_volume" released by "delete_volume" :: held 4.489s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:51:42 devstack sudo[100711]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b371ff4b-f6b6-4521-beff-2eb272093c8b" returned: 0 in 1.994s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b371ff4b-f6b6-4521-beff-2eb272093c8b {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:42 devstack sudo[100717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b371ff4b-f6b6-4521-beff-2eb272093c8b
Jul 10 12:51:42 devstack sudo[100717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:43 devstack sudo[100685]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5b0e5f7a-00cc-4969-a585-45020e47b4b2" returned: 0 in 5.940s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:43 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[451d2134-0e97-4b23-a7f5-e84ca63cc5f1]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:51:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:43 devstack sudo[100721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597
Jul 10 12:51:43 devstack sudo[100721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:43 devstack sudo[100717]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b371ff4b-f6b6-4521-beff-2eb272093c8b" returned: 1 in 1.491s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b371ff4b-f6b6-4521-beff-2eb272093c8b' failed. Not Retrying. {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 10 12:51:43 devstack cinder-volume[87378]: DEBUG cinder.volume.volume_utils [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] Downloaded image c73e431b-92e2-4ca0-8142-903361296a8f ((None, [{'url': 'file:///opt/stack/data/glance/images/c73e431b-92e2-4ca0-8142-903361296a8f', 'metadata': {}}])) to volume b371ff4b-f6b6-4521-beff-2eb272093c8b successfully. {{(pid=87378) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 10 12:51:44 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] Temporary image c73e431b-92e2-4ca0-8142-903361296a8f for user fdd7b612fdb047f7908e44fa9926ecd3 is deleted. {{(pid=87378) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 10 12:51:44 devstack cinder-volume[87378]: DEBUG cinder.volume.volume_utils [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] Marking volume b371ff4b-f6b6-4521-beff-2eb272093c8b as bootable. {{(pid=87378) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 10 12:51:44 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] Copying metadata from image c73e431b-92e2-4ca0-8142-903361296a8f to b371ff4b-f6b6-4521-beff-2eb272093c8b. {{(pid=87378) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 10 12:51:44 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] Creating volume glance metadata for volume b371ff4b-f6b6-4521-beff-2eb272093c8b backed by image c73e431b-92e2-4ca0-8142-903361296a8f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c73e431b-92e2-4ca0-8142-903361296a8f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87378) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 10 12:51:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (787d5f69-75c2-4a92-adb9-c9dba665045b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b371ff4b-f6b6-4521-beff-2eb272093c8b', 'volume_size': 1, 'image_id': 'c73e431b-92e2-4ca0-8142-903361296a8f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c73e431b-92e2-4ca0-8142-903361296a8f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ea129ca6c904ec8b3827a458726b692', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c73e431b-92e2-4ca0-8142-903361296a8f', 'created_at': datetime.datetime(2026, 7, 10, 10, 26, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 10, 26, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c73e431b-92e2-4ca0-8142-903361296a8f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74a0a1750a10>}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:51:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9350d79-a8f3-44f5-ae05-6d6c5e37510e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:51:44 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] Volume volume-b371ff4b-f6b6-4521-beff-2eb272093c8b (b371ff4b-f6b6-4521-beff-2eb272093c8b): created successfully
Jul 10 12:51:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9350d79-a8f3-44f5-ae05-6d6c5e37510e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:51:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] Flow 'volume_create_manager' (b5f40aec-d934-4ee7-9a0a-654a7b96cdb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:51:44 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-2792ec75-c46d-45ca-9867-198ebfca1711 tempest-VolumesGetTest-712653248 None] Created volume successfully.
Jul 10 12:51:44 devstack sudo[100721]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597" returned: 0 in 1.070s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:44 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] Image conversion details: src /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597, size 1024.00 MB, duration 5.94 sec, destination /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5b0e5f7a-00cc-4969-a585-45020e47b4b2 {{(pid=87378) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 10 12:51:44 devstack cinder-volume[87378]: INFO cinder.image.image_utils [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] Converted 1024.00 MB image at 172.26 MB/s
Jul 10 12:51:44 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5b0e5f7a-00cc-4969-a585-45020e47b4b2 is being set with open permissions: ugo+rw
Jul 10 12:51:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5b0e5f7a-00cc-4969-a585-45020e47b4b2 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:44 devstack sudo[100728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5b0e5f7a-00cc-4969-a585-45020e47b4b2
Jul 10 12:51:44 devstack sudo[100728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:45 devstack sudo[100728]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5b0e5f7a-00cc-4969-a585-45020e47b4b2" returned: 0 in 0.714s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:45 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] Lock "cinder-quobyte-5b0e5f7a-00cc-4969-a585-45020e47b4b2" released by "_copy_volume_from_snapshot" :: held 9.560s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:51:45 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] Lock "cinder-quobyte-72b37049-5704-4169-8b20-62b261913a5a-5b0e5f7a-00cc-4969-a585-45020e47b4b2" released by "_create_volume_from_snapshot" :: held 9.620s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:51:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.667s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:51:45 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71967622-08a3-40be-96f4-8fae9a676d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b0e5f7a-00cc-4969-a585-45020e47b4b2', 'volume_size': 1, 'snapshot_id': '72b37049-5704-4169-8b20-62b261913a5a'}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:51:45 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa560fb1-4911-4ef0-9bb3-03c6097964a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:51:45 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] Volume volume-5b0e5f7a-00cc-4969-a585-45020e47b4b2 (5b0e5f7a-00cc-4969-a585-45020e47b4b2): created successfully
Jul 10 12:51:45 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa560fb1-4911-4ef0-9bb3-03c6097964a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:51:45 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] Flow 'volume_create_manager' (ecba2c51-c983-4876-bcc3-f06f12f3e8e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:51:45 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-5b3ea2c0-370e-4990-8a52-a650b911abfc tempest-SnapshotDependencyTests-1482164512 None] Created volume successfully.
Jul 10 12:51:46 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-df106633-1763-47ef-a780-05c60852a5a6 tempest-VolumesGetTest-712653248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:51:46 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-df106633-1763-47ef-a780-05c60852a5a6 tempest-VolumesGetTest-712653248 None] Flow 'volume_create_manager' (c968311d-7abd-4f34-948a-33e311b1c1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:51:46 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-df106633-1763-47ef-a780-05c60852a5a6 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de3fbe3d-c0e1-4102-9a6b-68ebe5813493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:51:46 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-df106633-1763-47ef-a780-05c60852a5a6 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de3fbe3d-c0e1-4102-9a6b-68ebe5813493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:51:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1773262084',display_name='tempest-VolumesGetTest-Volume-1807995395',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45af9c1a-6e63-40a7-aff4-981d71b12787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94859412ce094e45ae424b684b73d5b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:51:46Z,use_quota=True,user_id='fdd7b612fdb047f7908e44fa9926ecd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:51:46 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-df106633-1763-47ef-a780-05c60852a5a6 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (226709e4-fab0-4979-894c-b166deeb3608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:51:46 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-df106633-1763-47ef-a780-05c60852a5a6 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (226709e4-fab0-4979-894c-b166deeb3608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:51:46 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-df106633-1763-47ef-a780-05c60852a5a6 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce6c72ca-cad9-4e85-8077-47e29466ff00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:51:46 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-df106633-1763-47ef-a780-05c60852a5a6 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce6c72ca-cad9-4e85-8077-47e29466ff00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45af9c1a-6e63-40a7-aff4-981d71b12787', 'volume_name': 'volume-45af9c1a-6e63-40a7-aff4-981d71b12787', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:51:46 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-df106633-1763-47ef-a780-05c60852a5a6 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2442ffd8-5271-4416-8292-cc79a4d4f7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:51:46 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-df106633-1763-47ef-a780-05c60852a5a6 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2442ffd8-5271-4416-8292-cc79a4d4f7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:51:46 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-df106633-1763-47ef-a780-05c60852a5a6 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (798214d2-39a6-4e8f-a9d2-cdcc2e591fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:51:46 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-df106633-1763-47ef-a780-05c60852a5a6 tempest-VolumesGetTest-712653248 None] Volume 45af9c1a-6e63-40a7-aff4-981d71b12787: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45af9c1a-6e63-40a7-aff4-981d71b12787', 'volume_size': 1}
Jul 10 12:51:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-df106633-1763-47ef-a780-05c60852a5a6 tempest-VolumesGetTest-712653248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:51:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-df106633-1763-47ef-a780-05c60852a5a6 tempest-VolumesGetTest-712653248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:51:46 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-df106633-1763-47ef-a780-05c60852a5a6 tempest-VolumesGetTest-712653248 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:51:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1773262084',display_name='tempest-VolumesGetTest-Volume-1807995395',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45af9c1a-6e63-40a7-aff4-981d71b12787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94859412ce094e45ae424b684b73d5b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:51:46Z,use_quota=True,user_id='fdd7b612fdb047f7908e44fa9926ecd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:51:46 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-df106633-1763-47ef-a780-05c60852a5a6 tempest-VolumesGetTest-712653248 None] Creating volume 45af9c1a-6e63-40a7-aff4-981d71b12787 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:51:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-df106633-1763-47ef-a780-05c60852a5a6 tempest-VolumesGetTest-712653248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:51:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-df106633-1763-47ef-a780-05c60852a5a6 tempest-VolumesGetTest-712653248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:51:46 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-df106633-1763-47ef-a780-05c60852a5a6 tempest-VolumesGetTest-712653248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:51:46 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-df106633-1763-47ef-a780-05c60852a5a6 tempest-VolumesGetTest-712653248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:51:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-df106633-1763-47ef-a780-05c60852a5a6 tempest-VolumesGetTest-712653248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:51:46 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-df106633-1763-47ef-a780-05c60852a5a6 tempest-VolumesGetTest-712653248 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:51:46 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-df106633-1763-47ef-a780-05c60852a5a6 tempest-VolumesGetTest-712653248 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:51:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-df106633-1763-47ef-a780-05c60852a5a6 tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-45af9c1a-6e63-40a7-aff4-981d71b12787 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:46 devstack sudo[100731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-45af9c1a-6e63-40a7-aff4-981d71b12787 1073741824
Jul 10 12:51:46 devstack sudo[100731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:46 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fb61f1c1-56b9-49e3-9205-83e1d71cb0f0 tempest-SnapshotDependencyTests-1482164512 None] Acquiring lock "cinder-72b37049-5704-4169-8b20-62b261913a5a-delete_snapshot" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:51:46 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fb61f1c1-56b9-49e3-9205-83e1d71cb0f0 tempest-SnapshotDependencyTests-1482164512 None] Lock "cinder-72b37049-5704-4169-8b20-62b261913a5a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:51:46 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fb61f1c1-56b9-49e3-9205-83e1d71cb0f0 tempest-SnapshotDependencyTests-1482164512 None] Acquiring lock "cinder-quobyte-34f37766-0c00-4b9d-9158-3357518de597" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:51:46 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fb61f1c1-56b9-49e3-9205-83e1d71cb0f0 tempest-SnapshotDependencyTests-1482164512 None] Lock "cinder-quobyte-34f37766-0c00-4b9d-9158-3357518de597" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:51:46 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fb61f1c1-56b9-49e3-9205-83e1d71cb0f0 tempest-SnapshotDependencyTests-1482164512 None] Acquiring lock "cinder-quobyte-72b37049-5704-4169-8b20-62b261913a5a" by "_delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:51:46 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fb61f1c1-56b9-49e3-9205-83e1d71cb0f0 tempest-SnapshotDependencyTests-1482164512 None] Lock "cinder-quobyte-72b37049-5704-4169-8b20-62b261913a5a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:51:46 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-fb61f1c1-56b9-49e3-9205-83e1d71cb0f0 tempest-SnapshotDependencyTests-1482164512 None] Deleting offline snapshot 72b37049-5704-4169-8b20-62b261913a5a of volume 34f37766-0c00-4b9d-9158-3357518de597 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 10 12:51:46 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-fb61f1c1-56b9-49e3-9205-83e1d71cb0f0 tempest-SnapshotDependencyTests-1482164512 None] snapshot_file for this snap is: volume-34f37766-0c00-4b9d-9158-3357518de597.72b37049-5704-4169-8b20-62b261913a5a {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 10 12:51:46 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1cbf0f-1b09-48e8-8a30-8f40ff6bda31]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:51:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fb61f1c1-56b9-49e3-9205-83e1d71cb0f0 tempest-SnapshotDependencyTests-1482164512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597.72b37049-5704-4169-8b20-62b261913a5a {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:47 devstack sudo[100737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597.72b37049-5704-4169-8b20-62b261913a5a
Jul 10 12:51:47 devstack sudo[100737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:47 devstack sudo[100731]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-df106633-1763-47ef-a780-05c60852a5a6 tempest-VolumesGetTest-712653248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-45af9c1a-6e63-40a7-aff4-981d71b12787 1073741824" returned: 0 in 0.886s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-df106633-1763-47ef-a780-05c60852a5a6 tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-45af9c1a-6e63-40a7-aff4-981d71b12787 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:47 devstack sudo[100739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-45af9c1a-6e63-40a7-aff4-981d71b12787
Jul 10 12:51:47 devstack sudo[100739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:47 devstack sudo[100737]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fb61f1c1-56b9-49e3-9205-83e1d71cb0f0 tempest-SnapshotDependencyTests-1482164512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597.72b37049-5704-4169-8b20-62b261913a5a" returned: 0 in 0.869s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:47 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-fb61f1c1-56b9-49e3-9205-83e1d71cb0f0 tempest-SnapshotDependencyTests-1482164512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34f37766-0c00-4b9d-9158-3357518de597(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:51:47 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5059f8f-49e9-423d-b379-67e3edc70b03]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:51:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fb61f1c1-56b9-49e3-9205-83e1d71cb0f0 tempest-SnapshotDependencyTests-1482164512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:47 devstack sudo[100739]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-df106633-1763-47ef-a780-05c60852a5a6 tempest-VolumesGetTest-712653248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-45af9c1a-6e63-40a7-aff4-981d71b12787" returned: 0 in 0.723s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:47 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-df106633-1763-47ef-a780-05c60852a5a6 tempest-VolumesGetTest-712653248 None] <== create_volume: return (1652ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:51:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-df106633-1763-47ef-a780-05c60852a5a6 tempest-VolumesGetTest-712653248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:51:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-df106633-1763-47ef-a780-05c60852a5a6 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (798214d2-39a6-4e8f-a9d2-cdcc2e591fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45af9c1a-6e63-40a7-aff4-981d71b12787', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:51:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-df106633-1763-47ef-a780-05c60852a5a6 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81bb56dc-f059-49b1-b668-aa77b349d653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:51:47 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-df106633-1763-47ef-a780-05c60852a5a6 tempest-VolumesGetTest-712653248 None] Volume volume-45af9c1a-6e63-40a7-aff4-981d71b12787 (45af9c1a-6e63-40a7-aff4-981d71b12787): created successfully
Jul 10 12:51:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-df106633-1763-47ef-a780-05c60852a5a6 tempest-VolumesGetTest-712653248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81bb56dc-f059-49b1-b668-aa77b349d653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:51:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-df106633-1763-47ef-a780-05c60852a5a6 tempest-VolumesGetTest-712653248 None] Flow 'volume_create_manager' (c968311d-7abd-4f34-948a-33e311b1c1c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:51:47 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-df106633-1763-47ef-a780-05c60852a5a6 tempest-VolumesGetTest-712653248 None] Created volume successfully.
Jul 10 12:51:47 devstack sudo[100745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597
Jul 10 12:51:47 devstack sudo[100745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:48 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-80f04237-4075-4b68-83a1-8ed8ee9d5bfd tempest-VolumesGetTest-712653248 None] Acquiring lock "cinder-45af9c1a-6e63-40a7-aff4-981d71b12787-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:51:48 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-80f04237-4075-4b68-83a1-8ed8ee9d5bfd tempest-VolumesGetTest-712653248 None] Lock "cinder-45af9c1a-6e63-40a7-aff4-981d71b12787-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:51:48 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-80f04237-4075-4b68-83a1-8ed8ee9d5bfd tempest-VolumesGetTest-712653248 None] Acquiring lock "cinder-quobyte-45af9c1a-6e63-40a7-aff4-981d71b12787" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:51:48 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-80f04237-4075-4b68-83a1-8ed8ee9d5bfd tempest-VolumesGetTest-712653248 None] Lock "cinder-quobyte-45af9c1a-6e63-40a7-aff4-981d71b12787" acquired by "delete_volume" :: waited 0.018s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:51:48 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3ff768-53bd-4b69-8b1f-92ebcab5dca8]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:51:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-80f04237-4075-4b68-83a1-8ed8ee9d5bfd tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-45af9c1a-6e63-40a7-aff4-981d71b12787 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:48 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecd6c545-1e23-4cb6-be0e-0da5a1cd335b tempest-VolumesNegativeTest-48519593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:51:48 devstack sudo[100747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-45af9c1a-6e63-40a7-aff4-981d71b12787
Jul 10 12:51:48 devstack sudo[100747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:48 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ecd6c545-1e23-4cb6-be0e-0da5a1cd335b tempest-VolumesNegativeTest-48519593 None] Flow 'volume_create_manager' (39ba5bc0-d920-4a3f-91a5-baf06c19ae96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:51:48 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ecd6c545-1e23-4cb6-be0e-0da5a1cd335b tempest-VolumesNegativeTest-48519593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcaa9b8d-4639-4ebb-81db-78e4bf7d08d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:51:48 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ecd6c545-1e23-4cb6-be0e-0da5a1cd335b tempest-VolumesNegativeTest-48519593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcaa9b8d-4639-4ebb-81db-78e4bf7d08d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-55054351',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=301ea504-a40e-4165-a300-633d66a336cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309722d9c2784174863919f98c7d2657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:51:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:51:48Z,use_quota=True,user_id='db51f14f217f484c9c8e27c98e524406',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:51:48 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ecd6c545-1e23-4cb6-be0e-0da5a1cd335b tempest-VolumesNegativeTest-48519593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7e73646-2058-4716-b815-86b5b171672b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:51:48 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ecd6c545-1e23-4cb6-be0e-0da5a1cd335b tempest-VolumesNegativeTest-48519593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7e73646-2058-4716-b815-86b5b171672b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:51:48 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ecd6c545-1e23-4cb6-be0e-0da5a1cd335b tempest-VolumesNegativeTest-48519593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55501b1c-8cc3-4cf7-83ce-e41787e49c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:51:48 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ecd6c545-1e23-4cb6-be0e-0da5a1cd335b tempest-VolumesNegativeTest-48519593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55501b1c-8cc3-4cf7-83ce-e41787e49c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '301ea504-a40e-4165-a300-633d66a336cc', 'volume_name': 'volume-301ea504-a40e-4165-a300-633d66a336cc', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:51:48 devstack sudo[100745]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:48 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ecd6c545-1e23-4cb6-be0e-0da5a1cd335b tempest-VolumesNegativeTest-48519593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f809e339-03ab-4606-bc59-06c3da4e8edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:51:48 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ecd6c545-1e23-4cb6-be0e-0da5a1cd335b tempest-VolumesNegativeTest-48519593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f809e339-03ab-4606-bc59-06c3da4e8edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:51:48 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ecd6c545-1e23-4cb6-be0e-0da5a1cd335b tempest-VolumesNegativeTest-48519593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7b49eff-2c78-400c-9a82-204e9c78d818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:51:48 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-ecd6c545-1e23-4cb6-be0e-0da5a1cd335b tempest-VolumesNegativeTest-48519593 None] Volume 301ea504-a40e-4165-a300-633d66a336cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-301ea504-a40e-4165-a300-633d66a336cc', 'volume_size': 1}
Jul 10 12:51:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ecd6c545-1e23-4cb6-be0e-0da5a1cd335b tempest-VolumesNegativeTest-48519593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:51:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ecd6c545-1e23-4cb6-be0e-0da5a1cd335b tempest-VolumesNegativeTest-48519593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:51:48 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-ecd6c545-1e23-4cb6-be0e-0da5a1cd335b tempest-VolumesNegativeTest-48519593 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-55054351',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=301ea504-a40e-4165-a300-633d66a336cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309722d9c2784174863919f98c7d2657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:51:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:51:48Z,use_quota=True,user_id='db51f14f217f484c9c8e27c98e524406',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:51:48 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-ecd6c545-1e23-4cb6-be0e-0da5a1cd335b tempest-VolumesNegativeTest-48519593 None] Creating volume 301ea504-a40e-4165-a300-633d66a336cc {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:51:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ecd6c545-1e23-4cb6-be0e-0da5a1cd335b tempest-VolumesNegativeTest-48519593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:51:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ecd6c545-1e23-4cb6-be0e-0da5a1cd335b tempest-VolumesNegativeTest-48519593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:51:48 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-ecd6c545-1e23-4cb6-be0e-0da5a1cd335b tempest-VolumesNegativeTest-48519593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:51:48 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-ecd6c545-1e23-4cb6-be0e-0da5a1cd335b tempest-VolumesNegativeTest-48519593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:51:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ecd6c545-1e23-4cb6-be0e-0da5a1cd335b tempest-VolumesNegativeTest-48519593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:51:48 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-ecd6c545-1e23-4cb6-be0e-0da5a1cd335b tempest-VolumesNegativeTest-48519593 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:51:48 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-ecd6c545-1e23-4cb6-be0e-0da5a1cd335b tempest-VolumesNegativeTest-48519593 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:51:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ecd6c545-1e23-4cb6-be0e-0da5a1cd335b tempest-VolumesNegativeTest-48519593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-301ea504-a40e-4165-a300-633d66a336cc 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fb61f1c1-56b9-49e3-9205-83e1d71cb0f0 tempest-SnapshotDependencyTests-1482164512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597" returned: 0 in 0.861s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fb61f1c1-56b9-49e3-9205-83e1d71cb0f0 tempest-SnapshotDependencyTests-1482164512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597.72b37049-5704-4169-8b20-62b261913a5a {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:48 devstack sudo[100753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-301ea504-a40e-4165-a300-633d66a336cc 1073741824
Jul 10 12:51:48 devstack sudo[100753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:48 devstack sudo[100754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597.72b37049-5704-4169-8b20-62b261913a5a
Jul 10 12:51:48 devstack sudo[100754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:49 devstack sudo[100747]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-80f04237-4075-4b68-83a1-8ed8ee9d5bfd tempest-VolumesGetTest-712653248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-45af9c1a-6e63-40a7-aff4-981d71b12787" returned: 0 in 0.777s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-80f04237-4075-4b68-83a1-8ed8ee9d5bfd tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-45af9c1a-6e63-40a7-aff4-981d71b12787 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:49 devstack sudo[100761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-45af9c1a-6e63-40a7-aff4-981d71b12787
Jul 10 12:51:49 devstack sudo[100761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:49 devstack sudo[100754]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fb61f1c1-56b9-49e3-9205-83e1d71cb0f0 tempest-SnapshotDependencyTests-1482164512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597.72b37049-5704-4169-8b20-62b261913a5a" returned: 0 in 0.827s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fb61f1c1-56b9-49e3-9205-83e1d71cb0f0 tempest-SnapshotDependencyTests-1482164512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597.72b37049-5704-4169-8b20-62b261913a5a {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:49 devstack sudo[100770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597.72b37049-5704-4169-8b20-62b261913a5a
Jul 10 12:51:49 devstack sudo[100770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:49 devstack sudo[100753]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ecd6c545-1e23-4cb6-be0e-0da5a1cd335b tempest-VolumesNegativeTest-48519593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-301ea504-a40e-4165-a300-633d66a336cc 1073741824" returned: 0 in 0.905s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ecd6c545-1e23-4cb6-be0e-0da5a1cd335b tempest-VolumesNegativeTest-48519593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-301ea504-a40e-4165-a300-633d66a336cc {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:49 devstack sudo[100772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-301ea504-a40e-4165-a300-633d66a336cc
Jul 10 12:51:49 devstack sudo[100772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:49 devstack sudo[100761]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-80f04237-4075-4b68-83a1-8ed8ee9d5bfd tempest-VolumesGetTest-712653248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-45af9c1a-6e63-40a7-aff4-981d71b12787" returned: 0 in 0.707s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:49 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-80f04237-4075-4b68-83a1-8ed8ee9d5bfd tempest-VolumesGetTest-712653248 None] Lock "cinder-quobyte-45af9c1a-6e63-40a7-aff4-981d71b12787" released by "delete_volume" :: held 1.541s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:51:49 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-80f04237-4075-4b68-83a1-8ed8ee9d5bfd tempest-VolumesGetTest-712653248 None] Created reservations ['72361375-7bcd-4e1c-b6b0-b9363f26f532', '595835bb-399a-4aaa-9684-920bb461f59c', '281f897a-a4ce-4d99-bd93-1f7c92b2ac9e', '843c8fe3-5c24-4634-a157-b87f85d93b5f'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:51:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-80f04237-4075-4b68-83a1-8ed8ee9d5bfd tempest-VolumesGetTest-712653248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:51:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-80f04237-4075-4b68-83a1-8ed8ee9d5bfd tempest-VolumesGetTest-712653248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:51:50 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-80f04237-4075-4b68-83a1-8ed8ee9d5bfd tempest-VolumesGetTest-712653248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:51:50 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-80f04237-4075-4b68-83a1-8ed8ee9d5bfd tempest-VolumesGetTest-712653248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:51:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-80f04237-4075-4b68-83a1-8ed8ee9d5bfd tempest-VolumesGetTest-712653248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:51:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-80f04237-4075-4b68-83a1-8ed8ee9d5bfd tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:50 devstack sudo[100775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:51:50 devstack sudo[100775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:50 devstack sudo[100770]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fb61f1c1-56b9-49e3-9205-83e1d71cb0f0 tempest-SnapshotDependencyTests-1482164512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597.72b37049-5704-4169-8b20-62b261913a5a" returned: 0 in 0.706s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:50 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fb61f1c1-56b9-49e3-9205-83e1d71cb0f0 tempest-SnapshotDependencyTests-1482164512 None] Lock "cinder-quobyte-72b37049-5704-4169-8b20-62b261913a5a" released by "_delete_snapshot" :: held 3.398s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:51:50 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fb61f1c1-56b9-49e3-9205-83e1d71cb0f0 tempest-SnapshotDependencyTests-1482164512 None] Lock "cinder-quobyte-34f37766-0c00-4b9d-9158-3357518de597" released by "delete_snapshot" :: held 3.427s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:51:50 devstack sudo[100772]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ecd6c545-1e23-4cb6-be0e-0da5a1cd335b tempest-VolumesNegativeTest-48519593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-301ea504-a40e-4165-a300-633d66a336cc" returned: 0 in 0.709s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:50 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-ecd6c545-1e23-4cb6-be0e-0da5a1cd335b tempest-VolumesNegativeTest-48519593 None] <== create_volume: return (1657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:51:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ecd6c545-1e23-4cb6-be0e-0da5a1cd335b tempest-VolumesNegativeTest-48519593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.660s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:51:50 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ecd6c545-1e23-4cb6-be0e-0da5a1cd335b tempest-VolumesNegativeTest-48519593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7b49eff-2c78-400c-9a82-204e9c78d818) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-301ea504-a40e-4165-a300-633d66a336cc', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:51:50 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ecd6c545-1e23-4cb6-be0e-0da5a1cd335b tempest-VolumesNegativeTest-48519593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68c2d55e-2f7e-4268-88e0-6f283501ebcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:51:50 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-ecd6c545-1e23-4cb6-be0e-0da5a1cd335b tempest-VolumesNegativeTest-48519593 None] Volume volume-301ea504-a40e-4165-a300-633d66a336cc (301ea504-a40e-4165-a300-633d66a336cc): created successfully
Jul 10 12:51:50 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ecd6c545-1e23-4cb6-be0e-0da5a1cd335b tempest-VolumesNegativeTest-48519593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68c2d55e-2f7e-4268-88e0-6f283501ebcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:51:50 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ecd6c545-1e23-4cb6-be0e-0da5a1cd335b tempest-VolumesNegativeTest-48519593 None] Flow 'volume_create_manager' (39ba5bc0-d920-4a3f-91a5-baf06c19ae96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:51:50 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-fb61f1c1-56b9-49e3-9205-83e1d71cb0f0 tempest-SnapshotDependencyTests-1482164512 None] Created reservations ['756f6346-85a4-451b-a7ad-9c5f8cc8cca2', 'fe344e81-0f8e-4678-ba99-20756ad90e45', '4ca22ef9-674b-41a2-9cbc-f69a05f3a81c', 'f4dff8b7-157e-4da6-a53d-d710e5677165'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:51:50 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-ecd6c545-1e23-4cb6-be0e-0da5a1cd335b tempest-VolumesNegativeTest-48519593 None] Created volume successfully.
Jul 10 12:51:50 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-fb61f1c1-56b9-49e3-9205-83e1d71cb0f0 tempest-SnapshotDependencyTests-1482164512 None] Delete snapshot completed successfully.
Jul 10 12:51:50 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fb61f1c1-56b9-49e3-9205-83e1d71cb0f0 tempest-SnapshotDependencyTests-1482164512 None] Lock "cinder-72b37049-5704-4169-8b20-62b261913a5a-delete_snapshot" released by "delete_snapshot" :: held 3.605s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:51:50 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-0d774f2a-4b6e-436d-899f-20f08adb334c tempest-VolumesGetTest-712653248 None] Acquiring lock "cinder-b371ff4b-f6b6-4521-beff-2eb272093c8b-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:51:50 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-0d774f2a-4b6e-436d-899f-20f08adb334c tempest-VolumesGetTest-712653248 None] Lock "cinder-b371ff4b-f6b6-4521-beff-2eb272093c8b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:51:50 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-0d774f2a-4b6e-436d-899f-20f08adb334c tempest-VolumesGetTest-712653248 None] Acquiring lock "cinder-quobyte-b371ff4b-f6b6-4521-beff-2eb272093c8b" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:51:50 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-0d774f2a-4b6e-436d-899f-20f08adb334c tempest-VolumesGetTest-712653248 None] Lock "cinder-quobyte-b371ff4b-f6b6-4521-beff-2eb272093c8b" acquired by "delete_volume" :: waited 0.023s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:51:50 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[1329b421-8a33-49b8-85f2-a9fb538b22f8]: (4, 'raw') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:51:50 devstack sudo[100775]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0d774f2a-4b6e-436d-899f-20f08adb334c tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b371ff4b-f6b6-4521-beff-2eb272093c8b {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-80f04237-4075-4b68-83a1-8ed8ee9d5bfd tempest-VolumesGetTest-712653248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.759s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:50 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-80f04237-4075-4b68-83a1-8ed8ee9d5bfd tempest-VolumesGetTest-712653248 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:51:50 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-80f04237-4075-4b68-83a1-8ed8ee9d5bfd tempest-VolumesGetTest-712653248 None] Deleted volume successfully.
Jul 10 12:51:50 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-80f04237-4075-4b68-83a1-8ed8ee9d5bfd tempest-VolumesGetTest-712653248 None] Lock "cinder-45af9c1a-6e63-40a7-aff4-981d71b12787-delete_volume" released by "delete_volume" :: held 2.524s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:51:50 devstack sudo[100780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b371ff4b-f6b6-4521-beff-2eb272093c8b
Jul 10 12:51:50 devstack sudo[100780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:51 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f43bda06-55f0-4742-82f0-00ed89d4c974 tempest-SnapshotDependencyTests-1482164512 None] Acquiring lock "cinder-34f37766-0c00-4b9d-9158-3357518de597-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:51:51 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f43bda06-55f0-4742-82f0-00ed89d4c974 tempest-SnapshotDependencyTests-1482164512 None] Lock "cinder-34f37766-0c00-4b9d-9158-3357518de597-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:51:51 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f43bda06-55f0-4742-82f0-00ed89d4c974 tempest-SnapshotDependencyTests-1482164512 None] Acquiring lock "cinder-quobyte-34f37766-0c00-4b9d-9158-3357518de597" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:51:51 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f43bda06-55f0-4742-82f0-00ed89d4c974 tempest-SnapshotDependencyTests-1482164512 None] Lock "cinder-quobyte-34f37766-0c00-4b9d-9158-3357518de597" acquired by "delete_volume" :: waited 0.025s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:51:51 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[668202c4-a35f-4bf2-980a-3c345758292f]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:51:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f43bda06-55f0-4742-82f0-00ed89d4c974 tempest-SnapshotDependencyTests-1482164512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:51 devstack sudo[100785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597
Jul 10 12:51:51 devstack sudo[100785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:51 devstack sudo[100780]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0d774f2a-4b6e-436d-899f-20f08adb334c tempest-VolumesGetTest-712653248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b371ff4b-f6b6-4521-beff-2eb272093c8b" returned: 0 in 0.831s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0d774f2a-4b6e-436d-899f-20f08adb334c tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b371ff4b-f6b6-4521-beff-2eb272093c8b {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:51 devstack sudo[100789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b371ff4b-f6b6-4521-beff-2eb272093c8b
Jul 10 12:51:51 devstack sudo[100789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:51 devstack sudo[100785]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f43bda06-55f0-4742-82f0-00ed89d4c974 tempest-SnapshotDependencyTests-1482164512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597" returned: 0 in 0.810s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f43bda06-55f0-4742-82f0-00ed89d4c974 tempest-SnapshotDependencyTests-1482164512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:52 devstack sudo[100794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597
Jul 10 12:51:52 devstack sudo[100794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:52 devstack sudo[100789]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0d774f2a-4b6e-436d-899f-20f08adb334c tempest-VolumesGetTest-712653248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b371ff4b-f6b6-4521-beff-2eb272093c8b" returned: 1 in 0.847s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0d774f2a-4b6e-436d-899f-20f08adb334c tempest-VolumesGetTest-712653248 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b371ff4b-f6b6-4521-beff-2eb272093c8b' failed. Not Retrying. {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 10 12:51:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0d774f2a-4b6e-436d-899f-20f08adb334c tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b371ff4b-f6b6-4521-beff-2eb272093c8b {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:52 devstack sudo[100799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b371ff4b-f6b6-4521-beff-2eb272093c8b
Jul 10 12:51:52 devstack sudo[100799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:52 devstack sudo[100794]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f43bda06-55f0-4742-82f0-00ed89d4c974 tempest-SnapshotDependencyTests-1482164512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-34f37766-0c00-4b9d-9158-3357518de597" returned: 0 in 0.703s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:52 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f43bda06-55f0-4742-82f0-00ed89d4c974 tempest-SnapshotDependencyTests-1482164512 None] Lock "cinder-quobyte-34f37766-0c00-4b9d-9158-3357518de597" released by "delete_volume" :: held 1.593s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:51:52 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-f43bda06-55f0-4742-82f0-00ed89d4c974 tempest-SnapshotDependencyTests-1482164512 None] Created reservations ['fa8a4d81-c212-4549-926b-2f4b4ad40eab', 'c133dd08-0196-4a3a-a0a8-8e5cd4d81472', '26f8093d-5132-4781-9fcd-29899b8bf455', 'ba64ef01-dfa9-4f8b-ad96-e3ed91555592'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:51:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f43bda06-55f0-4742-82f0-00ed89d4c974 tempest-SnapshotDependencyTests-1482164512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:51:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f43bda06-55f0-4742-82f0-00ed89d4c974 tempest-SnapshotDependencyTests-1482164512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:51:52 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-f43bda06-55f0-4742-82f0-00ed89d4c974 tempest-SnapshotDependencyTests-1482164512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:51:52 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-f43bda06-55f0-4742-82f0-00ed89d4c974 tempest-SnapshotDependencyTests-1482164512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:51:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f43bda06-55f0-4742-82f0-00ed89d4c974 tempest-SnapshotDependencyTests-1482164512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:51:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f43bda06-55f0-4742-82f0-00ed89d4c974 tempest-SnapshotDependencyTests-1482164512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:52 devstack sudo[100802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:51:52 devstack sudo[100802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:53 devstack sudo[100799]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0d774f2a-4b6e-436d-899f-20f08adb334c tempest-VolumesGetTest-712653248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b371ff4b-f6b6-4521-beff-2eb272093c8b" returned: 0 in 0.680s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:53 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-0d774f2a-4b6e-436d-899f-20f08adb334c tempest-VolumesGetTest-712653248 None] Lock "cinder-quobyte-b371ff4b-f6b6-4521-beff-2eb272093c8b" released by "delete_volume" :: held 2.432s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:51:53 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-0d774f2a-4b6e-436d-899f-20f08adb334c tempest-VolumesGetTest-712653248 None] Created reservations ['2456ccce-f1b0-4b39-a66c-06a98055d884', '3fe2c4ff-48f9-4d5b-bc9f-03acaab4fee7', '06fce695-b4ca-48a8-9a44-10d5f370e95b', '73325558-e53f-45dc-8636-ca425a2f4c01'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:51:53 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e804309d-6a8c-44b4-a256-53413316d5db tempest-SnapshotDependencyTests-1482164512 None] Acquiring lock "cinder-5b0e5f7a-00cc-4969-a585-45020e47b4b2-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:51:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0d774f2a-4b6e-436d-899f-20f08adb334c tempest-VolumesGetTest-712653248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:51:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0d774f2a-4b6e-436d-899f-20f08adb334c tempest-VolumesGetTest-712653248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:51:53 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-0d774f2a-4b6e-436d-899f-20f08adb334c tempest-VolumesGetTest-712653248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:51:53 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-0d774f2a-4b6e-436d-899f-20f08adb334c tempest-VolumesGetTest-712653248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:51:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0d774f2a-4b6e-436d-899f-20f08adb334c tempest-VolumesGetTest-712653248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:51:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0d774f2a-4b6e-436d-899f-20f08adb334c tempest-VolumesGetTest-712653248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:53 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e804309d-6a8c-44b4-a256-53413316d5db tempest-SnapshotDependencyTests-1482164512 None] Lock "cinder-5b0e5f7a-00cc-4969-a585-45020e47b4b2-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:51:53 devstack sudo[100805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:51:53 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:53 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e804309d-6a8c-44b4-a256-53413316d5db tempest-SnapshotDependencyTests-1482164512 None] Acquiring lock "cinder-quobyte-5b0e5f7a-00cc-4969-a585-45020e47b4b2" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:51:53 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e804309d-6a8c-44b4-a256-53413316d5db tempest-SnapshotDependencyTests-1482164512 None] Lock "cinder-quobyte-5b0e5f7a-00cc-4969-a585-45020e47b4b2" acquired by "delete_volume" :: waited 0.015s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:51:53 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[17611dcf-f627-4ea1-8284-b3f129ad95f3]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:51:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e804309d-6a8c-44b4-a256-53413316d5db tempest-SnapshotDependencyTests-1482164512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5b0e5f7a-00cc-4969-a585-45020e47b4b2 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:53 devstack sudo[100802]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:53 devstack sudo[100808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5b0e5f7a-00cc-4969-a585-45020e47b4b2
Jul 10 12:51:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f43bda06-55f0-4742-82f0-00ed89d4c974 tempest-SnapshotDependencyTests-1482164512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.737s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:53 devstack sudo[100808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:53 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-f43bda06-55f0-4742-82f0-00ed89d4c974 tempest-SnapshotDependencyTests-1482164512 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:51:53 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-f43bda06-55f0-4742-82f0-00ed89d4c974 tempest-SnapshotDependencyTests-1482164512 None] Deleted volume successfully.
Jul 10 12:51:53 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f43bda06-55f0-4742-82f0-00ed89d4c974 tempest-SnapshotDependencyTests-1482164512 None] Lock "cinder-34f37766-0c00-4b9d-9158-3357518de597-delete_volume" released by "delete_volume" :: held 2.569s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:51:54 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0d774f2a-4b6e-436d-899f-20f08adb334c tempest-VolumesGetTest-712653248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.718s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:54 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-0d774f2a-4b6e-436d-899f-20f08adb334c tempest-VolumesGetTest-712653248 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:51:54 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-0d774f2a-4b6e-436d-899f-20f08adb334c tempest-VolumesGetTest-712653248 None] Deleted volume successfully.
Jul 10 12:51:54 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-0d774f2a-4b6e-436d-899f-20f08adb334c tempest-VolumesGetTest-712653248 None] Lock "cinder-b371ff4b-f6b6-4521-beff-2eb272093c8b-delete_volume" released by "delete_volume" :: held 3.414s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:51:54 devstack sudo[100808]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e804309d-6a8c-44b4-a256-53413316d5db tempest-SnapshotDependencyTests-1482164512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5b0e5f7a-00cc-4969-a585-45020e47b4b2" returned: 0 in 0.888s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e804309d-6a8c-44b4-a256-53413316d5db tempest-SnapshotDependencyTests-1482164512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5b0e5f7a-00cc-4969-a585-45020e47b4b2 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:54 devstack sudo[100814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5b0e5f7a-00cc-4969-a585-45020e47b4b2
Jul 10 12:51:54 devstack sudo[100814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:55 devstack sudo[100814]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e804309d-6a8c-44b4-a256-53413316d5db tempest-SnapshotDependencyTests-1482164512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5b0e5f7a-00cc-4969-a585-45020e47b4b2" returned: 0 in 0.685s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:55 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e804309d-6a8c-44b4-a256-53413316d5db tempest-SnapshotDependencyTests-1482164512 None] Lock "cinder-quobyte-5b0e5f7a-00cc-4969-a585-45020e47b4b2" released by "delete_volume" :: held 1.625s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:51:55 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-e804309d-6a8c-44b4-a256-53413316d5db tempest-SnapshotDependencyTests-1482164512 None] Created reservations ['71a3134e-454c-4825-903c-4df6d49c9bcc', '8c84a2d8-da26-418b-9684-90065fdee5b6', 'ebe29f0b-4061-4894-ac2b-729e31a2ffd4', 'a7b890a0-865f-4e3b-bb5a-0f41f2d1a249'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:51:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e804309d-6a8c-44b4-a256-53413316d5db tempest-SnapshotDependencyTests-1482164512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:51:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e804309d-6a8c-44b4-a256-53413316d5db tempest-SnapshotDependencyTests-1482164512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:51:55 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-e804309d-6a8c-44b4-a256-53413316d5db tempest-SnapshotDependencyTests-1482164512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:51:55 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-e804309d-6a8c-44b4-a256-53413316d5db tempest-SnapshotDependencyTests-1482164512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:51:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e804309d-6a8c-44b4-a256-53413316d5db tempest-SnapshotDependencyTests-1482164512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:51:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e804309d-6a8c-44b4-a256-53413316d5db tempest-SnapshotDependencyTests-1482164512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:51:55 devstack sudo[100817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:51:55 devstack sudo[100817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:51:55 devstack sudo[100817]: pam_unix(sudo:session): session closed for user root
Jul 10 12:51:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e804309d-6a8c-44b4-a256-53413316d5db tempest-SnapshotDependencyTests-1482164512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.746s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:51:55 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-e804309d-6a8c-44b4-a256-53413316d5db tempest-SnapshotDependencyTests-1482164512 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:51:55 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-e804309d-6a8c-44b4-a256-53413316d5db tempest-SnapshotDependencyTests-1482164512 None] Deleted volume successfully.
Jul 10 12:51:55 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e804309d-6a8c-44b4-a256-53413316d5db tempest-SnapshotDependencyTests-1482164512 None] Lock "cinder-5b0e5f7a-00cc-4969-a585-45020e47b4b2-delete_volume" released by "delete_volume" :: held 2.601s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:52:01 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb1780a6-d80e-4516-b3e4-8601e00453d0 tempest-VolumesListTestJSON-2067873647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:52:01 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-cb1780a6-d80e-4516-b3e4-8601e00453d0 tempest-VolumesListTestJSON-2067873647 None] Flow 'volume_create_manager' (14550440-8a3b-467e-ad80-79ad6e996085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:52:01 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-cb1780a6-d80e-4516-b3e4-8601e00453d0 tempest-VolumesListTestJSON-2067873647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49d15aa7-3220-488e-aaee-11dc8a251082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:52:01 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-cb1780a6-d80e-4516-b3e4-8601e00453d0 tempest-VolumesListTestJSON-2067873647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49d15aa7-3220-488e-aaee-11dc8a251082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:52:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1105628422',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77d266b7-0ff5-4cbd-90dc-10cd884f7e1c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='641bf36ba13042718f8f603acb60d879',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:52:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:52:01Z,use_quota=True,user_id='0c991624f8184b1daeb529f2b7681b00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:52:01 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-cb1780a6-d80e-4516-b3e4-8601e00453d0 tempest-VolumesListTestJSON-2067873647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b327d900-4d1d-4a39-b068-ba1c52415433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:52:01 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-cb1780a6-d80e-4516-b3e4-8601e00453d0 tempest-VolumesListTestJSON-2067873647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b327d900-4d1d-4a39-b068-ba1c52415433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:52:01 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-cb1780a6-d80e-4516-b3e4-8601e00453d0 tempest-VolumesListTestJSON-2067873647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (880e3f52-45f4-4736-bb42-2d7919f80fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:52:01 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-cb1780a6-d80e-4516-b3e4-8601e00453d0 tempest-VolumesListTestJSON-2067873647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (880e3f52-45f4-4736-bb42-2d7919f80fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77d266b7-0ff5-4cbd-90dc-10cd884f7e1c', 'volume_name': 'volume-77d266b7-0ff5-4cbd-90dc-10cd884f7e1c', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:52:01 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-cb1780a6-d80e-4516-b3e4-8601e00453d0 tempest-VolumesListTestJSON-2067873647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (613c36da-c61b-4baf-b66f-480b758d101a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:52:01 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-cb1780a6-d80e-4516-b3e4-8601e00453d0 tempest-VolumesListTestJSON-2067873647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (613c36da-c61b-4baf-b66f-480b758d101a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:52:01 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-cb1780a6-d80e-4516-b3e4-8601e00453d0 tempest-VolumesListTestJSON-2067873647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d69fd8bb-8c90-4b4d-ba26-ada0605cb66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:52:01 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-cb1780a6-d80e-4516-b3e4-8601e00453d0 tempest-VolumesListTestJSON-2067873647 None] Volume 77d266b7-0ff5-4cbd-90dc-10cd884f7e1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77d266b7-0ff5-4cbd-90dc-10cd884f7e1c', 'volume_size': 1}
Jul 10 12:52:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-cb1780a6-d80e-4516-b3e4-8601e00453d0 tempest-VolumesListTestJSON-2067873647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:52:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-cb1780a6-d80e-4516-b3e4-8601e00453d0 tempest-VolumesListTestJSON-2067873647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:52:01 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-cb1780a6-d80e-4516-b3e4-8601e00453d0 tempest-VolumesListTestJSON-2067873647 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:52:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1105628422',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77d266b7-0ff5-4cbd-90dc-10cd884f7e1c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='641bf36ba13042718f8f603acb60d879',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:52:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:52:01Z,use_quota=True,user_id='0c991624f8184b1daeb529f2b7681b00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:52:01 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-cb1780a6-d80e-4516-b3e4-8601e00453d0 tempest-VolumesListTestJSON-2067873647 None] Creating volume 77d266b7-0ff5-4cbd-90dc-10cd884f7e1c {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:52:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-cb1780a6-d80e-4516-b3e4-8601e00453d0 tempest-VolumesListTestJSON-2067873647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:52:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-cb1780a6-d80e-4516-b3e4-8601e00453d0 tempest-VolumesListTestJSON-2067873647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:52:01 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-cb1780a6-d80e-4516-b3e4-8601e00453d0 tempest-VolumesListTestJSON-2067873647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:52:01 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-cb1780a6-d80e-4516-b3e4-8601e00453d0 tempest-VolumesListTestJSON-2067873647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:52:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-cb1780a6-d80e-4516-b3e4-8601e00453d0 tempest-VolumesListTestJSON-2067873647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:52:01 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-cb1780a6-d80e-4516-b3e4-8601e00453d0 tempest-VolumesListTestJSON-2067873647 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:52:01 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-cb1780a6-d80e-4516-b3e4-8601e00453d0 tempest-VolumesListTestJSON-2067873647 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:52:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cb1780a6-d80e-4516-b3e4-8601e00453d0 tempest-VolumesListTestJSON-2067873647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-77d266b7-0ff5-4cbd-90dc-10cd884f7e1c 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:52:01 devstack sudo[100842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-77d266b7-0ff5-4cbd-90dc-10cd884f7e1c 1073741824
Jul 10 12:52:01 devstack sudo[100842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:52:02 devstack sudo[100842]: pam_unix(sudo:session): session closed for user root
Jul 10 12:52:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cb1780a6-d80e-4516-b3e4-8601e00453d0 tempest-VolumesListTestJSON-2067873647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-77d266b7-0ff5-4cbd-90dc-10cd884f7e1c 1073741824" returned: 0 in 0.972s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:52:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cb1780a6-d80e-4516-b3e4-8601e00453d0 tempest-VolumesListTestJSON-2067873647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-77d266b7-0ff5-4cbd-90dc-10cd884f7e1c {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:52:02 devstack sudo[100849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-77d266b7-0ff5-4cbd-90dc-10cd884f7e1c
Jul 10 12:52:02 devstack sudo[100849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:52:03 devstack sudo[100849]: pam_unix(sudo:session): session closed for user root
Jul 10 12:52:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cb1780a6-d80e-4516-b3e4-8601e00453d0 tempest-VolumesListTestJSON-2067873647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-77d266b7-0ff5-4cbd-90dc-10cd884f7e1c" returned: 0 in 0.698s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:52:03 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-cb1780a6-d80e-4516-b3e4-8601e00453d0 tempest-VolumesListTestJSON-2067873647 None] <== create_volume: return (1714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:52:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-cb1780a6-d80e-4516-b3e4-8601e00453d0 tempest-VolumesListTestJSON-2067873647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.716s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:52:03 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-cb1780a6-d80e-4516-b3e4-8601e00453d0 tempest-VolumesListTestJSON-2067873647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d69fd8bb-8c90-4b4d-ba26-ada0605cb66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77d266b7-0ff5-4cbd-90dc-10cd884f7e1c', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:52:03 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-cb1780a6-d80e-4516-b3e4-8601e00453d0 tempest-VolumesListTestJSON-2067873647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31a52241-a54c-465c-916e-3ec764b9ebdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:52:03 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-cb1780a6-d80e-4516-b3e4-8601e00453d0 tempest-VolumesListTestJSON-2067873647 None] Volume volume-77d266b7-0ff5-4cbd-90dc-10cd884f7e1c (77d266b7-0ff5-4cbd-90dc-10cd884f7e1c): created successfully
Jul 10 12:52:03 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-cb1780a6-d80e-4516-b3e4-8601e00453d0 tempest-VolumesListTestJSON-2067873647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31a52241-a54c-465c-916e-3ec764b9ebdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:52:03 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-cb1780a6-d80e-4516-b3e4-8601e00453d0 tempest-VolumesListTestJSON-2067873647 None] Flow 'volume_create_manager' (14550440-8a3b-467e-ad80-79ad6e996085) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:52:03 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-cb1780a6-d80e-4516-b3e4-8601e00453d0 tempest-VolumesListTestJSON-2067873647 None] Created volume successfully.
Jul 10 12:52:04 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa5f8428-6cd9-40f4-a791-14026e723f3c tempest-VolumesListTestJSON-2067873647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:52:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-aa5f8428-6cd9-40f4-a791-14026e723f3c tempest-VolumesListTestJSON-2067873647 None] Flow 'volume_create_manager' (5b2e45dc-7975-4350-99fb-39060785c5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:52:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-aa5f8428-6cd9-40f4-a791-14026e723f3c tempest-VolumesListTestJSON-2067873647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39e5e35e-b7bf-4d8b-b833-a36eb6e2a44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:52:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-aa5f8428-6cd9-40f4-a791-14026e723f3c tempest-VolumesListTestJSON-2067873647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39e5e35e-b7bf-4d8b-b833-a36eb6e2a44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-381372316',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b40bb42-8221-4333-87f2-371356c971be,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='641bf36ba13042718f8f603acb60d879',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:52:05Z,use_quota=True,user_id='0c991624f8184b1daeb529f2b7681b00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:52:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-aa5f8428-6cd9-40f4-a791-14026e723f3c tempest-VolumesListTestJSON-2067873647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a354ca99-ab39-4ba0-99b1-27145dc3301d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:52:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-aa5f8428-6cd9-40f4-a791-14026e723f3c tempest-VolumesListTestJSON-2067873647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a354ca99-ab39-4ba0-99b1-27145dc3301d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:52:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-aa5f8428-6cd9-40f4-a791-14026e723f3c tempest-VolumesListTestJSON-2067873647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ccf7740-575e-4db5-9f01-64e3f52af28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:52:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-aa5f8428-6cd9-40f4-a791-14026e723f3c tempest-VolumesListTestJSON-2067873647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ccf7740-575e-4db5-9f01-64e3f52af28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b40bb42-8221-4333-87f2-371356c971be', 'volume_name': 'volume-0b40bb42-8221-4333-87f2-371356c971be', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:52:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-aa5f8428-6cd9-40f4-a791-14026e723f3c tempest-VolumesListTestJSON-2067873647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (242c1e7d-211d-4bbc-9274-634ad2121ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:52:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-aa5f8428-6cd9-40f4-a791-14026e723f3c tempest-VolumesListTestJSON-2067873647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (242c1e7d-211d-4bbc-9274-634ad2121ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:52:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-aa5f8428-6cd9-40f4-a791-14026e723f3c tempest-VolumesListTestJSON-2067873647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b026fff-6427-4d11-a161-146dcd4e48ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:52:04 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-aa5f8428-6cd9-40f4-a791-14026e723f3c tempest-VolumesListTestJSON-2067873647 None] Volume 0b40bb42-8221-4333-87f2-371356c971be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b40bb42-8221-4333-87f2-371356c971be', 'volume_size': 1}
Jul 10 12:52:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-aa5f8428-6cd9-40f4-a791-14026e723f3c tempest-VolumesListTestJSON-2067873647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:52:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-aa5f8428-6cd9-40f4-a791-14026e723f3c tempest-VolumesListTestJSON-2067873647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:52:04 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-aa5f8428-6cd9-40f4-a791-14026e723f3c tempest-VolumesListTestJSON-2067873647 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-381372316',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b40bb42-8221-4333-87f2-371356c971be,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='641bf36ba13042718f8f603acb60d879',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:52:05Z,use_quota=True,user_id='0c991624f8184b1daeb529f2b7681b00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:52:04 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-aa5f8428-6cd9-40f4-a791-14026e723f3c tempest-VolumesListTestJSON-2067873647 None] Creating volume 0b40bb42-8221-4333-87f2-371356c971be {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:52:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-aa5f8428-6cd9-40f4-a791-14026e723f3c tempest-VolumesListTestJSON-2067873647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:52:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-aa5f8428-6cd9-40f4-a791-14026e723f3c tempest-VolumesListTestJSON-2067873647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:52:04 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-aa5f8428-6cd9-40f4-a791-14026e723f3c tempest-VolumesListTestJSON-2067873647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:52:04 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-aa5f8428-6cd9-40f4-a791-14026e723f3c tempest-VolumesListTestJSON-2067873647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:52:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-aa5f8428-6cd9-40f4-a791-14026e723f3c tempest-VolumesListTestJSON-2067873647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:52:04 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-aa5f8428-6cd9-40f4-a791-14026e723f3c tempest-VolumesListTestJSON-2067873647 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:52:04 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-aa5f8428-6cd9-40f4-a791-14026e723f3c tempest-VolumesListTestJSON-2067873647 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:52:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-aa5f8428-6cd9-40f4-a791-14026e723f3c tempest-VolumesListTestJSON-2067873647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0b40bb42-8221-4333-87f2-371356c971be 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:52:04 devstack sudo[100898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0b40bb42-8221-4333-87f2-371356c971be 1073741824
Jul 10 12:52:04 devstack sudo[100898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:52:05 devstack sudo[100898]: pam_unix(sudo:session): session closed for user root
Jul 10 12:52:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-aa5f8428-6cd9-40f4-a791-14026e723f3c tempest-VolumesListTestJSON-2067873647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0b40bb42-8221-4333-87f2-371356c971be 1073741824" returned: 0 in 1.128s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:52:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-aa5f8428-6cd9-40f4-a791-14026e723f3c tempest-VolumesListTestJSON-2067873647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0b40bb42-8221-4333-87f2-371356c971be {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:52:06 devstack sudo[100924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0b40bb42-8221-4333-87f2-371356c971be
Jul 10 12:52:06 devstack sudo[100924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:52:06 devstack sudo[100924]: pam_unix(sudo:session): session closed for user root
Jul 10 12:52:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-aa5f8428-6cd9-40f4-a791-14026e723f3c tempest-VolumesListTestJSON-2067873647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0b40bb42-8221-4333-87f2-371356c971be" returned: 0 in 0.794s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:52:06 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-aa5f8428-6cd9-40f4-a791-14026e723f3c tempest-VolumesListTestJSON-2067873647 None] <== create_volume: return (1973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:52:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-aa5f8428-6cd9-40f4-a791-14026e723f3c tempest-VolumesListTestJSON-2067873647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.976s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:52:06 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-aa5f8428-6cd9-40f4-a791-14026e723f3c tempest-VolumesListTestJSON-2067873647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b026fff-6427-4d11-a161-146dcd4e48ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b40bb42-8221-4333-87f2-371356c971be', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:52:06 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-aa5f8428-6cd9-40f4-a791-14026e723f3c tempest-VolumesListTestJSON-2067873647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4879599e-a930-4f1b-aa14-352b4faa8ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:52:06 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-aa5f8428-6cd9-40f4-a791-14026e723f3c tempest-VolumesListTestJSON-2067873647 None] Volume volume-0b40bb42-8221-4333-87f2-371356c971be (0b40bb42-8221-4333-87f2-371356c971be): created successfully
Jul 10 12:52:06 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-aa5f8428-6cd9-40f4-a791-14026e723f3c tempest-VolumesListTestJSON-2067873647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4879599e-a930-4f1b-aa14-352b4faa8ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:52:06 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-aa5f8428-6cd9-40f4-a791-14026e723f3c tempest-VolumesListTestJSON-2067873647 None] Flow 'volume_create_manager' (5b2e45dc-7975-4350-99fb-39060785c5c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:52:06 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-aa5f8428-6cd9-40f4-a791-14026e723f3c tempest-VolumesListTestJSON-2067873647 None] Created volume successfully.
Jul 10 12:52:08 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-44164f8f-509a-455d-82d0-102597be111c tempest-VolumesListTestJSON-2067873647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:52:08 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-44164f8f-509a-455d-82d0-102597be111c tempest-VolumesListTestJSON-2067873647 None] Flow 'volume_create_manager' (76989a3a-a0ce-4bd8-ba4f-1a2573c399c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:52:08 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-44164f8f-509a-455d-82d0-102597be111c tempest-VolumesListTestJSON-2067873647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7db4f609-5f25-4b9b-9648-a3de4936e5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:52:08 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-44164f8f-509a-455d-82d0-102597be111c tempest-VolumesListTestJSON-2067873647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7db4f609-5f25-4b9b-9648-a3de4936e5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:52:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-585155295',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=484a8466-5bcc-44ff-a33c-d878f100409b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='641bf36ba13042718f8f603acb60d879',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:52:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:52:08Z,use_quota=True,user_id='0c991624f8184b1daeb529f2b7681b00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:52:08 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-44164f8f-509a-455d-82d0-102597be111c tempest-VolumesListTestJSON-2067873647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf968d37-a5ca-428c-89ce-1f82ee945533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:52:08 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-44164f8f-509a-455d-82d0-102597be111c tempest-VolumesListTestJSON-2067873647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf968d37-a5ca-428c-89ce-1f82ee945533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:52:08 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-44164f8f-509a-455d-82d0-102597be111c tempest-VolumesListTestJSON-2067873647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e13fc64-c24d-46d4-9a8b-cfe4e02342c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:52:08 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-44164f8f-509a-455d-82d0-102597be111c tempest-VolumesListTestJSON-2067873647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e13fc64-c24d-46d4-9a8b-cfe4e02342c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '484a8466-5bcc-44ff-a33c-d878f100409b', 'volume_name': 'volume-484a8466-5bcc-44ff-a33c-d878f100409b', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:52:08 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-44164f8f-509a-455d-82d0-102597be111c tempest-VolumesListTestJSON-2067873647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8e45738-0f10-449c-902d-efeca2dbe34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:52:08 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-44164f8f-509a-455d-82d0-102597be111c tempest-VolumesListTestJSON-2067873647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8e45738-0f10-449c-902d-efeca2dbe34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:52:08 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-44164f8f-509a-455d-82d0-102597be111c tempest-VolumesListTestJSON-2067873647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce8ddb3f-75ef-4145-9923-447e0e89e213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:52:08 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-44164f8f-509a-455d-82d0-102597be111c tempest-VolumesListTestJSON-2067873647 None] Volume 484a8466-5bcc-44ff-a33c-d878f100409b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-484a8466-5bcc-44ff-a33c-d878f100409b', 'volume_size': 1}
Jul 10 12:52:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-44164f8f-509a-455d-82d0-102597be111c tempest-VolumesListTestJSON-2067873647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:52:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-44164f8f-509a-455d-82d0-102597be111c tempest-VolumesListTestJSON-2067873647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:52:08 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-44164f8f-509a-455d-82d0-102597be111c tempest-VolumesListTestJSON-2067873647 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:52:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-585155295',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=484a8466-5bcc-44ff-a33c-d878f100409b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='641bf36ba13042718f8f603acb60d879',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:52:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:52:08Z,use_quota=True,user_id='0c991624f8184b1daeb529f2b7681b00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:52:08 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-44164f8f-509a-455d-82d0-102597be111c tempest-VolumesListTestJSON-2067873647 None] Creating volume 484a8466-5bcc-44ff-a33c-d878f100409b {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:52:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-44164f8f-509a-455d-82d0-102597be111c tempest-VolumesListTestJSON-2067873647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:52:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-44164f8f-509a-455d-82d0-102597be111c tempest-VolumesListTestJSON-2067873647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:52:08 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-44164f8f-509a-455d-82d0-102597be111c tempest-VolumesListTestJSON-2067873647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:52:08 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-44164f8f-509a-455d-82d0-102597be111c tempest-VolumesListTestJSON-2067873647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:52:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-44164f8f-509a-455d-82d0-102597be111c tempest-VolumesListTestJSON-2067873647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:52:08 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-44164f8f-509a-455d-82d0-102597be111c tempest-VolumesListTestJSON-2067873647 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:52:08 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-44164f8f-509a-455d-82d0-102597be111c tempest-VolumesListTestJSON-2067873647 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:52:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-44164f8f-509a-455d-82d0-102597be111c tempest-VolumesListTestJSON-2067873647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-484a8466-5bcc-44ff-a33c-d878f100409b 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:52:08 devstack sudo[100929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-484a8466-5bcc-44ff-a33c-d878f100409b 1073741824
Jul 10 12:52:08 devstack sudo[100929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:52:09 devstack sudo[100929]: pam_unix(sudo:session): session closed for user root
Jul 10 12:52:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-44164f8f-509a-455d-82d0-102597be111c tempest-VolumesListTestJSON-2067873647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-484a8466-5bcc-44ff-a33c-d878f100409b 1073741824" returned: 0 in 0.925s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:52:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-44164f8f-509a-455d-82d0-102597be111c tempest-VolumesListTestJSON-2067873647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-484a8466-5bcc-44ff-a33c-d878f100409b {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:52:09 devstack sudo[100935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-484a8466-5bcc-44ff-a33c-d878f100409b
Jul 10 12:52:09 devstack sudo[100935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:52:10 devstack sudo[100935]: pam_unix(sudo:session): session closed for user root
Jul 10 12:52:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-44164f8f-509a-455d-82d0-102597be111c tempest-VolumesListTestJSON-2067873647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-484a8466-5bcc-44ff-a33c-d878f100409b" returned: 0 in 0.656s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:52:10 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-44164f8f-509a-455d-82d0-102597be111c tempest-VolumesListTestJSON-2067873647 None] <== create_volume: return (1635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:52:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-44164f8f-509a-455d-82d0-102597be111c tempest-VolumesListTestJSON-2067873647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.637s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:52:10 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-44164f8f-509a-455d-82d0-102597be111c tempest-VolumesListTestJSON-2067873647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce8ddb3f-75ef-4145-9923-447e0e89e213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-484a8466-5bcc-44ff-a33c-d878f100409b', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:52:10 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-44164f8f-509a-455d-82d0-102597be111c tempest-VolumesListTestJSON-2067873647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e91eeabd-9a85-4825-a226-ab32b2535186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:52:10 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-44164f8f-509a-455d-82d0-102597be111c tempest-VolumesListTestJSON-2067873647 None] Volume volume-484a8466-5bcc-44ff-a33c-d878f100409b (484a8466-5bcc-44ff-a33c-d878f100409b): created successfully
Jul 10 12:52:10 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-44164f8f-509a-455d-82d0-102597be111c tempest-VolumesListTestJSON-2067873647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e91eeabd-9a85-4825-a226-ab32b2535186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:52:10 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-44164f8f-509a-455d-82d0-102597be111c tempest-VolumesListTestJSON-2067873647 None] Flow 'volume_create_manager' (76989a3a-a0ce-4bd8-ba4f-1a2573c399c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:52:10 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-44164f8f-509a-455d-82d0-102597be111c tempest-VolumesListTestJSON-2067873647 None] Created volume successfully.
Jul 10 12:52:12 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:52:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:52:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:52:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:52:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:52:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:52:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:52:13 devstack sudo[100964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:52:13 devstack sudo[100964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:52:13 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-5536fd6c-052d-42fb-b770-f90f9eb15ca8 tempest-VolumesListTestJSON-2067873647 None] Acquiring lock "cinder-484a8466-5bcc-44ff-a33c-d878f100409b-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:52:13 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-5536fd6c-052d-42fb-b770-f90f9eb15ca8 tempest-VolumesListTestJSON-2067873647 None] Lock "cinder-484a8466-5bcc-44ff-a33c-d878f100409b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:52:13 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:UPDATE=115,cinder:INSERT=31,cinder:SELECT=90,cinder:DELETE=10 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:52:13 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:UPDATE=118,cinder:SELECT=82,cinder:DELETE=12,cinder:INSERT=34 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:52:13 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-5536fd6c-052d-42fb-b770-f90f9eb15ca8 tempest-VolumesListTestJSON-2067873647 None] Acquiring lock "cinder-quobyte-484a8466-5bcc-44ff-a33c-d878f100409b" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:52:13 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-5536fd6c-052d-42fb-b770-f90f9eb15ca8 tempest-VolumesListTestJSON-2067873647 None] Lock "cinder-quobyte-484a8466-5bcc-44ff-a33c-d878f100409b" acquired by "delete_volume" :: waited 0.018s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:52:13 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e923fb76-4e5c-46a7-89c3-3fcf9ac8dd16]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:52:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5536fd6c-052d-42fb-b770-f90f9eb15ca8 tempest-VolumesListTestJSON-2067873647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-484a8466-5bcc-44ff-a33c-d878f100409b {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:52:13 devstack sudo[100966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-484a8466-5bcc-44ff-a33c-d878f100409b
Jul 10 12:52:13 devstack sudo[100966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:52:13 devstack sudo[100964]: pam_unix(sudo:session): session closed for user root
Jul 10 12:52:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.710s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:52:13 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:52:13 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager._thread_info {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:52:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread count: 28 {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 10 12:52:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread info: [<_MainThread(MainThread, started 128233544536192)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128233445424704)>, <Thread(Thread-3 (stat_writer), started daemon 128233435118528)>, <Thread(Rabbit-heartbeat, started daemon 128233435718016)>, <Thread(Thread-5 (_runner), started daemon 128233432624448)>, <Thread(Thread-7 (_runner), started daemon 128233432674688)>, <Thread(fd_logger, started daemon 128233428569472)>, <Thread(privsep_reader, started daemon 128233429417088)>, <Thread(tpool_thread_0, started daemon 128233421182656)>, <Thread(tpool_thread_1, started daemon 128233412789952)>, <Thread(tpool_thread_2, started daemon 128233404397248)>, <Thread(tpool_thread_3, started daemon 128233396004544)>, <Thread(tpool_thread_4, started daemon 128233387611840)>, <Thread(tpool_thread_5, started daemon 128233379219136)>, <Thread(tpool_thread_6, started daemon 128233370826432)>, <Thread(tpool_thread_7, started daemon 128233362433728)>, <Thread(tpool_thread_8, started daemon 128233354041024)>, <Thread(tpool_thread_9, started daemon 128233345631936)>, <Thread(tpool_thread_10, started daemon 128233337222848)>, <Thread(tpool_thread_11, started daemon 128233328813760)>, <Thread(tpool_thread_12, started daemon 128233320404672)>, <Thread(tpool_thread_13, started daemon 128233311995584)>, <Thread(tpool_thread_14, started daemon 128233303586496)>, <Thread(tpool_thread_15, started daemon 128233295177408)>, <Thread(tpool_thread_16, started daemon 128233286768320)>, <Thread(tpool_thread_17, started daemon 128233278359232)>, <Thread(tpool_thread_18, started daemon 128233269950144)>, <Thread(tpool_thread_19, started daemon 128233261541056)>] {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 10 12:52:13 devstack sudo[100966]: pam_unix(sudo:session): session closed for user root
Jul 10 12:52:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5536fd6c-052d-42fb-b770-f90f9eb15ca8 tempest-VolumesListTestJSON-2067873647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-484a8466-5bcc-44ff-a33c-d878f100409b" returned: 0 in 0.783s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:52:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5536fd6c-052d-42fb-b770-f90f9eb15ca8 tempest-VolumesListTestJSON-2067873647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-484a8466-5bcc-44ff-a33c-d878f100409b {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:52:13 devstack sudo[100972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-484a8466-5bcc-44ff-a33c-d878f100409b
Jul 10 12:52:13 devstack sudo[100972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:52:14 devstack sudo[100972]: pam_unix(sudo:session): session closed for user root
Jul 10 12:52:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5536fd6c-052d-42fb-b770-f90f9eb15ca8 tempest-VolumesListTestJSON-2067873647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-484a8466-5bcc-44ff-a33c-d878f100409b" returned: 0 in 0.669s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:52:14 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-5536fd6c-052d-42fb-b770-f90f9eb15ca8 tempest-VolumesListTestJSON-2067873647 None] Lock "cinder-quobyte-484a8466-5bcc-44ff-a33c-d878f100409b" released by "delete_volume" :: held 1.500s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:52:14 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-5536fd6c-052d-42fb-b770-f90f9eb15ca8 tempest-VolumesListTestJSON-2067873647 None] Created reservations ['ff97431a-86e5-4372-820b-39c0adc63de1', 'c80a1b8a-bb1c-4da0-b985-baa6feed3710', 'fbb514d5-98cf-44fc-9ced-c20f4ec8609d', '47c6396d-9309-4bb1-a223-61e9a0e7d839'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:52:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5536fd6c-052d-42fb-b770-f90f9eb15ca8 tempest-VolumesListTestJSON-2067873647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:52:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5536fd6c-052d-42fb-b770-f90f9eb15ca8 tempest-VolumesListTestJSON-2067873647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:52:14 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5536fd6c-052d-42fb-b770-f90f9eb15ca8 tempest-VolumesListTestJSON-2067873647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:52:14 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5536fd6c-052d-42fb-b770-f90f9eb15ca8 tempest-VolumesListTestJSON-2067873647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:52:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5536fd6c-052d-42fb-b770-f90f9eb15ca8 tempest-VolumesListTestJSON-2067873647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:52:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5536fd6c-052d-42fb-b770-f90f9eb15ca8 tempest-VolumesListTestJSON-2067873647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:52:14 devstack sudo[100975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:52:14 devstack sudo[100975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:52:15 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1e67e0f3-ae0f-4b59-9494-27c2e9f92f5f tempest-VolumesListTestJSON-2067873647 None] Acquiring lock "cinder-0b40bb42-8221-4333-87f2-371356c971be-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:52:15 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1e67e0f3-ae0f-4b59-9494-27c2e9f92f5f tempest-VolumesListTestJSON-2067873647 None] Lock "cinder-0b40bb42-8221-4333-87f2-371356c971be-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:52:15 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1e67e0f3-ae0f-4b59-9494-27c2e9f92f5f tempest-VolumesListTestJSON-2067873647 None] Acquiring lock "cinder-quobyte-0b40bb42-8221-4333-87f2-371356c971be" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:52:15 devstack sudo[100975]: pam_unix(sudo:session): session closed for user root
Jul 10 12:52:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5536fd6c-052d-42fb-b770-f90f9eb15ca8 tempest-VolumesListTestJSON-2067873647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.669s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:52:15 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-5536fd6c-052d-42fb-b770-f90f9eb15ca8 tempest-VolumesListTestJSON-2067873647 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:52:15 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-5536fd6c-052d-42fb-b770-f90f9eb15ca8 tempest-VolumesListTestJSON-2067873647 None] Deleted volume successfully.
Jul 10 12:52:15 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1e67e0f3-ae0f-4b59-9494-27c2e9f92f5f tempest-VolumesListTestJSON-2067873647 None] Lock "cinder-quobyte-0b40bb42-8221-4333-87f2-371356c971be" acquired by "delete_volume" :: waited 0.027s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:52:15 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-5536fd6c-052d-42fb-b770-f90f9eb15ca8 tempest-VolumesListTestJSON-2067873647 None] Lock "cinder-484a8466-5bcc-44ff-a33c-d878f100409b-delete_volume" released by "delete_volume" :: held 2.397s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:52:15 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f237604d-0bef-4db4-8a67-aacff841e625]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:52:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1e67e0f3-ae0f-4b59-9494-27c2e9f92f5f tempest-VolumesListTestJSON-2067873647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0b40bb42-8221-4333-87f2-371356c971be {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:52:15 devstack sudo[100978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0b40bb42-8221-4333-87f2-371356c971be
Jul 10 12:52:15 devstack sudo[100978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:52:16 devstack sudo[100978]: pam_unix(sudo:session): session closed for user root
Jul 10 12:52:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1e67e0f3-ae0f-4b59-9494-27c2e9f92f5f tempest-VolumesListTestJSON-2067873647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0b40bb42-8221-4333-87f2-371356c971be" returned: 0 in 0.777s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:52:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1e67e0f3-ae0f-4b59-9494-27c2e9f92f5f tempest-VolumesListTestJSON-2067873647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0b40bb42-8221-4333-87f2-371356c971be {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:52:16 devstack sudo[100983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0b40bb42-8221-4333-87f2-371356c971be
Jul 10 12:52:16 devstack sudo[100983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:52:16 devstack sudo[100983]: pam_unix(sudo:session): session closed for user root
Jul 10 12:52:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1e67e0f3-ae0f-4b59-9494-27c2e9f92f5f tempest-VolumesListTestJSON-2067873647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0b40bb42-8221-4333-87f2-371356c971be" returned: 0 in 0.649s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:52:16 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1e67e0f3-ae0f-4b59-9494-27c2e9f92f5f tempest-VolumesListTestJSON-2067873647 None] Lock "cinder-quobyte-0b40bb42-8221-4333-87f2-371356c971be" released by "delete_volume" :: held 1.477s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:52:16 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-1e67e0f3-ae0f-4b59-9494-27c2e9f92f5f tempest-VolumesListTestJSON-2067873647 None] Created reservations ['96e85831-c06e-4038-9d7f-86209fbb84e1', 'e9457c3b-8160-44d7-bcfa-5dfbf7f760c2', 'c0970923-3082-4195-aec6-5d6bc29f9a3e', '5a9efbee-b435-4a0c-88b5-a8175ea1baf1'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:52:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1e67e0f3-ae0f-4b59-9494-27c2e9f92f5f tempest-VolumesListTestJSON-2067873647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:52:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1e67e0f3-ae0f-4b59-9494-27c2e9f92f5f tempest-VolumesListTestJSON-2067873647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:52:17 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-1e67e0f3-ae0f-4b59-9494-27c2e9f92f5f tempest-VolumesListTestJSON-2067873647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:52:17 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-1e67e0f3-ae0f-4b59-9494-27c2e9f92f5f tempest-VolumesListTestJSON-2067873647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:52:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1e67e0f3-ae0f-4b59-9494-27c2e9f92f5f tempest-VolumesListTestJSON-2067873647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:52:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1e67e0f3-ae0f-4b59-9494-27c2e9f92f5f tempest-VolumesListTestJSON-2067873647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:52:17 devstack sudo[100986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:52:17 devstack sudo[100986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:52:17 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8d6c9587-3505-49c1-9c3f-9dd4806ec94b tempest-VolumesListTestJSON-2067873647 None] Acquiring lock "cinder-77d266b7-0ff5-4cbd-90dc-10cd884f7e1c-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:52:17 devstack sudo[100986]: pam_unix(sudo:session): session closed for user root
Jul 10 12:52:17 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8d6c9587-3505-49c1-9c3f-9dd4806ec94b tempest-VolumesListTestJSON-2067873647 None] Lock "cinder-77d266b7-0ff5-4cbd-90dc-10cd884f7e1c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:52:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1e67e0f3-ae0f-4b59-9494-27c2e9f92f5f tempest-VolumesListTestJSON-2067873647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.654s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:52:17 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-1e67e0f3-ae0f-4b59-9494-27c2e9f92f5f tempest-VolumesListTestJSON-2067873647 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:52:17 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-1e67e0f3-ae0f-4b59-9494-27c2e9f92f5f tempest-VolumesListTestJSON-2067873647 None] Deleted volume successfully.
Jul 10 12:52:17 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8d6c9587-3505-49c1-9c3f-9dd4806ec94b tempest-VolumesListTestJSON-2067873647 None] Acquiring lock "cinder-quobyte-77d266b7-0ff5-4cbd-90dc-10cd884f7e1c" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:52:17 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1e67e0f3-ae0f-4b59-9494-27c2e9f92f5f tempest-VolumesListTestJSON-2067873647 None] Lock "cinder-0b40bb42-8221-4333-87f2-371356c971be-delete_volume" released by "delete_volume" :: held 2.373s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:52:17 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8d6c9587-3505-49c1-9c3f-9dd4806ec94b tempest-VolumesListTestJSON-2067873647 None] Lock "cinder-quobyte-77d266b7-0ff5-4cbd-90dc-10cd884f7e1c" acquired by "delete_volume" :: waited 0.020s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:52:17 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a061a0ca-73da-41ff-ac9a-b12b9f634a1d]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:52:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8d6c9587-3505-49c1-9c3f-9dd4806ec94b tempest-VolumesListTestJSON-2067873647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-77d266b7-0ff5-4cbd-90dc-10cd884f7e1c {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:52:17 devstack sudo[100989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-77d266b7-0ff5-4cbd-90dc-10cd884f7e1c
Jul 10 12:52:17 devstack sudo[100989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:52:18 devstack sudo[100989]: pam_unix(sudo:session): session closed for user root
Jul 10 12:52:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8d6c9587-3505-49c1-9c3f-9dd4806ec94b tempest-VolumesListTestJSON-2067873647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-77d266b7-0ff5-4cbd-90dc-10cd884f7e1c" returned: 0 in 0.816s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:52:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8d6c9587-3505-49c1-9c3f-9dd4806ec94b tempest-VolumesListTestJSON-2067873647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-77d266b7-0ff5-4cbd-90dc-10cd884f7e1c {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:52:18 devstack sudo[100995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-77d266b7-0ff5-4cbd-90dc-10cd884f7e1c
Jul 10 12:52:18 devstack sudo[100995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:52:19 devstack sudo[100995]: pam_unix(sudo:session): session closed for user root
Jul 10 12:52:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8d6c9587-3505-49c1-9c3f-9dd4806ec94b tempest-VolumesListTestJSON-2067873647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-77d266b7-0ff5-4cbd-90dc-10cd884f7e1c" returned: 0 in 0.715s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:52:19 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8d6c9587-3505-49c1-9c3f-9dd4806ec94b tempest-VolumesListTestJSON-2067873647 None] Lock "cinder-quobyte-77d266b7-0ff5-4cbd-90dc-10cd884f7e1c" released by "delete_volume" :: held 1.572s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:52:19 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-8d6c9587-3505-49c1-9c3f-9dd4806ec94b tempest-VolumesListTestJSON-2067873647 None] Created reservations ['454b5d9b-dcf5-4128-9eec-f4d5dd4c0c72', 'd208aa03-ad80-4466-a0c7-bc9e5aebf3b2', '7b6d5f78-e159-4149-b5c9-296c95a28d86', '372f05a7-863a-495f-8ff1-c036662bafb7'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:52:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-8d6c9587-3505-49c1-9c3f-9dd4806ec94b tempest-VolumesListTestJSON-2067873647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:52:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-8d6c9587-3505-49c1-9c3f-9dd4806ec94b tempest-VolumesListTestJSON-2067873647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:52:19 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-8d6c9587-3505-49c1-9c3f-9dd4806ec94b tempest-VolumesListTestJSON-2067873647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:52:19 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-8d6c9587-3505-49c1-9c3f-9dd4806ec94b tempest-VolumesListTestJSON-2067873647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:52:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-8d6c9587-3505-49c1-9c3f-9dd4806ec94b tempest-VolumesListTestJSON-2067873647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:52:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8d6c9587-3505-49c1-9c3f-9dd4806ec94b tempest-VolumesListTestJSON-2067873647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:52:19 devstack sudo[101000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:52:19 devstack sudo[101000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:52:20 devstack sudo[101000]: pam_unix(sudo:session): session closed for user root
Jul 10 12:52:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8d6c9587-3505-49c1-9c3f-9dd4806ec94b tempest-VolumesListTestJSON-2067873647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.680s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:52:20 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-8d6c9587-3505-49c1-9c3f-9dd4806ec94b tempest-VolumesListTestJSON-2067873647 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:52:20 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-8d6c9587-3505-49c1-9c3f-9dd4806ec94b tempest-VolumesListTestJSON-2067873647 None] Deleted volume successfully.
Jul 10 12:52:20 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8d6c9587-3505-49c1-9c3f-9dd4806ec94b tempest-VolumesListTestJSON-2067873647 None] Lock "cinder-77d266b7-0ff5-4cbd-90dc-10cd884f7e1c-delete_volume" released by "delete_volume" :: held 2.473s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:52:22 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-89f9ed5e-892e-45b1-8f5b-e48c8abca531 tempest-VolumesNegativeTest-48519593 None] Acquiring lock "cinder-301ea504-a40e-4165-a300-633d66a336cc-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:52:22 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-89f9ed5e-892e-45b1-8f5b-e48c8abca531 tempest-VolumesNegativeTest-48519593 None] Lock "cinder-301ea504-a40e-4165-a300-633d66a336cc-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:52:22 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-89f9ed5e-892e-45b1-8f5b-e48c8abca531 tempest-VolumesNegativeTest-48519593 None] Acquiring lock "cinder-quobyte-301ea504-a40e-4165-a300-633d66a336cc" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:52:22 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-89f9ed5e-892e-45b1-8f5b-e48c8abca531 tempest-VolumesNegativeTest-48519593 None] Lock "cinder-quobyte-301ea504-a40e-4165-a300-633d66a336cc" acquired by "delete_volume" :: waited 0.014s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:52:22 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8cf9fae-3c73-4674-bf7f-51a16196ef2f]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:52:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-89f9ed5e-892e-45b1-8f5b-e48c8abca531 tempest-VolumesNegativeTest-48519593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-301ea504-a40e-4165-a300-633d66a336cc {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:52:22 devstack sudo[101003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-301ea504-a40e-4165-a300-633d66a336cc
Jul 10 12:52:22 devstack sudo[101003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:52:23 devstack sudo[101003]: pam_unix(sudo:session): session closed for user root
Jul 10 12:52:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-89f9ed5e-892e-45b1-8f5b-e48c8abca531 tempest-VolumesNegativeTest-48519593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-301ea504-a40e-4165-a300-633d66a336cc" returned: 0 in 0.796s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:52:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-89f9ed5e-892e-45b1-8f5b-e48c8abca531 tempest-VolumesNegativeTest-48519593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-301ea504-a40e-4165-a300-633d66a336cc {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:52:23 devstack sudo[101008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-301ea504-a40e-4165-a300-633d66a336cc
Jul 10 12:52:23 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:52:24 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root
Jul 10 12:52:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-89f9ed5e-892e-45b1-8f5b-e48c8abca531 tempest-VolumesNegativeTest-48519593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-301ea504-a40e-4165-a300-633d66a336cc" returned: 0 in 0.741s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:52:24 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-89f9ed5e-892e-45b1-8f5b-e48c8abca531 tempest-VolumesNegativeTest-48519593 None] Lock "cinder-quobyte-301ea504-a40e-4165-a300-633d66a336cc" released by "delete_volume" :: held 1.590s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:52:24 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-89f9ed5e-892e-45b1-8f5b-e48c8abca531 tempest-VolumesNegativeTest-48519593 None] Created reservations ['70d419a0-69b5-4ab7-803a-e80cce3d21ea', 'efab3d71-bf87-4791-bd05-3231b3fa69fc', '2724ad9a-1538-4264-9953-3dbe13aa2fdc', 'e883be78-4ed0-4c6d-8e50-8f035f40b9e0'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:52:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-89f9ed5e-892e-45b1-8f5b-e48c8abca531 tempest-VolumesNegativeTest-48519593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:52:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-89f9ed5e-892e-45b1-8f5b-e48c8abca531 tempest-VolumesNegativeTest-48519593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:52:24 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-89f9ed5e-892e-45b1-8f5b-e48c8abca531 tempest-VolumesNegativeTest-48519593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:52:24 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-89f9ed5e-892e-45b1-8f5b-e48c8abca531 tempest-VolumesNegativeTest-48519593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:52:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-89f9ed5e-892e-45b1-8f5b-e48c8abca531 tempest-VolumesNegativeTest-48519593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:52:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-89f9ed5e-892e-45b1-8f5b-e48c8abca531 tempest-VolumesNegativeTest-48519593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:52:24 devstack sudo[101047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:52:24 devstack sudo[101047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:52:25 devstack sudo[101047]: pam_unix(sudo:session): session closed for user root
Jul 10 12:52:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-89f9ed5e-892e-45b1-8f5b-e48c8abca531 tempest-VolumesNegativeTest-48519593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.700s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:52:25 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-89f9ed5e-892e-45b1-8f5b-e48c8abca531 tempest-VolumesNegativeTest-48519593 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:52:25 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-89f9ed5e-892e-45b1-8f5b-e48c8abca531 tempest-VolumesNegativeTest-48519593 None] Deleted volume successfully.
Jul 10 12:52:25 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-89f9ed5e-892e-45b1-8f5b-e48c8abca531 tempest-VolumesNegativeTest-48519593 None] Lock "cinder-301ea504-a40e-4165-a300-633d66a336cc-delete_volume" released by "delete_volume" :: held 2.514s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:52:34 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:SELECT=22,cinder:INSERT=7,cinder:UPDATE=33,cinder:DELETE=3 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:52:35 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:SELECT=18,cinder:INSERT=9,cinder:UPDATE=31,cinder:DELETE=1 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:52:38 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-3076dca2-4152-4d87-ad23-7ca172209e63 tempest-VolumesSnapshotTestJSON-1082928251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:52:38 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3076dca2-4152-4d87-ad23-7ca172209e63 tempest-VolumesSnapshotTestJSON-1082928251 None] Flow 'volume_create_manager' (164c29d2-cb9d-4217-be3f-3f101d45d57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:52:38 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3076dca2-4152-4d87-ad23-7ca172209e63 tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a9b58d0-1b37-4008-b896-36a715a242a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:52:38 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3076dca2-4152-4d87-ad23-7ca172209e63 tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a9b58d0-1b37-4008-b896-36a715a242a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:52:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-169012641',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f47df7e5-0f3e-4d2f-82cd-e78be9103184,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d425631eefe8472c89e24c6b4811a3d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:52:38Z,use_quota=True,user_id='4439e7f0e5554d9d87d2f5bcae5d85d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:52:38 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3076dca2-4152-4d87-ad23-7ca172209e63 tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2c59c60-1d37-42f5-a91b-006258a0badf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:52:38 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3076dca2-4152-4d87-ad23-7ca172209e63 tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2c59c60-1d37-42f5-a91b-006258a0badf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:52:38 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3076dca2-4152-4d87-ad23-7ca172209e63 tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2de296bc-09d8-4fe6-ab66-6538bca91a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:52:38 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3076dca2-4152-4d87-ad23-7ca172209e63 tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2de296bc-09d8-4fe6-ab66-6538bca91a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f47df7e5-0f3e-4d2f-82cd-e78be9103184', 'volume_name': 'volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:52:38 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3076dca2-4152-4d87-ad23-7ca172209e63 tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b73415c-9cf0-4594-98eb-f73b98b7e423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:52:38 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3076dca2-4152-4d87-ad23-7ca172209e63 tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b73415c-9cf0-4594-98eb-f73b98b7e423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:52:38 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3076dca2-4152-4d87-ad23-7ca172209e63 tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6da76c75-db3d-4cc6-aa19-280022721fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:52:38 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-3076dca2-4152-4d87-ad23-7ca172209e63 tempest-VolumesSnapshotTestJSON-1082928251 None] Volume f47df7e5-0f3e-4d2f-82cd-e78be9103184: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184', 'volume_size': 1}
Jul 10 12:52:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3076dca2-4152-4d87-ad23-7ca172209e63 tempest-VolumesSnapshotTestJSON-1082928251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:52:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3076dca2-4152-4d87-ad23-7ca172209e63 tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:52:38 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3076dca2-4152-4d87-ad23-7ca172209e63 tempest-VolumesSnapshotTestJSON-1082928251 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:52:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-169012641',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f47df7e5-0f3e-4d2f-82cd-e78be9103184,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d425631eefe8472c89e24c6b4811a3d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:52:38Z,use_quota=True,user_id='4439e7f0e5554d9d87d2f5bcae5d85d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:52:38 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-3076dca2-4152-4d87-ad23-7ca172209e63 tempest-VolumesSnapshotTestJSON-1082928251 None] Creating volume f47df7e5-0f3e-4d2f-82cd-e78be9103184 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:52:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3076dca2-4152-4d87-ad23-7ca172209e63 tempest-VolumesSnapshotTestJSON-1082928251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:52:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3076dca2-4152-4d87-ad23-7ca172209e63 tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:52:38 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3076dca2-4152-4d87-ad23-7ca172209e63 tempest-VolumesSnapshotTestJSON-1082928251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:52:38 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3076dca2-4152-4d87-ad23-7ca172209e63 tempest-VolumesSnapshotTestJSON-1082928251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:52:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3076dca2-4152-4d87-ad23-7ca172209e63 tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:52:38 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3076dca2-4152-4d87-ad23-7ca172209e63 tempest-VolumesSnapshotTestJSON-1082928251 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:52:38 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-3076dca2-4152-4d87-ad23-7ca172209e63 tempest-VolumesSnapshotTestJSON-1082928251 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:52:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3076dca2-4152-4d87-ad23-7ca172209e63 tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:52:38 devstack sudo[101059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184 1073741824
Jul 10 12:52:38 devstack sudo[101059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:52:39 devstack sudo[101059]: pam_unix(sudo:session): session closed for user root
Jul 10 12:52:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3076dca2-4152-4d87-ad23-7ca172209e63 tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184 1073741824" returned: 0 in 0.865s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:52:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3076dca2-4152-4d87-ad23-7ca172209e63 tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:52:39 devstack sudo[101066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184
Jul 10 12:52:39 devstack sudo[101066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:52:40 devstack sudo[101066]: pam_unix(sudo:session): session closed for user root
Jul 10 12:52:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3076dca2-4152-4d87-ad23-7ca172209e63 tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184" returned: 0 in 0.678s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:52:40 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3076dca2-4152-4d87-ad23-7ca172209e63 tempest-VolumesSnapshotTestJSON-1082928251 None] <== create_volume: return (1594ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:52:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3076dca2-4152-4d87-ad23-7ca172209e63 tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.597s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:52:40 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3076dca2-4152-4d87-ad23-7ca172209e63 tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6da76c75-db3d-4cc6-aa19-280022721fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:52:40 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3076dca2-4152-4d87-ad23-7ca172209e63 tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3605bbc9-8f9b-4a7e-878a-12f78d303e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:52:40 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-3076dca2-4152-4d87-ad23-7ca172209e63 tempest-VolumesSnapshotTestJSON-1082928251 None] Volume volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184 (f47df7e5-0f3e-4d2f-82cd-e78be9103184): created successfully
Jul 10 12:52:40 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3076dca2-4152-4d87-ad23-7ca172209e63 tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3605bbc9-8f9b-4a7e-878a-12f78d303e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:52:40 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3076dca2-4152-4d87-ad23-7ca172209e63 tempest-VolumesSnapshotTestJSON-1082928251 None] Flow 'volume_create_manager' (164c29d2-cb9d-4217-be3f-3f101d45d57e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:52:40 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-3076dca2-4152-4d87-ad23-7ca172209e63 tempest-VolumesSnapshotTestJSON-1082928251 None] Created volume successfully.
Jul 10 12:52:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-21ade507-29b2-4e3b-b776-78fdb49ebe06 tempest-VolumesSnapshotTestJSON-1082928251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:52:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-21ade507-29b2-4e3b-b776-78fdb49ebe06 tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:52:40 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-21ade507-29b2-4e3b-b776-78fdb49ebe06 tempest-VolumesSnapshotTestJSON-1082928251 None] Creating offline snapshot a9fded3a-b588-47fc-a09e-6b846294be41 of volume f47df7e5-0f3e-4d2f-82cd-e78be9103184 {{(pid=87378) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 10 12:52:40 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[112a21d3-8e46-4610-8747-4e2c501d6fed]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:52:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-21ade507-29b2-4e3b-b776-78fdb49ebe06 tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:52:41 devstack sudo[101069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184
Jul 10 12:52:41 devstack sudo[101069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:52:41 devstack sudo[101069]: pam_unix(sudo:session): session closed for user root
Jul 10 12:52:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-21ade507-29b2-4e3b-b776-78fdb49ebe06 tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184" returned: 0 in 0.810s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:52:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-21ade507-29b2-4e3b-b776-78fdb49ebe06 tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184.a9fded3a-b588-47fc-a09e-6b846294be41 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:52:41 devstack sudo[101074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184.a9fded3a-b588-47fc-a09e-6b846294be41 1G
Jul 10 12:52:41 devstack sudo[101074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:52:42 devstack sudo[101074]: pam_unix(sudo:session): session closed for user root
Jul 10 12:52:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-21ade507-29b2-4e3b-b776-78fdb49ebe06 tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184.a9fded3a-b588-47fc-a09e-6b846294be41 1G" returned: 0 in 0.855s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:52:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-21ade507-29b2-4e3b-b776-78fdb49ebe06 tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184.a9fded3a-b588-47fc-a09e-6b846294be41 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:52:42 devstack sudo[101081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184.a9fded3a-b588-47fc-a09e-6b846294be41
Jul 10 12:52:42 devstack sudo[101081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:52:43 devstack sudo[101081]: pam_unix(sudo:session): session closed for user root
Jul 10 12:52:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-21ade507-29b2-4e3b-b776-78fdb49ebe06 tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184.a9fded3a-b588-47fc-a09e-6b846294be41" returned: 0 in 0.740s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:52:43 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-21ade507-29b2-4e3b-b776-78fdb49ebe06 tempest-VolumesSnapshotTestJSON-1082928251 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184.a9fded3a-b588-47fc-a09e-6b846294be41 is being set with open permissions: ugo+rw
Jul 10 12:52:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-21ade507-29b2-4e3b-b776-78fdb49ebe06 tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184.a9fded3a-b588-47fc-a09e-6b846294be41 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:52:43 devstack sudo[101086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184.a9fded3a-b588-47fc-a09e-6b846294be41
Jul 10 12:52:43 devstack sudo[101086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:52:44 devstack sudo[101086]: pam_unix(sudo:session): session closed for user root
Jul 10 12:52:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-21ade507-29b2-4e3b-b776-78fdb49ebe06 tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184.a9fded3a-b588-47fc-a09e-6b846294be41" returned: 0 in 0.668s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:52:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-21ade507-29b2-4e3b-b776-78fdb49ebe06 tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:52:44 devstack sudo[101089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184.info
Jul 10 12:52:44 devstack sudo[101089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:52:44 devstack sudo[101089]: pam_unix(sudo:session): session closed for user root
Jul 10 12:52:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-21ade507-29b2-4e3b-b776-78fdb49ebe06 tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184.info" returned: 0 in 0.729s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:52:44 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-21ade507-29b2-4e3b-b776-78fdb49ebe06 tempest-VolumesSnapshotTestJSON-1082928251 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184.info is being set with open permissions: ugo+rw
Jul 10 12:52:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-21ade507-29b2-4e3b-b776-78fdb49ebe06 tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:52:44 devstack sudo[101092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184.info
Jul 10 12:52:44 devstack sudo[101092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:52:45 devstack sudo[101092]: pam_unix(sudo:session): session closed for user root
Jul 10 12:52:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-21ade507-29b2-4e3b-b776-78fdb49ebe06 tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184.info" returned: 0 in 0.771s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:52:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-21ade507-29b2-4e3b-b776-78fdb49ebe06 tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.674s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:52:45 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-21ade507-29b2-4e3b-b776-78fdb49ebe06 tempest-VolumesSnapshotTestJSON-1082928251 None] Create snapshot completed successfully
Jul 10 12:52:46 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-2cef6603-362c-446f-8857-2c21ae3e5b1d tempest-VolumesSnapshotTestJSON-1082928251 None] Acquiring lock "cinder-a9fded3a-b588-47fc-a09e-6b846294be41-delete_snapshot" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:52:46 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-2cef6603-362c-446f-8857-2c21ae3e5b1d tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "cinder-a9fded3a-b588-47fc-a09e-6b846294be41-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:52:46 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-2cef6603-362c-446f-8857-2c21ae3e5b1d tempest-VolumesSnapshotTestJSON-1082928251 None] Acquiring lock "cinder-quobyte-f47df7e5-0f3e-4d2f-82cd-e78be9103184" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:52:46 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-2cef6603-362c-446f-8857-2c21ae3e5b1d tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "cinder-quobyte-f47df7e5-0f3e-4d2f-82cd-e78be9103184" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:52:46 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-2cef6603-362c-446f-8857-2c21ae3e5b1d tempest-VolumesSnapshotTestJSON-1082928251 None] Acquiring lock "cinder-quobyte-a9fded3a-b588-47fc-a09e-6b846294be41" by "_delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:52:46 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-2cef6603-362c-446f-8857-2c21ae3e5b1d tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "cinder-quobyte-a9fded3a-b588-47fc-a09e-6b846294be41" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:52:46 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-2cef6603-362c-446f-8857-2c21ae3e5b1d tempest-VolumesSnapshotTestJSON-1082928251 None] Deleting offline snapshot a9fded3a-b588-47fc-a09e-6b846294be41 of volume f47df7e5-0f3e-4d2f-82cd-e78be9103184 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 10 12:52:46 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-2cef6603-362c-446f-8857-2c21ae3e5b1d tempest-VolumesSnapshotTestJSON-1082928251 None] snapshot_file for this snap is: volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184.a9fded3a-b588-47fc-a09e-6b846294be41 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 10 12:52:46 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2287b6-40b2-4651-91e1-575852e89e0e]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:52:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2cef6603-362c-446f-8857-2c21ae3e5b1d tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184.a9fded3a-b588-47fc-a09e-6b846294be41 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:52:46 devstack sudo[101096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184.a9fded3a-b588-47fc-a09e-6b846294be41
Jul 10 12:52:46 devstack sudo[101096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:52:47 devstack sudo[101096]: pam_unix(sudo:session): session closed for user root
Jul 10 12:52:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2cef6603-362c-446f-8857-2c21ae3e5b1d tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184.a9fded3a-b588-47fc-a09e-6b846294be41" returned: 0 in 0.782s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:52:47 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-2cef6603-362c-446f-8857-2c21ae3e5b1d tempest-VolumesSnapshotTestJSON-1082928251 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:52:47 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec056963-6c5a-4b2c-92fc-aed526cbba8d]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:52:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2cef6603-362c-446f-8857-2c21ae3e5b1d tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:52:47 devstack sudo[101102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184
Jul 10 12:52:47 devstack sudo[101102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:52:48 devstack sudo[101102]: pam_unix(sudo:session): session closed for user root
Jul 10 12:52:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2cef6603-362c-446f-8857-2c21ae3e5b1d tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184" returned: 0 in 0.772s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:52:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2cef6603-362c-446f-8857-2c21ae3e5b1d tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184.a9fded3a-b588-47fc-a09e-6b846294be41 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:52:48 devstack sudo[101108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184.a9fded3a-b588-47fc-a09e-6b846294be41
Jul 10 12:52:48 devstack sudo[101108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:52:48 devstack sudo[101108]: pam_unix(sudo:session): session closed for user root
Jul 10 12:52:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2cef6603-362c-446f-8857-2c21ae3e5b1d tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184.a9fded3a-b588-47fc-a09e-6b846294be41" returned: 0 in 0.776s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:52:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2cef6603-362c-446f-8857-2c21ae3e5b1d tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184.a9fded3a-b588-47fc-a09e-6b846294be41 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:52:48 devstack sudo[101114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184.a9fded3a-b588-47fc-a09e-6b846294be41
Jul 10 12:52:48 devstack sudo[101114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:52:49 devstack sudo[101114]: pam_unix(sudo:session): session closed for user root
Jul 10 12:52:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2cef6603-362c-446f-8857-2c21ae3e5b1d tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184.a9fded3a-b588-47fc-a09e-6b846294be41" returned: 0 in 0.682s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:52:49 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-2cef6603-362c-446f-8857-2c21ae3e5b1d tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "cinder-quobyte-a9fded3a-b588-47fc-a09e-6b846294be41" released by "_delete_snapshot" :: held 3.131s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:52:49 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-2cef6603-362c-446f-8857-2c21ae3e5b1d tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "cinder-quobyte-f47df7e5-0f3e-4d2f-82cd-e78be9103184" released by "delete_snapshot" :: held 3.156s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:52:49 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-2cef6603-362c-446f-8857-2c21ae3e5b1d tempest-VolumesSnapshotTestJSON-1082928251 None] Created reservations ['ff2f17e4-937f-4152-af8c-a2ee32b0edb3', 'fb240423-2e80-4e5d-9bb9-bb13c537a5ae', '58f14dd0-894f-4a07-8807-f28e6a8ed129', '6a9191e9-61b5-4d19-a329-7cafd35e9b65'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:52:49 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-2cef6603-362c-446f-8857-2c21ae3e5b1d tempest-VolumesSnapshotTestJSON-1082928251 None] Delete snapshot completed successfully.
Jul 10 12:52:49 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-2cef6603-362c-446f-8857-2c21ae3e5b1d tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "cinder-a9fded3a-b588-47fc-a09e-6b846294be41-delete_snapshot" released by "delete_snapshot" :: held 3.348s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:52:51 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee5bd9c7-507c-44f2-a74c-3f66fd0861bd tempest-VolumesSnapshotTestJSON-1082928251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:52:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ee5bd9c7-507c-44f2-a74c-3f66fd0861bd tempest-VolumesSnapshotTestJSON-1082928251 None] Flow 'volume_create_manager' (b528e190-a8f3-4082-bdf1-f47cfbdd9512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:52:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ee5bd9c7-507c-44f2-a74c-3f66fd0861bd tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d1e485b-8618-4b06-8e62-29c040e3e6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:52:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ee5bd9c7-507c-44f2-a74c-3f66fd0861bd tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d1e485b-8618-4b06-8e62-29c040e3e6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1170261927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f60d5eee-b793-443e-8649-5a58ffb8ddf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d425631eefe8472c89e24c6b4811a3d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:52:51Z,use_quota=True,user_id='4439e7f0e5554d9d87d2f5bcae5d85d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:52:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ee5bd9c7-507c-44f2-a74c-3f66fd0861bd tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b722c66a-d9de-4a96-95df-94aa1bd937ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:52:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ee5bd9c7-507c-44f2-a74c-3f66fd0861bd tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b722c66a-d9de-4a96-95df-94aa1bd937ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:52:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ee5bd9c7-507c-44f2-a74c-3f66fd0861bd tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (802167c7-4978-48f5-a5ec-1fda3df252d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:52:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ee5bd9c7-507c-44f2-a74c-3f66fd0861bd tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (802167c7-4978-48f5-a5ec-1fda3df252d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f60d5eee-b793-443e-8649-5a58ffb8ddf4', 'volume_name': 'volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:52:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ee5bd9c7-507c-44f2-a74c-3f66fd0861bd tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1439cf9d-405c-46b1-aadd-94416a518106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:52:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ee5bd9c7-507c-44f2-a74c-3f66fd0861bd tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1439cf9d-405c-46b1-aadd-94416a518106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:52:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ee5bd9c7-507c-44f2-a74c-3f66fd0861bd tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (360034a6-51d9-40cd-bcf7-e400f46a3050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:52:51 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-ee5bd9c7-507c-44f2-a74c-3f66fd0861bd tempest-VolumesSnapshotTestJSON-1082928251 None] Volume f60d5eee-b793-443e-8649-5a58ffb8ddf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4', 'volume_size': 1}
Jul 10 12:52:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ee5bd9c7-507c-44f2-a74c-3f66fd0861bd tempest-VolumesSnapshotTestJSON-1082928251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:52:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ee5bd9c7-507c-44f2-a74c-3f66fd0861bd tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:52:51 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-ee5bd9c7-507c-44f2-a74c-3f66fd0861bd tempest-VolumesSnapshotTestJSON-1082928251 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1170261927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f60d5eee-b793-443e-8649-5a58ffb8ddf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d425631eefe8472c89e24c6b4811a3d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:52:51Z,use_quota=True,user_id='4439e7f0e5554d9d87d2f5bcae5d85d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:52:51 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-ee5bd9c7-507c-44f2-a74c-3f66fd0861bd tempest-VolumesSnapshotTestJSON-1082928251 None] Creating volume f60d5eee-b793-443e-8649-5a58ffb8ddf4 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:52:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ee5bd9c7-507c-44f2-a74c-3f66fd0861bd tempest-VolumesSnapshotTestJSON-1082928251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:52:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ee5bd9c7-507c-44f2-a74c-3f66fd0861bd tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:52:51 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-ee5bd9c7-507c-44f2-a74c-3f66fd0861bd tempest-VolumesSnapshotTestJSON-1082928251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:52:51 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-ee5bd9c7-507c-44f2-a74c-3f66fd0861bd tempest-VolumesSnapshotTestJSON-1082928251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:52:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ee5bd9c7-507c-44f2-a74c-3f66fd0861bd tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:52:51 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-ee5bd9c7-507c-44f2-a74c-3f66fd0861bd tempest-VolumesSnapshotTestJSON-1082928251 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:52:51 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-ee5bd9c7-507c-44f2-a74c-3f66fd0861bd tempest-VolumesSnapshotTestJSON-1082928251 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:52:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ee5bd9c7-507c-44f2-a74c-3f66fd0861bd tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:52:51 devstack sudo[101121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4 1073741824
Jul 10 12:52:51 devstack sudo[101121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:52:52 devstack sudo[101121]: pam_unix(sudo:session): session closed for user root
Jul 10 12:52:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ee5bd9c7-507c-44f2-a74c-3f66fd0861bd tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4 1073741824" returned: 0 in 0.867s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:52:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ee5bd9c7-507c-44f2-a74c-3f66fd0861bd tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:52:52 devstack sudo[101126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4
Jul 10 12:52:52 devstack sudo[101126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:52:52 devstack sudo[101126]: pam_unix(sudo:session): session closed for user root
Jul 10 12:52:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ee5bd9c7-507c-44f2-a74c-3f66fd0861bd tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4" returned: 0 in 0.653s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:52:52 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-ee5bd9c7-507c-44f2-a74c-3f66fd0861bd tempest-VolumesSnapshotTestJSON-1082928251 None] <== create_volume: return (1561ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:52:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ee5bd9c7-507c-44f2-a74c-3f66fd0861bd tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.563s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:52:52 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ee5bd9c7-507c-44f2-a74c-3f66fd0861bd tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (360034a6-51d9-40cd-bcf7-e400f46a3050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:52:52 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ee5bd9c7-507c-44f2-a74c-3f66fd0861bd tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a57dc05c-b8ad-4686-b002-000636a4d60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:52:52 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-ee5bd9c7-507c-44f2-a74c-3f66fd0861bd tempest-VolumesSnapshotTestJSON-1082928251 None] Volume volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4 (f60d5eee-b793-443e-8649-5a58ffb8ddf4): created successfully
Jul 10 12:52:52 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ee5bd9c7-507c-44f2-a74c-3f66fd0861bd tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a57dc05c-b8ad-4686-b002-000636a4d60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:52:52 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ee5bd9c7-507c-44f2-a74c-3f66fd0861bd tempest-VolumesSnapshotTestJSON-1082928251 None] Flow 'volume_create_manager' (b528e190-a8f3-4082-bdf1-f47cfbdd9512) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:52:52 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-ee5bd9c7-507c-44f2-a74c-3f66fd0861bd tempest-VolumesSnapshotTestJSON-1082928251 None] Created volume successfully.
Jul 10 12:52:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-57a1add0-acc3-4858-9bfb-ba45b9c8ef3f tempest-VolumesSnapshotTestJSON-1082928251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:52:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-57a1add0-acc3-4858-9bfb-ba45b9c8ef3f tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:52:53 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-57a1add0-acc3-4858-9bfb-ba45b9c8ef3f tempest-VolumesSnapshotTestJSON-1082928251 None] Creating offline snapshot b021b25f-53e0-4537-aee1-46dbf5172142 of volume f60d5eee-b793-443e-8649-5a58ffb8ddf4 {{(pid=87378) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 10 12:52:53 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[106b42a1-7713-4e91-a14f-18ba9468806a]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:52:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-57a1add0-acc3-4858-9bfb-ba45b9c8ef3f tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:52:53 devstack sudo[101129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4
Jul 10 12:52:53 devstack sudo[101129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:52:54 devstack sudo[101129]: pam_unix(sudo:session): session closed for user root
Jul 10 12:52:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-57a1add0-acc3-4858-9bfb-ba45b9c8ef3f tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4" returned: 0 in 0.827s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:52:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-57a1add0-acc3-4858-9bfb-ba45b9c8ef3f tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4.b021b25f-53e0-4537-aee1-46dbf5172142 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:52:54 devstack sudo[101134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4.b021b25f-53e0-4537-aee1-46dbf5172142 1G
Jul 10 12:52:54 devstack sudo[101134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:52:55 devstack sudo[101134]: pam_unix(sudo:session): session closed for user root
Jul 10 12:52:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-57a1add0-acc3-4858-9bfb-ba45b9c8ef3f tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4.b021b25f-53e0-4537-aee1-46dbf5172142 1G" returned: 0 in 0.916s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:52:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-57a1add0-acc3-4858-9bfb-ba45b9c8ef3f tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4.b021b25f-53e0-4537-aee1-46dbf5172142 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:52:55 devstack sudo[101140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4.b021b25f-53e0-4537-aee1-46dbf5172142
Jul 10 12:52:55 devstack sudo[101140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:52:55 devstack sudo[101140]: pam_unix(sudo:session): session closed for user root
Jul 10 12:52:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-57a1add0-acc3-4858-9bfb-ba45b9c8ef3f tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4.b021b25f-53e0-4537-aee1-46dbf5172142" returned: 0 in 0.774s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:52:55 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-57a1add0-acc3-4858-9bfb-ba45b9c8ef3f tempest-VolumesSnapshotTestJSON-1082928251 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4.b021b25f-53e0-4537-aee1-46dbf5172142 is being set with open permissions: ugo+rw
Jul 10 12:52:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-57a1add0-acc3-4858-9bfb-ba45b9c8ef3f tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4.b021b25f-53e0-4537-aee1-46dbf5172142 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:52:55 devstack sudo[101146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4.b021b25f-53e0-4537-aee1-46dbf5172142
Jul 10 12:52:55 devstack sudo[101146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:52:56 devstack sudo[101146]: pam_unix(sudo:session): session closed for user root
Jul 10 12:52:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-57a1add0-acc3-4858-9bfb-ba45b9c8ef3f tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4.b021b25f-53e0-4537-aee1-46dbf5172142" returned: 0 in 0.720s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:52:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-57a1add0-acc3-4858-9bfb-ba45b9c8ef3f tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:52:56 devstack sudo[101161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4.info
Jul 10 12:52:56 devstack sudo[101161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:52:57 devstack sudo[101161]: pam_unix(sudo:session): session closed for user root
Jul 10 12:52:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-57a1add0-acc3-4858-9bfb-ba45b9c8ef3f tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4.info" returned: 0 in 0.692s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:52:57 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-57a1add0-acc3-4858-9bfb-ba45b9c8ef3f tempest-VolumesSnapshotTestJSON-1082928251 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4.info is being set with open permissions: ugo+rw
Jul 10 12:52:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-57a1add0-acc3-4858-9bfb-ba45b9c8ef3f tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:52:57 devstack sudo[101181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4.info
Jul 10 12:52:57 devstack sudo[101181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:52:57 devstack sudo[101181]: pam_unix(sudo:session): session closed for user root
Jul 10 12:52:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-57a1add0-acc3-4858-9bfb-ba45b9c8ef3f tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4.info" returned: 0 in 0.683s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:52:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-57a1add0-acc3-4858-9bfb-ba45b9c8ef3f tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.697s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:52:58 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-57a1add0-acc3-4858-9bfb-ba45b9c8ef3f tempest-VolumesSnapshotTestJSON-1082928251 None] Create snapshot completed successfully
Jul 10 12:52:59 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:52:59 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] Flow 'volume_create_manager' (0eb72d10-0431-47b2-ae2c-11866207cb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:52:59 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f8976a0-1e49-47e8-8ca1-d6991e96a903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:52:59 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f8976a0-1e49-47e8-8ca1-d6991e96a903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-696191020',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06c1288c-c404-4def-840d-cdfe33843164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d425631eefe8472c89e24c6b4811a3d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:52:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=b021b25f-53e0-4537-aee1-46dbf5172142,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:52:59Z,use_quota=True,user_id='4439e7f0e5554d9d87d2f5bcae5d85d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:52:59 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18ad80c0-8763-4c6e-918e-2a969c2514f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:52:59 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18ad80c0-8763-4c6e-918e-2a969c2514f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:52:59 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e946f3e7-98fc-4d52-b026-18c6ac06f99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:52:59 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e946f3e7-98fc-4d52-b026-18c6ac06f99c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '06c1288c-c404-4def-840d-cdfe33843164', 'volume_name': 'volume-06c1288c-c404-4def-840d-cdfe33843164', 'volume_size': 2, 'snapshot_id': 'b021b25f-53e0-4537-aee1-46dbf5172142'}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:52:59 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5358d8d5-e56e-4f5e-a298-5cabef32060c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:52:59 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5358d8d5-e56e-4f5e-a298-5cabef32060c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:52:59 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc7f404f-c20c-4403-8bc9-e6580598532a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:52:59 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] Volume 06c1288c-c404-4def-840d-cdfe33843164: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-06c1288c-c404-4def-840d-cdfe33843164', 'volume_size': 2, 'snapshot_id': 'b021b25f-53e0-4537-aee1-46dbf5172142'}
Jul 10 12:52:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:52:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:52:59 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] Acquiring lock "cinder-quobyte-b021b25f-53e0-4537-aee1-46dbf5172142-06c1288c-c404-4def-840d-cdfe33843164" by "_create_volume_from_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:52:59 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "cinder-quobyte-b021b25f-53e0-4537-aee1-46dbf5172142-06c1288c-c404-4def-840d-cdfe33843164" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:52:59 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] Creating volume 06c1288c-c404-4def-840d-cdfe33843164 from snapshot b021b25f-53e0-4537-aee1-46dbf5172142 {{(pid=87378) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 10 12:52:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:52:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:52:59 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:52:59 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:52:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:52:59 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:52:59 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] Acquiring lock "cinder-quobyte-06c1288c-c404-4def-840d-cdfe33843164" by "_copy_volume_from_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:52:59 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "cinder-quobyte-06c1288c-c404-4def-840d-cdfe33843164" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:52:59 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] snapshot: b021b25f-53e0-4537-aee1-46dbf5172142, volume: 06c1288c-c404-4def-840d-cdfe33843164,  {{(pid=87378) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 10 12:52:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:52:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:52:59 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:52:59 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:52:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:52:59 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7d9e8c-38ff-4261-a6d7-6ba53879ce56]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:52:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4.b021b25f-53e0-4537-aee1-46dbf5172142 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:52:59 devstack sudo[101231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4.b021b25f-53e0-4537-aee1-46dbf5172142
Jul 10 12:52:59 devstack sudo[101231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:53:00 devstack sudo[101231]: pam_unix(sudo:session): session closed for user root
Jul 10 12:53:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4.b021b25f-53e0-4537-aee1-46dbf5172142" returned: 0 in 0.788s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:53:00 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:53:00 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] will copy from snapshot at /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4 {{(pid=87378) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 10 12:53:00 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] Creating direct copy from snapshot {{(pid=87378) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 10 12:53:00 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8337f1-47c0-4632-88f0-a5db4fea1cae]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:53:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:53:00 devstack sudo[101240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4
Jul 10 12:53:00 devstack sudo[101240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:53:01 devstack sudo[101240]: pam_unix(sudo:session): session closed for user root
Jul 10 12:53:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4" returned: 0 in 0.810s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:53:01 devstack cinder-volume[87378]: DEBUG cinder.utils [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] Path /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-06c1288c-c404-4def-840d-cdfe33843164 not found in is_blk_device check {{(pid=87378) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 10 12:53:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-06c1288c-c404-4def-840d-cdfe33843164 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:53:01 devstack sudo[101262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-06c1288c-c404-4def-840d-cdfe33843164
Jul 10 12:53:01 devstack sudo[101262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:53:07 devstack sudo[101262]: pam_unix(sudo:session): session closed for user root
Jul 10 12:53:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-06c1288c-c404-4def-840d-cdfe33843164" returned: 0 in 6.482s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:53:07 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa1def5-5a23-4f5c-a382-29e0fa59f329]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:53:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:53:07 devstack sudo[101277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4
Jul 10 12:53:07 devstack sudo[101277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:53:07 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cd1e8d8-e20a-4f55-bf76-e53cb5147f21 tempest-TestMinimumBasicScenario-2115265487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:53:07 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3cd1e8d8-e20a-4f55-bf76-e53cb5147f21 tempest-TestMinimumBasicScenario-2115265487 None] Flow 'volume_create_manager' (37f3e92b-4916-46e1-b1cf-b6001439a950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:53:07 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3cd1e8d8-e20a-4f55-bf76-e53cb5147f21 tempest-TestMinimumBasicScenario-2115265487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (702afbf2-1b76-4725-8f6c-f119b0936406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:53:07 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3cd1e8d8-e20a-4f55-bf76-e53cb5147f21 tempest-TestMinimumBasicScenario-2115265487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (702afbf2-1b76-4725-8f6c-f119b0936406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:53:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1414813997',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=597918c0-f3a5-4c6d-8377-cf0a9a95c500,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2e635370c574196a3e1573364c4cab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:53:08Z,use_quota=True,user_id='49935e324d5344fabc2ee9dc6d927f0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:53:07 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3cd1e8d8-e20a-4f55-bf76-e53cb5147f21 tempest-TestMinimumBasicScenario-2115265487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1c09bf8-fca2-4adf-a545-6db1060706bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:53:07 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3cd1e8d8-e20a-4f55-bf76-e53cb5147f21 tempest-TestMinimumBasicScenario-2115265487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1c09bf8-fca2-4adf-a545-6db1060706bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:53:07 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3cd1e8d8-e20a-4f55-bf76-e53cb5147f21 tempest-TestMinimumBasicScenario-2115265487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc349552-52d1-4e94-a828-7669230690c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:53:07 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3cd1e8d8-e20a-4f55-bf76-e53cb5147f21 tempest-TestMinimumBasicScenario-2115265487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc349552-52d1-4e94-a828-7669230690c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '597918c0-f3a5-4c6d-8377-cf0a9a95c500', 'volume_name': 'volume-597918c0-f3a5-4c6d-8377-cf0a9a95c500', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:53:07 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3cd1e8d8-e20a-4f55-bf76-e53cb5147f21 tempest-TestMinimumBasicScenario-2115265487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d83c3963-0e3f-4a3a-a90f-37e26c7f7611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:53:07 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3cd1e8d8-e20a-4f55-bf76-e53cb5147f21 tempest-TestMinimumBasicScenario-2115265487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d83c3963-0e3f-4a3a-a90f-37e26c7f7611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:53:07 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3cd1e8d8-e20a-4f55-bf76-e53cb5147f21 tempest-TestMinimumBasicScenario-2115265487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af79e067-2bfc-4237-bbe3-9d7b375113f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:53:07 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-3cd1e8d8-e20a-4f55-bf76-e53cb5147f21 tempest-TestMinimumBasicScenario-2115265487 None] Volume 597918c0-f3a5-4c6d-8377-cf0a9a95c500: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-597918c0-f3a5-4c6d-8377-cf0a9a95c500', 'volume_size': 1}
Jul 10 12:53:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3cd1e8d8-e20a-4f55-bf76-e53cb5147f21 tempest-TestMinimumBasicScenario-2115265487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:53:08 devstack sudo[101277]: pam_unix(sudo:session): session closed for user root
Jul 10 12:53:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4" returned: 0 in 1.017s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:53:08 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] Image conversion details: src /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4, size 1024.00 MB, duration 6.48 sec, destination /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-06c1288c-c404-4def-840d-cdfe33843164 {{(pid=87378) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 10 12:53:08 devstack cinder-volume[87378]: INFO cinder.image.image_utils [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] Converted 1024.00 MB image at 157.94 MB/s
Jul 10 12:53:08 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-06c1288c-c404-4def-840d-cdfe33843164 is being set with open permissions: ugo+rw
Jul 10 12:53:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-06c1288c-c404-4def-840d-cdfe33843164 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:53:08 devstack sudo[101282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-06c1288c-c404-4def-840d-cdfe33843164
Jul 10 12:53:08 devstack sudo[101282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:53:09 devstack sudo[101282]: pam_unix(sudo:session): session closed for user root
Jul 10 12:53:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-06c1288c-c404-4def-840d-cdfe33843164" returned: 0 in 0.666s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:53:09 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "cinder-quobyte-06c1288c-c404-4def-840d-cdfe33843164" released by "_copy_volume_from_snapshot" :: held 9.875s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:53:09 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "cinder-quobyte-b021b25f-53e0-4537-aee1-46dbf5172142-06c1288c-c404-4def-840d-cdfe33843164" released by "_create_volume_from_snapshot" :: held 9.929s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:53:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.954s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:53:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3cd1e8d8-e20a-4f55-bf76-e53cb5147f21 tempest-TestMinimumBasicScenario-2115265487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.389s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:53:09 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3cd1e8d8-e20a-4f55-bf76-e53cb5147f21 tempest-TestMinimumBasicScenario-2115265487 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:53:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1414813997',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=597918c0-f3a5-4c6d-8377-cf0a9a95c500,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2e635370c574196a3e1573364c4cab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:53:08Z,use_quota=True,user_id='49935e324d5344fabc2ee9dc6d927f0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:53:09 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-3cd1e8d8-e20a-4f55-bf76-e53cb5147f21 tempest-TestMinimumBasicScenario-2115265487 None] Creating volume 597918c0-f3a5-4c6d-8377-cf0a9a95c500 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:53:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3cd1e8d8-e20a-4f55-bf76-e53cb5147f21 tempest-TestMinimumBasicScenario-2115265487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:53:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3cd1e8d8-e20a-4f55-bf76-e53cb5147f21 tempest-TestMinimumBasicScenario-2115265487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:53:09 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3cd1e8d8-e20a-4f55-bf76-e53cb5147f21 tempest-TestMinimumBasicScenario-2115265487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:53:09 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3cd1e8d8-e20a-4f55-bf76-e53cb5147f21 tempest-TestMinimumBasicScenario-2115265487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:53:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3cd1e8d8-e20a-4f55-bf76-e53cb5147f21 tempest-TestMinimumBasicScenario-2115265487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:53:09 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3cd1e8d8-e20a-4f55-bf76-e53cb5147f21 tempest-TestMinimumBasicScenario-2115265487 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:53:09 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-3cd1e8d8-e20a-4f55-bf76-e53cb5147f21 tempest-TestMinimumBasicScenario-2115265487 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:53:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3cd1e8d8-e20a-4f55-bf76-e53cb5147f21 tempest-TestMinimumBasicScenario-2115265487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-597918c0-f3a5-4c6d-8377-cf0a9a95c500 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:53:09 devstack sudo[101286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-597918c0-f3a5-4c6d-8377-cf0a9a95c500 1073741824
Jul 10 12:53:09 devstack sudo[101286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:53:09 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc7f404f-c20c-4403-8bc9-e6580598532a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06c1288c-c404-4def-840d-cdfe33843164', 'volume_size': 2, 'snapshot_id': 'b021b25f-53e0-4537-aee1-46dbf5172142'}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:53:09 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38e60703-a6c1-40f5-82dc-d724de4cc4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:53:09 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] Volume volume-06c1288c-c404-4def-840d-cdfe33843164 (06c1288c-c404-4def-840d-cdfe33843164): created successfully
Jul 10 12:53:09 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38e60703-a6c1-40f5-82dc-d724de4cc4b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:53:09 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] Flow 'volume_create_manager' (0eb72d10-0431-47b2-ae2c-11866207cb9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:53:09 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-4b579214-3065-4b6a-b802-1b355cf39c4f tempest-VolumesSnapshotTestJSON-1082928251 None] Created volume successfully.
Jul 10 12:53:10 devstack sudo[101286]: pam_unix(sudo:session): session closed for user root
Jul 10 12:53:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3cd1e8d8-e20a-4f55-bf76-e53cb5147f21 tempest-TestMinimumBasicScenario-2115265487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-597918c0-f3a5-4c6d-8377-cf0a9a95c500 1073741824" returned: 0 in 0.835s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:53:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3cd1e8d8-e20a-4f55-bf76-e53cb5147f21 tempest-TestMinimumBasicScenario-2115265487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-597918c0-f3a5-4c6d-8377-cf0a9a95c500 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:53:10 devstack sudo[101291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-597918c0-f3a5-4c6d-8377-cf0a9a95c500
Jul 10 12:53:10 devstack sudo[101291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:53:10 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-14ac143f-fc57-4330-90a3-82bfb4c95881 tempest-VolumesSnapshotTestJSON-1082928251 None] Acquiring lock "cinder-06c1288c-c404-4def-840d-cdfe33843164-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:53:10 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-14ac143f-fc57-4330-90a3-82bfb4c95881 tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "cinder-06c1288c-c404-4def-840d-cdfe33843164-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:53:10 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-14ac143f-fc57-4330-90a3-82bfb4c95881 tempest-VolumesSnapshotTestJSON-1082928251 None] Acquiring lock "cinder-quobyte-06c1288c-c404-4def-840d-cdfe33843164" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:53:10 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-14ac143f-fc57-4330-90a3-82bfb4c95881 tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "cinder-quobyte-06c1288c-c404-4def-840d-cdfe33843164" acquired by "delete_volume" :: waited 0.036s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:53:10 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[1428c2cc-e3bd-4b62-be5d-2e14e922d18a]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:53:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-14ac143f-fc57-4330-90a3-82bfb4c95881 tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-06c1288c-c404-4def-840d-cdfe33843164 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:53:10 devstack sudo[101293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-06c1288c-c404-4def-840d-cdfe33843164
Jul 10 12:53:10 devstack sudo[101293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:53:10 devstack sudo[101291]: pam_unix(sudo:session): session closed for user root
Jul 10 12:53:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3cd1e8d8-e20a-4f55-bf76-e53cb5147f21 tempest-TestMinimumBasicScenario-2115265487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-597918c0-f3a5-4c6d-8377-cf0a9a95c500" returned: 0 in 0.678s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:53:10 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3cd1e8d8-e20a-4f55-bf76-e53cb5147f21 tempest-TestMinimumBasicScenario-2115265487 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:53:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3cd1e8d8-e20a-4f55-bf76-e53cb5147f21 tempest-TestMinimumBasicScenario-2115265487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:53:10 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3cd1e8d8-e20a-4f55-bf76-e53cb5147f21 tempest-TestMinimumBasicScenario-2115265487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af79e067-2bfc-4237-bbe3-9d7b375113f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-597918c0-f3a5-4c6d-8377-cf0a9a95c500', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:53:10 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3cd1e8d8-e20a-4f55-bf76-e53cb5147f21 tempest-TestMinimumBasicScenario-2115265487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e98b10a-4f98-4588-b39b-9cd8dae00b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:53:10 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-3cd1e8d8-e20a-4f55-bf76-e53cb5147f21 tempest-TestMinimumBasicScenario-2115265487 None] Volume volume-597918c0-f3a5-4c6d-8377-cf0a9a95c500 (597918c0-f3a5-4c6d-8377-cf0a9a95c500): created successfully
Jul 10 12:53:10 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3cd1e8d8-e20a-4f55-bf76-e53cb5147f21 tempest-TestMinimumBasicScenario-2115265487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e98b10a-4f98-4588-b39b-9cd8dae00b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:53:10 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3cd1e8d8-e20a-4f55-bf76-e53cb5147f21 tempest-TestMinimumBasicScenario-2115265487 None] Flow 'volume_create_manager' (37f3e92b-4916-46e1-b1cf-b6001439a950) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:53:10 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-3cd1e8d8-e20a-4f55-bf76-e53cb5147f21 tempest-TestMinimumBasicScenario-2115265487 None] Created volume successfully.
Jul 10 12:53:11 devstack sudo[101293]: pam_unix(sudo:session): session closed for user root
Jul 10 12:53:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-14ac143f-fc57-4330-90a3-82bfb4c95881 tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-06c1288c-c404-4def-840d-cdfe33843164" returned: 0 in 0.804s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:53:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-14ac143f-fc57-4330-90a3-82bfb4c95881 tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-06c1288c-c404-4def-840d-cdfe33843164 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:53:11 devstack sudo[101300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-06c1288c-c404-4def-840d-cdfe33843164
Jul 10 12:53:11 devstack sudo[101300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:53:12 devstack sudo[101300]: pam_unix(sudo:session): session closed for user root
Jul 10 12:53:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-14ac143f-fc57-4330-90a3-82bfb4c95881 tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-06c1288c-c404-4def-840d-cdfe33843164" returned: 0 in 0.692s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:53:12 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-14ac143f-fc57-4330-90a3-82bfb4c95881 tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "cinder-quobyte-06c1288c-c404-4def-840d-cdfe33843164" released by "delete_volume" :: held 1.546s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:53:12 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-14ac143f-fc57-4330-90a3-82bfb4c95881 tempest-VolumesSnapshotTestJSON-1082928251 None] Created reservations ['5353cd7a-fd9e-4f79-b2a0-66327387b9c2', '5cb9fb2e-285a-4ace-b448-fa15057fb0b3', 'ed607b8e-7650-43a3-b0b5-94e641f3856e', '7652027e-cd3b-4151-acd7-5798bef9e540'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:53:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-14ac143f-fc57-4330-90a3-82bfb4c95881 tempest-VolumesSnapshotTestJSON-1082928251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:53:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-14ac143f-fc57-4330-90a3-82bfb4c95881 tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:53:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-14ac143f-fc57-4330-90a3-82bfb4c95881 tempest-VolumesSnapshotTestJSON-1082928251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:53:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-14ac143f-fc57-4330-90a3-82bfb4c95881 tempest-VolumesSnapshotTestJSON-1082928251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:53:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-14ac143f-fc57-4330-90a3-82bfb4c95881 tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:53:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-14ac143f-fc57-4330-90a3-82bfb4c95881 tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:53:12 devstack sudo[101306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:53:12 devstack sudo[101306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:53:12 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3d0069c8-5708-49e2-b0fb-30c03124595e tempest-VolumesSnapshotTestJSON-1082928251 None] Acquiring lock "cinder-b021b25f-53e0-4537-aee1-46dbf5172142-delete_snapshot" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:53:12 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:53:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:53:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:53:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:53:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:53:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:53:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:53:13 devstack sudo[101309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:53:13 devstack sudo[101309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:53:13 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3d0069c8-5708-49e2-b0fb-30c03124595e tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "cinder-b021b25f-53e0-4537-aee1-46dbf5172142-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:53:13 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3d0069c8-5708-49e2-b0fb-30c03124595e tempest-VolumesSnapshotTestJSON-1082928251 None] Acquiring lock "cinder-quobyte-f60d5eee-b793-443e-8649-5a58ffb8ddf4" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:53:13 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3d0069c8-5708-49e2-b0fb-30c03124595e tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "cinder-quobyte-f60d5eee-b793-443e-8649-5a58ffb8ddf4" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:53:13 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3d0069c8-5708-49e2-b0fb-30c03124595e tempest-VolumesSnapshotTestJSON-1082928251 None] Acquiring lock "cinder-quobyte-b021b25f-53e0-4537-aee1-46dbf5172142" by "_delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:53:13 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3d0069c8-5708-49e2-b0fb-30c03124595e tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "cinder-quobyte-b021b25f-53e0-4537-aee1-46dbf5172142" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:53:13 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-3d0069c8-5708-49e2-b0fb-30c03124595e tempest-VolumesSnapshotTestJSON-1082928251 None] Deleting offline snapshot b021b25f-53e0-4537-aee1-46dbf5172142 of volume f60d5eee-b793-443e-8649-5a58ffb8ddf4 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 10 12:53:13 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-3d0069c8-5708-49e2-b0fb-30c03124595e tempest-VolumesSnapshotTestJSON-1082928251 None] snapshot_file for this snap is: volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4.b021b25f-53e0-4537-aee1-46dbf5172142 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 10 12:53:13 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d1367a-9c62-4745-9236-59b4c6c7e7fb]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:53:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3d0069c8-5708-49e2-b0fb-30c03124595e tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4.b021b25f-53e0-4537-aee1-46dbf5172142 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:53:13 devstack sudo[101306]: pam_unix(sudo:session): session closed for user root
Jul 10 12:53:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-14ac143f-fc57-4330-90a3-82bfb4c95881 tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.737s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:53:13 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-14ac143f-fc57-4330-90a3-82bfb4c95881 tempest-VolumesSnapshotTestJSON-1082928251 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:53:13 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-14ac143f-fc57-4330-90a3-82bfb4c95881 tempest-VolumesSnapshotTestJSON-1082928251 None] Deleted volume successfully.
Jul 10 12:53:13 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-14ac143f-fc57-4330-90a3-82bfb4c95881 tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "cinder-06c1288c-c404-4def-840d-cdfe33843164-delete_volume" released by "delete_volume" :: held 2.577s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:53:13 devstack sudo[101311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4.b021b25f-53e0-4537-aee1-46dbf5172142
Jul 10 12:53:13 devstack sudo[101311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:53:13 devstack sudo[101309]: pam_unix(sudo:session): session closed for user root
Jul 10 12:53:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.751s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:53:13 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:53:13 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager._thread_info {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:53:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread count: 28 {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 10 12:53:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread info: [<_MainThread(MainThread, started 128233544536192)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128233445424704)>, <Thread(Thread-3 (stat_writer), started daemon 128233435118528)>, <Thread(Rabbit-heartbeat, started daemon 128233435718016)>, <Thread(Thread-5 (_runner), started daemon 128233432624448)>, <Thread(Thread-7 (_runner), started daemon 128233432674688)>, <Thread(fd_logger, started daemon 128233428569472)>, <Thread(privsep_reader, started daemon 128233429417088)>, <Thread(tpool_thread_0, started daemon 128233421182656)>, <Thread(tpool_thread_1, started daemon 128233412789952)>, <Thread(tpool_thread_2, started daemon 128233404397248)>, <Thread(tpool_thread_3, started daemon 128233396004544)>, <Thread(tpool_thread_4, started daemon 128233387611840)>, <Thread(tpool_thread_5, started daemon 128233379219136)>, <Thread(tpool_thread_6, started daemon 128233370826432)>, <Thread(tpool_thread_7, started daemon 128233362433728)>, <Thread(tpool_thread_8, started daemon 128233354041024)>, <Thread(tpool_thread_9, started daemon 128233345631936)>, <Thread(tpool_thread_10, started daemon 128233337222848)>, <Thread(tpool_thread_11, started daemon 128233328813760)>, <Thread(tpool_thread_12, started daemon 128233320404672)>, <Thread(tpool_thread_13, started daemon 128233311995584)>, <Thread(tpool_thread_14, started daemon 128233303586496)>, <Thread(tpool_thread_15, started daemon 128233295177408)>, <Thread(tpool_thread_16, started daemon 128233286768320)>, <Thread(tpool_thread_17, started daemon 128233278359232)>, <Thread(tpool_thread_18, started daemon 128233269950144)>, <Thread(tpool_thread_19, started daemon 128233261541056)>] {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 10 12:53:13 devstack sudo[101311]: pam_unix(sudo:session): session closed for user root
Jul 10 12:53:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3d0069c8-5708-49e2-b0fb-30c03124595e tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4.b021b25f-53e0-4537-aee1-46dbf5172142" returned: 0 in 0.832s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:53:13 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-3d0069c8-5708-49e2-b0fb-30c03124595e tempest-VolumesSnapshotTestJSON-1082928251 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:53:13 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[cadcaeda-cc5c-4c0b-8636-a680d5b69d86]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:53:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3d0069c8-5708-49e2-b0fb-30c03124595e tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:53:14 devstack sudo[101337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4
Jul 10 12:53:14 devstack sudo[101337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:53:14 devstack sudo[101337]: pam_unix(sudo:session): session closed for user root
Jul 10 12:53:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3d0069c8-5708-49e2-b0fb-30c03124595e tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4" returned: 0 in 0.764s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:53:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3d0069c8-5708-49e2-b0fb-30c03124595e tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4.b021b25f-53e0-4537-aee1-46dbf5172142 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:53:14 devstack sudo[101342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4.b021b25f-53e0-4537-aee1-46dbf5172142
Jul 10 12:53:14 devstack sudo[101342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:53:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-cad591f4-5117-4e31-b712-900e84fad815 req-5031de6a-322a-4893-b19f-c09ceecd052c tempest-TestMinimumBasicScenario-2115265487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:53:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-cad591f4-5117-4e31-b712-900e84fad815 req-5031de6a-322a-4893-b19f-c09ceecd052c tempest-TestMinimumBasicScenario-2115265487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:53:15 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5833db-b5fc-455c-abb1-744e1dacf753]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:53:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-cad591f4-5117-4e31-b712-900e84fad815 req-5031de6a-322a-4893-b19f-c09ceecd052c tempest-TestMinimumBasicScenario-2115265487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-597918c0-f3a5-4c6d-8377-cf0a9a95c500 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:53:15 devstack sudo[101355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-597918c0-f3a5-4c6d-8377-cf0a9a95c500
Jul 10 12:53:15 devstack sudo[101355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:53:15 devstack sudo[101342]: pam_unix(sudo:session): session closed for user root
Jul 10 12:53:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3d0069c8-5708-49e2-b0fb-30c03124595e tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4.b021b25f-53e0-4537-aee1-46dbf5172142" returned: 0 in 0.746s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:53:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3d0069c8-5708-49e2-b0fb-30c03124595e tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4.b021b25f-53e0-4537-aee1-46dbf5172142 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:53:15 devstack sudo[101357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4.b021b25f-53e0-4537-aee1-46dbf5172142
Jul 10 12:53:15 devstack sudo[101357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:53:16 devstack sudo[101357]: pam_unix(sudo:session): session closed for user root
Jul 10 12:53:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3d0069c8-5708-49e2-b0fb-30c03124595e tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4.b021b25f-53e0-4537-aee1-46dbf5172142" returned: 0 in 0.635s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:53:16 devstack sudo[101355]: pam_unix(sudo:session): session closed for user root
Jul 10 12:53:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-cad591f4-5117-4e31-b712-900e84fad815 req-5031de6a-322a-4893-b19f-c09ceecd052c tempest-TestMinimumBasicScenario-2115265487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-597918c0-f3a5-4c6d-8377-cf0a9a95c500" returned: 0 in 0.808s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:53:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-cad591f4-5117-4e31-b712-900e84fad815 req-5031de6a-322a-4893-b19f-c09ceecd052c tempest-TestMinimumBasicScenario-2115265487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.829s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:53:16 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3d0069c8-5708-49e2-b0fb-30c03124595e tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "cinder-quobyte-b021b25f-53e0-4537-aee1-46dbf5172142" released by "_delete_snapshot" :: held 3.101s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:53:16 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3d0069c8-5708-49e2-b0fb-30c03124595e tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "cinder-quobyte-f60d5eee-b793-443e-8649-5a58ffb8ddf4" released by "delete_snapshot" :: held 3.135s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:53:16 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-cad591f4-5117-4e31-b712-900e84fad815 req-5031de6a-322a-4893-b19f-c09ceecd052c tempest-TestMinimumBasicScenario-2115265487 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be', 'name': 'volume-597918c0-f3a5-4c6d-8377-cf0a9a95c500', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c1a54c76-a7d3-4942-93ac-6f9ddc574314', 'enforce_multipath': True} {{(pid=87378) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 10 12:53:16 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-3d0069c8-5708-49e2-b0fb-30c03124595e tempest-VolumesSnapshotTestJSON-1082928251 None] Created reservations ['b1b9ae99-1b63-471e-a9a0-ecf86be540fd', '8ff7d874-016a-496f-85c8-941077779f2c', '3241b9e4-b759-48e2-8d51-80c0b58f1474', '23ab674b-831e-4bb2-ba47-c91ca2d00330'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:53:16 devstack cinder-volume[87378]: INFO cinder.volume.manager [req-cad591f4-5117-4e31-b712-900e84fad815 req-5031de6a-322a-4893-b19f-c09ceecd052c tempest-TestMinimumBasicScenario-2115265487 None] attachment_update completed successfully.
Jul 10 12:53:16 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-3d0069c8-5708-49e2-b0fb-30c03124595e tempest-VolumesSnapshotTestJSON-1082928251 None] Delete snapshot completed successfully.
Jul 10 12:53:16 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3d0069c8-5708-49e2-b0fb-30c03124595e tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "cinder-b021b25f-53e0-4537-aee1-46dbf5172142-delete_snapshot" released by "delete_snapshot" :: held 3.307s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:53:17 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fa9f143b-b070-4459-97b0-d8091a9c2e9b tempest-VolumesSnapshotTestJSON-1082928251 None] Acquiring lock "cinder-f60d5eee-b793-443e-8649-5a58ffb8ddf4-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:53:17 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fa9f143b-b070-4459-97b0-d8091a9c2e9b tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "cinder-f60d5eee-b793-443e-8649-5a58ffb8ddf4-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:53:17 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fa9f143b-b070-4459-97b0-d8091a9c2e9b tempest-VolumesSnapshotTestJSON-1082928251 None] Acquiring lock "cinder-quobyte-f60d5eee-b793-443e-8649-5a58ffb8ddf4" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:53:17 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fa9f143b-b070-4459-97b0-d8091a9c2e9b tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "cinder-quobyte-f60d5eee-b793-443e-8649-5a58ffb8ddf4" acquired by "delete_volume" :: waited 0.015s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:53:17 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a5c56e-d5f4-4382-9ee0-1baeea4a1e70]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:53:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fa9f143b-b070-4459-97b0-d8091a9c2e9b tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:53:17 devstack sudo[101745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4
Jul 10 12:53:17 devstack sudo[101745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:53:18 devstack sudo[101745]: pam_unix(sudo:session): session closed for user root
Jul 10 12:53:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fa9f143b-b070-4459-97b0-d8091a9c2e9b tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4" returned: 0 in 0.776s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:53:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fa9f143b-b070-4459-97b0-d8091a9c2e9b tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:53:18 devstack sudo[101750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4
Jul 10 12:53:18 devstack sudo[101750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:53:18 devstack sudo[101750]: pam_unix(sudo:session): session closed for user root
Jul 10 12:53:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fa9f143b-b070-4459-97b0-d8091a9c2e9b tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f60d5eee-b793-443e-8649-5a58ffb8ddf4" returned: 0 in 0.629s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:53:18 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fa9f143b-b070-4459-97b0-d8091a9c2e9b tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "cinder-quobyte-f60d5eee-b793-443e-8649-5a58ffb8ddf4" released by "delete_volume" :: held 1.472s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:53:18 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-fa9f143b-b070-4459-97b0-d8091a9c2e9b tempest-VolumesSnapshotTestJSON-1082928251 None] Created reservations ['7c31c126-a5da-4def-886e-0ca756578d8a', '1f207a33-e815-4d3f-a736-f71c78e2fb92', '10eb0327-5e10-44e0-8ec1-550be1b80136', 'ecc098a4-2de7-4361-bfb8-c2df4d02003b'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:53:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-fa9f143b-b070-4459-97b0-d8091a9c2e9b tempest-VolumesSnapshotTestJSON-1082928251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:53:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-fa9f143b-b070-4459-97b0-d8091a9c2e9b tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:53:18 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-fa9f143b-b070-4459-97b0-d8091a9c2e9b tempest-VolumesSnapshotTestJSON-1082928251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:53:18 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-fa9f143b-b070-4459-97b0-d8091a9c2e9b tempest-VolumesSnapshotTestJSON-1082928251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:53:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-fa9f143b-b070-4459-97b0-d8091a9c2e9b tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:53:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fa9f143b-b070-4459-97b0-d8091a9c2e9b tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:53:18 devstack sudo[101753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:53:18 devstack sudo[101753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:53:19 devstack sudo[101753]: pam_unix(sudo:session): session closed for user root
Jul 10 12:53:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fa9f143b-b070-4459-97b0-d8091a9c2e9b tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.681s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:53:19 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-fa9f143b-b070-4459-97b0-d8091a9c2e9b tempest-VolumesSnapshotTestJSON-1082928251 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:53:19 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-fa9f143b-b070-4459-97b0-d8091a9c2e9b tempest-VolumesSnapshotTestJSON-1082928251 None] Deleted volume successfully.
Jul 10 12:53:19 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fa9f143b-b070-4459-97b0-d8091a9c2e9b tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "cinder-f60d5eee-b793-443e-8649-5a58ffb8ddf4-delete_volume" released by "delete_volume" :: held 2.370s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:53:19 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d800411-0438-43e3-8f8b-8383d41817ff tempest-VolumesSnapshotTestJSON-1082928251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:53:20 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2d800411-0438-43e3-8f8b-8383d41817ff tempest-VolumesSnapshotTestJSON-1082928251 None] Flow 'volume_create_manager' (ce71b6e8-ef72-4a04-a80d-5110769c28d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:53:20 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2d800411-0438-43e3-8f8b-8383d41817ff tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcb79726-661e-47b3-92ff-e5247925a40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:53:20 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2d800411-0438-43e3-8f8b-8383d41817ff tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcb79726-661e-47b3-92ff-e5247925a40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:53:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-825391734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6349eb93-b01e-404e-aaf4-32f70cbfb1da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d425631eefe8472c89e24c6b4811a3d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:53:20Z,use_quota=True,user_id='4439e7f0e5554d9d87d2f5bcae5d85d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:53:20 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2d800411-0438-43e3-8f8b-8383d41817ff tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbceb946-7ff2-49ec-8192-277a21c2b0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:53:20 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2d800411-0438-43e3-8f8b-8383d41817ff tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbceb946-7ff2-49ec-8192-277a21c2b0cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:53:20 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2d800411-0438-43e3-8f8b-8383d41817ff tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (264c9a53-216f-4762-af71-af7e5ad8fd47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:53:20 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2d800411-0438-43e3-8f8b-8383d41817ff tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (264c9a53-216f-4762-af71-af7e5ad8fd47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6349eb93-b01e-404e-aaf4-32f70cbfb1da', 'volume_name': 'volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:53:20 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2d800411-0438-43e3-8f8b-8383d41817ff tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ebd5eb4-1d8c-4425-ba7d-5dd1f7836893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:53:20 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2d800411-0438-43e3-8f8b-8383d41817ff tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ebd5eb4-1d8c-4425-ba7d-5dd1f7836893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:53:20 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2d800411-0438-43e3-8f8b-8383d41817ff tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31ab96fd-62f5-4f57-afa7-bbf14f5ef9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:53:20 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-2d800411-0438-43e3-8f8b-8383d41817ff tempest-VolumesSnapshotTestJSON-1082928251 None] Volume 6349eb93-b01e-404e-aaf4-32f70cbfb1da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da', 'volume_size': 1}
Jul 10 12:53:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2d800411-0438-43e3-8f8b-8383d41817ff tempest-VolumesSnapshotTestJSON-1082928251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:53:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2d800411-0438-43e3-8f8b-8383d41817ff tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:53:20 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-2d800411-0438-43e3-8f8b-8383d41817ff tempest-VolumesSnapshotTestJSON-1082928251 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:53:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-825391734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6349eb93-b01e-404e-aaf4-32f70cbfb1da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d425631eefe8472c89e24c6b4811a3d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:53:20Z,use_quota=True,user_id='4439e7f0e5554d9d87d2f5bcae5d85d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:53:20 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-2d800411-0438-43e3-8f8b-8383d41817ff tempest-VolumesSnapshotTestJSON-1082928251 None] Creating volume 6349eb93-b01e-404e-aaf4-32f70cbfb1da {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:53:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2d800411-0438-43e3-8f8b-8383d41817ff tempest-VolumesSnapshotTestJSON-1082928251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:53:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2d800411-0438-43e3-8f8b-8383d41817ff tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:53:20 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-2d800411-0438-43e3-8f8b-8383d41817ff tempest-VolumesSnapshotTestJSON-1082928251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:53:20 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-2d800411-0438-43e3-8f8b-8383d41817ff tempest-VolumesSnapshotTestJSON-1082928251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:53:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2d800411-0438-43e3-8f8b-8383d41817ff tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:53:20 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-2d800411-0438-43e3-8f8b-8383d41817ff tempest-VolumesSnapshotTestJSON-1082928251 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:53:20 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-2d800411-0438-43e3-8f8b-8383d41817ff tempest-VolumesSnapshotTestJSON-1082928251 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:53:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2d800411-0438-43e3-8f8b-8383d41817ff tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:53:20 devstack sudo[101757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da 1073741824
Jul 10 12:53:20 devstack sudo[101757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:53:20 devstack sudo[101757]: pam_unix(sudo:session): session closed for user root
Jul 10 12:53:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2d800411-0438-43e3-8f8b-8383d41817ff tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da 1073741824" returned: 0 in 0.911s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:53:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2d800411-0438-43e3-8f8b-8383d41817ff tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:53:21 devstack sudo[101764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da
Jul 10 12:53:21 devstack sudo[101764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:53:21 devstack sudo[101764]: pam_unix(sudo:session): session closed for user root
Jul 10 12:53:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2d800411-0438-43e3-8f8b-8383d41817ff tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da" returned: 0 in 0.675s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:53:21 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-2d800411-0438-43e3-8f8b-8383d41817ff tempest-VolumesSnapshotTestJSON-1082928251 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:53:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2d800411-0438-43e3-8f8b-8383d41817ff tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:53:21 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2d800411-0438-43e3-8f8b-8383d41817ff tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31ab96fd-62f5-4f57-afa7-bbf14f5ef9c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:53:21 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2d800411-0438-43e3-8f8b-8383d41817ff tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ee8f17e-1b57-44fe-95a7-540b46244a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:53:21 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-2d800411-0438-43e3-8f8b-8383d41817ff tempest-VolumesSnapshotTestJSON-1082928251 None] Volume volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da (6349eb93-b01e-404e-aaf4-32f70cbfb1da): created successfully
Jul 10 12:53:21 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2d800411-0438-43e3-8f8b-8383d41817ff tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ee8f17e-1b57-44fe-95a7-540b46244a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:53:21 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2d800411-0438-43e3-8f8b-8383d41817ff tempest-VolumesSnapshotTestJSON-1082928251 None] Flow 'volume_create_manager' (ce71b6e8-ef72-4a04-a80d-5110769c28d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:53:21 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-2d800411-0438-43e3-8f8b-8383d41817ff tempest-VolumesSnapshotTestJSON-1082928251 None] Created volume successfully.
Jul 10 12:53:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-7ae61f41-a7d5-4cfe-9181-1409a47d292e tempest-VolumesSnapshotTestJSON-1082928251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:53:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-7ae61f41-a7d5-4cfe-9181-1409a47d292e tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:53:22 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-7ae61f41-a7d5-4cfe-9181-1409a47d292e tempest-VolumesSnapshotTestJSON-1082928251 None] Creating offline snapshot 33f02381-2cdf-40d2-84e0-7782e8ff649f of volume 6349eb93-b01e-404e-aaf4-32f70cbfb1da {{(pid=87378) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 10 12:53:22 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[16762729-f869-4981-8855-2721be044690]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:53:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7ae61f41-a7d5-4cfe-9181-1409a47d292e tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:53:22 devstack sudo[101767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da
Jul 10 12:53:22 devstack sudo[101767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:53:23 devstack sudo[101767]: pam_unix(sudo:session): session closed for user root
Jul 10 12:53:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7ae61f41-a7d5-4cfe-9181-1409a47d292e tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da" returned: 0 in 0.865s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:53:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7ae61f41-a7d5-4cfe-9181-1409a47d292e tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da.33f02381-2cdf-40d2-84e0-7782e8ff649f 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:53:23 devstack sudo[101779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da.33f02381-2cdf-40d2-84e0-7782e8ff649f 1G
Jul 10 12:53:23 devstack sudo[101779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:53:24 devstack sudo[101779]: pam_unix(sudo:session): session closed for user root
Jul 10 12:53:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7ae61f41-a7d5-4cfe-9181-1409a47d292e tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da.33f02381-2cdf-40d2-84e0-7782e8ff649f 1G" returned: 0 in 0.922s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:53:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7ae61f41-a7d5-4cfe-9181-1409a47d292e tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da.33f02381-2cdf-40d2-84e0-7782e8ff649f {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:53:24 devstack sudo[101785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da.33f02381-2cdf-40d2-84e0-7782e8ff649f
Jul 10 12:53:24 devstack sudo[101785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:53:25 devstack sudo[101785]: pam_unix(sudo:session): session closed for user root
Jul 10 12:53:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7ae61f41-a7d5-4cfe-9181-1409a47d292e tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da.33f02381-2cdf-40d2-84e0-7782e8ff649f" returned: 0 in 0.866s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:53:25 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-7ae61f41-a7d5-4cfe-9181-1409a47d292e tempest-VolumesSnapshotTestJSON-1082928251 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da.33f02381-2cdf-40d2-84e0-7782e8ff649f is being set with open permissions: ugo+rw
Jul 10 12:53:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7ae61f41-a7d5-4cfe-9181-1409a47d292e tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da.33f02381-2cdf-40d2-84e0-7782e8ff649f {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:53:25 devstack sudo[101826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da.33f02381-2cdf-40d2-84e0-7782e8ff649f
Jul 10 12:53:25 devstack sudo[101826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:53:25 devstack sudo[101826]: pam_unix(sudo:session): session closed for user root
Jul 10 12:53:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7ae61f41-a7d5-4cfe-9181-1409a47d292e tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da.33f02381-2cdf-40d2-84e0-7782e8ff649f" returned: 0 in 0.689s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:53:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7ae61f41-a7d5-4cfe-9181-1409a47d292e tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:53:25 devstack sudo[101829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da.info
Jul 10 12:53:25 devstack sudo[101829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:53:26 devstack sudo[101829]: pam_unix(sudo:session): session closed for user root
Jul 10 12:53:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7ae61f41-a7d5-4cfe-9181-1409a47d292e tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da.info" returned: 0 in 0.706s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:53:26 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-7ae61f41-a7d5-4cfe-9181-1409a47d292e tempest-VolumesSnapshotTestJSON-1082928251 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da.info is being set with open permissions: ugo+rw
Jul 10 12:53:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7ae61f41-a7d5-4cfe-9181-1409a47d292e tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:53:26 devstack sudo[101832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da.info
Jul 10 12:53:26 devstack sudo[101832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:53:27 devstack sudo[101832]: pam_unix(sudo:session): session closed for user root
Jul 10 12:53:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7ae61f41-a7d5-4cfe-9181-1409a47d292e tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da.info" returned: 0 in 0.707s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:53:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-7ae61f41-a7d5-4cfe-9181-1409a47d292e tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.872s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:53:27 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-7ae61f41-a7d5-4cfe-9181-1409a47d292e tempest-VolumesSnapshotTestJSON-1082928251 None] Create snapshot completed successfully
Jul 10 12:53:28 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:53:28 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] Flow 'volume_create_manager' (ade796f6-c211-49a3-9e85-b562c6a15292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:53:28 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3df0b5b-49ac-4a8a-9611-53501999dfe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:53:28 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3df0b5b-49ac-4a8a-9611-53501999dfe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-649332921',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6db8a1dc-b42e-4806-87c6-67e079d66077,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d425631eefe8472c89e24c6b4811a3d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=33f02381-2cdf-40d2-84e0-7782e8ff649f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:53:28Z,use_quota=True,user_id='4439e7f0e5554d9d87d2f5bcae5d85d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:53:28 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d50be1f-eee4-4968-ae5e-2fa9465a444b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:53:28 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d50be1f-eee4-4968-ae5e-2fa9465a444b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:53:28 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5f1a2ad-00a6-4d9f-bbfc-b2d380707c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:53:28 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5f1a2ad-00a6-4d9f-bbfc-b2d380707c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6db8a1dc-b42e-4806-87c6-67e079d66077', 'volume_name': 'volume-6db8a1dc-b42e-4806-87c6-67e079d66077', 'volume_size': 1, 'snapshot_id': '33f02381-2cdf-40d2-84e0-7782e8ff649f'}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:53:28 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b773f103-fef1-4081-8d6a-cfb8aa6444f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:53:28 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b773f103-fef1-4081-8d6a-cfb8aa6444f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:53:28 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ecdcf88-ec0f-48cd-b6e8-ae5a370c44b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:53:28 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] Volume 6db8a1dc-b42e-4806-87c6-67e079d66077: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6db8a1dc-b42e-4806-87c6-67e079d66077', 'volume_size': 1, 'snapshot_id': '33f02381-2cdf-40d2-84e0-7782e8ff649f'}
Jul 10 12:53:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:53:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:53:28 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] Acquiring lock "cinder-quobyte-33f02381-2cdf-40d2-84e0-7782e8ff649f-6db8a1dc-b42e-4806-87c6-67e079d66077" by "_create_volume_from_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:53:28 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "cinder-quobyte-33f02381-2cdf-40d2-84e0-7782e8ff649f-6db8a1dc-b42e-4806-87c6-67e079d66077" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:53:28 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] Creating volume 6db8a1dc-b42e-4806-87c6-67e079d66077 from snapshot 33f02381-2cdf-40d2-84e0-7782e8ff649f {{(pid=87378) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 10 12:53:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:53:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:53:28 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:53:28 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:53:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:53:28 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:53:28 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] Acquiring lock "cinder-quobyte-6db8a1dc-b42e-4806-87c6-67e079d66077" by "_copy_volume_from_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:53:28 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "cinder-quobyte-6db8a1dc-b42e-4806-87c6-67e079d66077" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:53:28 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] snapshot: 33f02381-2cdf-40d2-84e0-7782e8ff649f, volume: 6db8a1dc-b42e-4806-87c6-67e079d66077,  {{(pid=87378) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 10 12:53:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:53:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:53:28 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:53:28 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:53:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:53:28 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d989b551-6471-4d4e-a1b7-c0c0ecd12f6c]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:53:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da.33f02381-2cdf-40d2-84e0-7782e8ff649f {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:53:28 devstack sudo[101838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da.33f02381-2cdf-40d2-84e0-7782e8ff649f
Jul 10 12:53:28 devstack sudo[101838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:53:29 devstack sudo[101838]: pam_unix(sudo:session): session closed for user root
Jul 10 12:53:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da.33f02381-2cdf-40d2-84e0-7782e8ff649f" returned: 0 in 0.803s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:53:29 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:53:29 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] will copy from snapshot at /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da {{(pid=87378) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 10 12:53:29 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] Creating direct copy from snapshot {{(pid=87378) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 10 12:53:29 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f08f1e-8aff-456d-ab02-6ea2160d4141]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:53:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:53:29 devstack sudo[101843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da
Jul 10 12:53:29 devstack sudo[101843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:53:29 devstack sudo[101843]: pam_unix(sudo:session): session closed for user root
Jul 10 12:53:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da" returned: 0 in 0.793s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:53:29 devstack cinder-volume[87378]: DEBUG cinder.utils [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] Path /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6db8a1dc-b42e-4806-87c6-67e079d66077 not found in is_blk_device check {{(pid=87378) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 10 12:53:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6db8a1dc-b42e-4806-87c6-67e079d66077 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:53:29 devstack sudo[101849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6db8a1dc-b42e-4806-87c6-67e079d66077
Jul 10 12:53:29 devstack sudo[101849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:53:34 devstack sudo[101849]: pam_unix(sudo:session): session closed for user root
Jul 10 12:53:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6db8a1dc-b42e-4806-87c6-67e079d66077" returned: 0 in 4.955s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:53:34 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6e6588-6c1b-4e4f-a487-9ebd76e428be]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:53:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:53:34 devstack sudo[101872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da
Jul 10 12:53:34 devstack sudo[101872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:53:35 devstack sudo[101872]: pam_unix(sudo:session): session closed for user root
Jul 10 12:53:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da" returned: 0 in 0.926s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:53:35 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] Image conversion details: src /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da, size 1024.00 MB, duration 4.96 sec, destination /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6db8a1dc-b42e-4806-87c6-67e079d66077 {{(pid=87378) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 10 12:53:35 devstack cinder-volume[87378]: INFO cinder.image.image_utils [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] Converted 1024.00 MB image at 206.62 MB/s
Jul 10 12:53:35 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6db8a1dc-b42e-4806-87c6-67e079d66077 is being set with open permissions: ugo+rw
Jul 10 12:53:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6db8a1dc-b42e-4806-87c6-67e079d66077 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:53:35 devstack sudo[101880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6db8a1dc-b42e-4806-87c6-67e079d66077
Jul 10 12:53:35 devstack sudo[101880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:53:36 devstack sudo[101880]: pam_unix(sudo:session): session closed for user root
Jul 10 12:53:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6db8a1dc-b42e-4806-87c6-67e079d66077" returned: 0 in 0.663s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:53:36 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "cinder-quobyte-6db8a1dc-b42e-4806-87c6-67e079d66077" released by "_copy_volume_from_snapshot" :: held 8.246s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:53:36 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "cinder-quobyte-33f02381-2cdf-40d2-84e0-7782e8ff649f-6db8a1dc-b42e-4806-87c6-67e079d66077" released by "_create_volume_from_snapshot" :: held 8.274s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:53:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.291s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:53:36 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:SELECT=58,cinder:UPDATE=46,cinder:DELETE=5,cinder:INSERT=9 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:53:36 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:SELECT=54,cinder:INSERT=14,cinder:UPDATE=51,cinder:DELETE=5 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:53:36 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ecdcf88-ec0f-48cd-b6e8-ae5a370c44b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6db8a1dc-b42e-4806-87c6-67e079d66077', 'volume_size': 1, 'snapshot_id': '33f02381-2cdf-40d2-84e0-7782e8ff649f'}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:53:36 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67e753bc-91d1-4c47-b96f-9b83b50e56f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:53:36 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] Volume volume-6db8a1dc-b42e-4806-87c6-67e079d66077 (6db8a1dc-b42e-4806-87c6-67e079d66077): created successfully
Jul 10 12:53:36 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67e753bc-91d1-4c47-b96f-9b83b50e56f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:53:36 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] Flow 'volume_create_manager' (ade796f6-c211-49a3-9e85-b562c6a15292) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:53:36 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-ca75dcfa-f5fb-42d2-88ee-9d8f67346abb tempest-VolumesSnapshotTestJSON-1082928251 None] Created volume successfully.
Jul 10 12:53:36 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-d75be70e-39ad-418e-b6e4-63b31bd255b5 tempest-VolumesSnapshotTestJSON-1082928251 None] Acquiring lock "cinder-6db8a1dc-b42e-4806-87c6-67e079d66077-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:53:36 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-d75be70e-39ad-418e-b6e4-63b31bd255b5 tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "cinder-6db8a1dc-b42e-4806-87c6-67e079d66077-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:53:36 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-d75be70e-39ad-418e-b6e4-63b31bd255b5 tempest-VolumesSnapshotTestJSON-1082928251 None] Acquiring lock "cinder-quobyte-6db8a1dc-b42e-4806-87c6-67e079d66077" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:53:37 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-d75be70e-39ad-418e-b6e4-63b31bd255b5 tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "cinder-quobyte-6db8a1dc-b42e-4806-87c6-67e079d66077" acquired by "delete_volume" :: waited 0.017s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:53:37 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9939e5-e3f9-4492-827d-57761e27eefd]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:53:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d75be70e-39ad-418e-b6e4-63b31bd255b5 tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6db8a1dc-b42e-4806-87c6-67e079d66077 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:53:37 devstack sudo[101907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6db8a1dc-b42e-4806-87c6-67e079d66077
Jul 10 12:53:37 devstack sudo[101907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:53:37 devstack sudo[101907]: pam_unix(sudo:session): session closed for user root
Jul 10 12:53:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d75be70e-39ad-418e-b6e4-63b31bd255b5 tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6db8a1dc-b42e-4806-87c6-67e079d66077" returned: 0 in 0.765s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:53:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d75be70e-39ad-418e-b6e4-63b31bd255b5 tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6db8a1dc-b42e-4806-87c6-67e079d66077 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:53:37 devstack sudo[101912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6db8a1dc-b42e-4806-87c6-67e079d66077
Jul 10 12:53:37 devstack sudo[101912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:53:38 devstack sudo[101912]: pam_unix(sudo:session): session closed for user root
Jul 10 12:53:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d75be70e-39ad-418e-b6e4-63b31bd255b5 tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6db8a1dc-b42e-4806-87c6-67e079d66077" returned: 0 in 0.641s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:53:38 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-d75be70e-39ad-418e-b6e4-63b31bd255b5 tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "cinder-quobyte-6db8a1dc-b42e-4806-87c6-67e079d66077" released by "delete_volume" :: held 1.455s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:53:38 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-d75be70e-39ad-418e-b6e4-63b31bd255b5 tempest-VolumesSnapshotTestJSON-1082928251 None] Created reservations ['077568f4-8e31-4f34-befd-e279649b0eb3', '1e186a9e-ea5b-41be-91a8-21fb099c862a', '523f8791-36d6-4919-87e9-90d66f5ab05d', '53fbca4b-c38a-47f2-902d-5cd4a4708f5c'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:53:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d75be70e-39ad-418e-b6e4-63b31bd255b5 tempest-VolumesSnapshotTestJSON-1082928251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:53:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d75be70e-39ad-418e-b6e4-63b31bd255b5 tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:53:38 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-d75be70e-39ad-418e-b6e4-63b31bd255b5 tempest-VolumesSnapshotTestJSON-1082928251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:53:38 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-d75be70e-39ad-418e-b6e4-63b31bd255b5 tempest-VolumesSnapshotTestJSON-1082928251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:53:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d75be70e-39ad-418e-b6e4-63b31bd255b5 tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:53:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d75be70e-39ad-418e-b6e4-63b31bd255b5 tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:53:38 devstack sudo[101922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:53:38 devstack sudo[101922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:53:39 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9403725d-c9ac-4353-ae25-532f63fd19de tempest-VolumesSnapshotTestJSON-1082928251 None] Acquiring lock "cinder-33f02381-2cdf-40d2-84e0-7782e8ff649f-delete_snapshot" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:53:39 devstack sudo[101922]: pam_unix(sudo:session): session closed for user root
Jul 10 12:53:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d75be70e-39ad-418e-b6e4-63b31bd255b5 tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.636s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:53:39 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-d75be70e-39ad-418e-b6e4-63b31bd255b5 tempest-VolumesSnapshotTestJSON-1082928251 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:53:39 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9403725d-c9ac-4353-ae25-532f63fd19de tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "cinder-33f02381-2cdf-40d2-84e0-7782e8ff649f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:53:39 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9403725d-c9ac-4353-ae25-532f63fd19de tempest-VolumesSnapshotTestJSON-1082928251 None] Acquiring lock "cinder-quobyte-6349eb93-b01e-404e-aaf4-32f70cbfb1da" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:53:39 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-d75be70e-39ad-418e-b6e4-63b31bd255b5 tempest-VolumesSnapshotTestJSON-1082928251 None] Deleted volume successfully.
Jul 10 12:53:39 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9403725d-c9ac-4353-ae25-532f63fd19de tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "cinder-quobyte-6349eb93-b01e-404e-aaf4-32f70cbfb1da" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:53:39 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9403725d-c9ac-4353-ae25-532f63fd19de tempest-VolumesSnapshotTestJSON-1082928251 None] Acquiring lock "cinder-quobyte-33f02381-2cdf-40d2-84e0-7782e8ff649f" by "_delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:53:39 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-d75be70e-39ad-418e-b6e4-63b31bd255b5 tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "cinder-6db8a1dc-b42e-4806-87c6-67e079d66077-delete_volume" released by "delete_volume" :: held 2.312s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:53:39 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9403725d-c9ac-4353-ae25-532f63fd19de tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "cinder-quobyte-33f02381-2cdf-40d2-84e0-7782e8ff649f" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:53:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-9403725d-c9ac-4353-ae25-532f63fd19de tempest-VolumesSnapshotTestJSON-1082928251 None] Deleting offline snapshot 33f02381-2cdf-40d2-84e0-7782e8ff649f of volume 6349eb93-b01e-404e-aaf4-32f70cbfb1da {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 10 12:53:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-9403725d-c9ac-4353-ae25-532f63fd19de tempest-VolumesSnapshotTestJSON-1082928251 None] snapshot_file for this snap is: volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da.33f02381-2cdf-40d2-84e0-7782e8ff649f {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 10 12:53:39 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b971ad-b349-4a8f-81de-5e0bcaf78cfb]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:53:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9403725d-c9ac-4353-ae25-532f63fd19de tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da.33f02381-2cdf-40d2-84e0-7782e8ff649f {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:53:39 devstack sudo[101926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da.33f02381-2cdf-40d2-84e0-7782e8ff649f
Jul 10 12:53:39 devstack sudo[101926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:53:40 devstack sudo[101926]: pam_unix(sudo:session): session closed for user root
Jul 10 12:53:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9403725d-c9ac-4353-ae25-532f63fd19de tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da.33f02381-2cdf-40d2-84e0-7782e8ff649f" returned: 0 in 0.756s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:53:40 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-9403725d-c9ac-4353-ae25-532f63fd19de tempest-VolumesSnapshotTestJSON-1082928251 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:53:40 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[634fd9df-0184-49ae-9515-c8a3ceef6dd2]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:53:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9403725d-c9ac-4353-ae25-532f63fd19de tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:53:40 devstack sudo[101952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da
Jul 10 12:53:40 devstack sudo[101952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:53:40 devstack sudo[101952]: pam_unix(sudo:session): session closed for user root
Jul 10 12:53:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9403725d-c9ac-4353-ae25-532f63fd19de tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da" returned: 0 in 0.766s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:53:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9403725d-c9ac-4353-ae25-532f63fd19de tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da.33f02381-2cdf-40d2-84e0-7782e8ff649f {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:53:40 devstack sudo[101959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da.33f02381-2cdf-40d2-84e0-7782e8ff649f
Jul 10 12:53:40 devstack sudo[101959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:53:41 devstack sudo[101959]: pam_unix(sudo:session): session closed for user root
Jul 10 12:53:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9403725d-c9ac-4353-ae25-532f63fd19de tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da.33f02381-2cdf-40d2-84e0-7782e8ff649f" returned: 0 in 0.801s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:53:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9403725d-c9ac-4353-ae25-532f63fd19de tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da.33f02381-2cdf-40d2-84e0-7782e8ff649f {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:53:41 devstack sudo[101964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da.33f02381-2cdf-40d2-84e0-7782e8ff649f
Jul 10 12:53:41 devstack sudo[101964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:53:42 devstack sudo[101964]: pam_unix(sudo:session): session closed for user root
Jul 10 12:53:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9403725d-c9ac-4353-ae25-532f63fd19de tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da.33f02381-2cdf-40d2-84e0-7782e8ff649f" returned: 0 in 0.682s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:53:42 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9403725d-c9ac-4353-ae25-532f63fd19de tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "cinder-quobyte-33f02381-2cdf-40d2-84e0-7782e8ff649f" released by "_delete_snapshot" :: held 3.116s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:53:42 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9403725d-c9ac-4353-ae25-532f63fd19de tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "cinder-quobyte-6349eb93-b01e-404e-aaf4-32f70cbfb1da" released by "delete_snapshot" :: held 3.149s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:53:42 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-9403725d-c9ac-4353-ae25-532f63fd19de tempest-VolumesSnapshotTestJSON-1082928251 None] Created reservations ['c164096b-6e28-4e17-94ab-e03e5f3a2558', '3eed4010-0f8e-472e-aec6-973ec64d197f', '9aac4385-9a1a-4cc1-a7bd-fadad33f4f6c', '7c66b1ab-b339-4e76-ba8f-c93e0e37c731'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:53:42 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-9403725d-c9ac-4353-ae25-532f63fd19de tempest-VolumesSnapshotTestJSON-1082928251 None] Delete snapshot completed successfully.
Jul 10 12:53:42 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9403725d-c9ac-4353-ae25-532f63fd19de tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "cinder-33f02381-2cdf-40d2-84e0-7782e8ff649f-delete_snapshot" released by "delete_snapshot" :: held 3.298s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:53:43 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-35f28879-19d4-4c50-8e32-dba9ef7b61e9 tempest-VolumesSnapshotTestJSON-1082928251 None] Acquiring lock "cinder-6349eb93-b01e-404e-aaf4-32f70cbfb1da-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:53:43 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-35f28879-19d4-4c50-8e32-dba9ef7b61e9 tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "cinder-6349eb93-b01e-404e-aaf4-32f70cbfb1da-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:53:43 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-35f28879-19d4-4c50-8e32-dba9ef7b61e9 tempest-VolumesSnapshotTestJSON-1082928251 None] Acquiring lock "cinder-quobyte-6349eb93-b01e-404e-aaf4-32f70cbfb1da" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:53:43 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-35f28879-19d4-4c50-8e32-dba9ef7b61e9 tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "cinder-quobyte-6349eb93-b01e-404e-aaf4-32f70cbfb1da" acquired by "delete_volume" :: waited 0.019s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:53:43 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49677a7-55ff-455a-babd-2d725e21faa1]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:53:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-35f28879-19d4-4c50-8e32-dba9ef7b61e9 tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:53:43 devstack sudo[101968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da
Jul 10 12:53:43 devstack sudo[101968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:53:44 devstack sudo[101968]: pam_unix(sudo:session): session closed for user root
Jul 10 12:53:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-35f28879-19d4-4c50-8e32-dba9ef7b61e9 tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da" returned: 0 in 0.787s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:53:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-35f28879-19d4-4c50-8e32-dba9ef7b61e9 tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:53:44 devstack sudo[101973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da
Jul 10 12:53:44 devstack sudo[101973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:53:45 devstack sudo[101973]: pam_unix(sudo:session): session closed for user root
Jul 10 12:53:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-35f28879-19d4-4c50-8e32-dba9ef7b61e9 tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-6349eb93-b01e-404e-aaf4-32f70cbfb1da" returned: 0 in 0.666s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:53:45 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-35f28879-19d4-4c50-8e32-dba9ef7b61e9 tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "cinder-quobyte-6349eb93-b01e-404e-aaf4-32f70cbfb1da" released by "delete_volume" :: held 1.531s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:53:45 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-35f28879-19d4-4c50-8e32-dba9ef7b61e9 tempest-VolumesSnapshotTestJSON-1082928251 None] Created reservations ['9afb12e9-8c1d-44ab-af45-be4d7d34053c', '5eebdaea-753e-4c42-b6a0-2c261ed058ba', 'cc01b8a6-82ba-4ea7-b92f-eb01409ff6f7', 'ccd6977b-d3f9-46cb-95f5-7b10ac95e9ba'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:53:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-35f28879-19d4-4c50-8e32-dba9ef7b61e9 tempest-VolumesSnapshotTestJSON-1082928251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:53:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-35f28879-19d4-4c50-8e32-dba9ef7b61e9 tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:53:45 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-35f28879-19d4-4c50-8e32-dba9ef7b61e9 tempest-VolumesSnapshotTestJSON-1082928251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:53:45 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-35f28879-19d4-4c50-8e32-dba9ef7b61e9 tempest-VolumesSnapshotTestJSON-1082928251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:53:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-35f28879-19d4-4c50-8e32-dba9ef7b61e9 tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:53:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-35f28879-19d4-4c50-8e32-dba9ef7b61e9 tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:53:45 devstack sudo[101976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:53:45 devstack sudo[101976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:53:45 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e083740f-8393-4a07-a3fe-fd5903b67f4e tempest-VolumesSnapshotTestJSON-1082928251 None] Acquiring lock "cinder-f47df7e5-0f3e-4d2f-82cd-e78be9103184-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:53:45 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e083740f-8393-4a07-a3fe-fd5903b67f4e tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "cinder-f47df7e5-0f3e-4d2f-82cd-e78be9103184-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:53:45 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e083740f-8393-4a07-a3fe-fd5903b67f4e tempest-VolumesSnapshotTestJSON-1082928251 None] Acquiring lock "cinder-quobyte-f47df7e5-0f3e-4d2f-82cd-e78be9103184" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:53:45 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e083740f-8393-4a07-a3fe-fd5903b67f4e tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "cinder-quobyte-f47df7e5-0f3e-4d2f-82cd-e78be9103184" acquired by "delete_volume" :: waited 0.021s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:53:46 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e3600f-a1b9-4885-8bdb-a478a29e05e3]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:53:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e083740f-8393-4a07-a3fe-fd5903b67f4e tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:53:46 devstack sudo[101976]: pam_unix(sudo:session): session closed for user root
Jul 10 12:53:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-35f28879-19d4-4c50-8e32-dba9ef7b61e9 tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.746s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:53:46 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-35f28879-19d4-4c50-8e32-dba9ef7b61e9 tempest-VolumesSnapshotTestJSON-1082928251 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:53:46 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-35f28879-19d4-4c50-8e32-dba9ef7b61e9 tempest-VolumesSnapshotTestJSON-1082928251 None] Deleted volume successfully.
Jul 10 12:53:46 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-35f28879-19d4-4c50-8e32-dba9ef7b61e9 tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "cinder-6349eb93-b01e-404e-aaf4-32f70cbfb1da-delete_volume" released by "delete_volume" :: held 2.560s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:53:46 devstack sudo[101979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184
Jul 10 12:53:46 devstack sudo[101979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:53:46 devstack sudo[101979]: pam_unix(sudo:session): session closed for user root
Jul 10 12:53:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e083740f-8393-4a07-a3fe-fd5903b67f4e tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184" returned: 0 in 0.796s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:53:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e083740f-8393-4a07-a3fe-fd5903b67f4e tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:53:46 devstack sudo[101984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184
Jul 10 12:53:46 devstack sudo[101984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:53:47 devstack sudo[101984]: pam_unix(sudo:session): session closed for user root
Jul 10 12:53:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e083740f-8393-4a07-a3fe-fd5903b67f4e tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f47df7e5-0f3e-4d2f-82cd-e78be9103184" returned: 0 in 0.662s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:53:47 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e083740f-8393-4a07-a3fe-fd5903b67f4e tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "cinder-quobyte-f47df7e5-0f3e-4d2f-82cd-e78be9103184" released by "delete_volume" :: held 1.519s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:53:47 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-e083740f-8393-4a07-a3fe-fd5903b67f4e tempest-VolumesSnapshotTestJSON-1082928251 None] Created reservations ['738dea7d-99dd-4a5a-ba52-4d7622b8dd0d', '90542ae2-c1bb-4417-9d58-1602257f1622', '91bcaa71-5613-4c6c-ab38-79d0fde7d7f6', 'f5588168-de6b-4425-908a-e7274b7e6358'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:53:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e083740f-8393-4a07-a3fe-fd5903b67f4e tempest-VolumesSnapshotTestJSON-1082928251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:53:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e083740f-8393-4a07-a3fe-fd5903b67f4e tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:53:47 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-e083740f-8393-4a07-a3fe-fd5903b67f4e tempest-VolumesSnapshotTestJSON-1082928251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:53:47 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-e083740f-8393-4a07-a3fe-fd5903b67f4e tempest-VolumesSnapshotTestJSON-1082928251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:53:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e083740f-8393-4a07-a3fe-fd5903b67f4e tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:53:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e083740f-8393-4a07-a3fe-fd5903b67f4e tempest-VolumesSnapshotTestJSON-1082928251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:53:47 devstack sudo[101987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:53:47 devstack sudo[101987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:53:48 devstack sudo[101987]: pam_unix(sudo:session): session closed for user root
Jul 10 12:53:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e083740f-8393-4a07-a3fe-fd5903b67f4e tempest-VolumesSnapshotTestJSON-1082928251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.710s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:53:48 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-e083740f-8393-4a07-a3fe-fd5903b67f4e tempest-VolumesSnapshotTestJSON-1082928251 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:53:48 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-e083740f-8393-4a07-a3fe-fd5903b67f4e tempest-VolumesSnapshotTestJSON-1082928251 None] Deleted volume successfully.
Jul 10 12:53:48 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e083740f-8393-4a07-a3fe-fd5903b67f4e tempest-VolumesSnapshotTestJSON-1082928251 None] Lock "cinder-f47df7e5-0f3e-4d2f-82cd-e78be9103184-delete_volume" released by "delete_volume" :: held 2.463s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:53:57 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:UPDATE=32,cinder:SELECT=21,cinder:INSERT=10 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:53:58 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:DELETE=4,cinder:UPDATE=29,cinder:SELECT=20,cinder:INSERT=6 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:54:06 devstack cinder-volume[87378]: INFO cinder.volume.manager [req-ab836523-d663-4536-9767-9fe4cf569d52 req-f4be8a0e-b7dc-4d6d-93b6-4c13172f4d92 tempest-TestMinimumBasicScenario-2115265487 None] Terminate volume connection completed successfully.
Jul 10 12:54:06 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-ab836523-d663-4536-9767-9fe4cf569d52 req-f4be8a0e-b7dc-4d6d-93b6-4c13172f4d92 tempest-TestMinimumBasicScenario-2115265487 None] Deleting attachment c1a54c76-a7d3-4942-93ac-6f9ddc574314. {{(pid=87378) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 10 12:54:08 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-93a8cab9-0cd8-4ddd-88fa-5089e742fd90 tempest-TestMinimumBasicScenario-2115265487 None] Acquiring lock "cinder-597918c0-f3a5-4c6d-8377-cf0a9a95c500-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:54:08 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-93a8cab9-0cd8-4ddd-88fa-5089e742fd90 tempest-TestMinimumBasicScenario-2115265487 None] Lock "cinder-597918c0-f3a5-4c6d-8377-cf0a9a95c500-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:54:08 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-93a8cab9-0cd8-4ddd-88fa-5089e742fd90 tempest-TestMinimumBasicScenario-2115265487 None] Acquiring lock "cinder-quobyte-597918c0-f3a5-4c6d-8377-cf0a9a95c500" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:54:08 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-93a8cab9-0cd8-4ddd-88fa-5089e742fd90 tempest-TestMinimumBasicScenario-2115265487 None] Lock "cinder-quobyte-597918c0-f3a5-4c6d-8377-cf0a9a95c500" acquired by "delete_volume" :: waited 0.016s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:54:08 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20b411f-4c78-423f-b6b6-0382ed26cdc7]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:54:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-93a8cab9-0cd8-4ddd-88fa-5089e742fd90 tempest-TestMinimumBasicScenario-2115265487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-597918c0-f3a5-4c6d-8377-cf0a9a95c500 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:54:08 devstack sudo[102011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-597918c0-f3a5-4c6d-8377-cf0a9a95c500
Jul 10 12:54:08 devstack sudo[102011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:54:09 devstack sudo[102011]: pam_unix(sudo:session): session closed for user root
Jul 10 12:54:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-93a8cab9-0cd8-4ddd-88fa-5089e742fd90 tempest-TestMinimumBasicScenario-2115265487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-597918c0-f3a5-4c6d-8377-cf0a9a95c500" returned: 0 in 0.878s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:54:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-93a8cab9-0cd8-4ddd-88fa-5089e742fd90 tempest-TestMinimumBasicScenario-2115265487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-597918c0-f3a5-4c6d-8377-cf0a9a95c500 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:54:09 devstack sudo[102017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-597918c0-f3a5-4c6d-8377-cf0a9a95c500
Jul 10 12:54:09 devstack sudo[102017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:54:09 devstack sudo[102017]: pam_unix(sudo:session): session closed for user root
Jul 10 12:54:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-93a8cab9-0cd8-4ddd-88fa-5089e742fd90 tempest-TestMinimumBasicScenario-2115265487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-597918c0-f3a5-4c6d-8377-cf0a9a95c500" returned: 0 in 0.669s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:54:09 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-93a8cab9-0cd8-4ddd-88fa-5089e742fd90 tempest-TestMinimumBasicScenario-2115265487 None] Lock "cinder-quobyte-597918c0-f3a5-4c6d-8377-cf0a9a95c500" released by "delete_volume" :: held 1.601s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:54:10 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-93a8cab9-0cd8-4ddd-88fa-5089e742fd90 tempest-TestMinimumBasicScenario-2115265487 None] Created reservations ['b500c4b3-1723-42a9-8e5e-0f66563c1594', '36b6bb0f-f3b9-4521-b0d3-585bfe28b15c', '53b28223-bcc9-4831-8fc3-f2f21fe34a67', '93d37d3e-e5ee-4c4f-a14b-a5b62cec39bd'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:54:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-93a8cab9-0cd8-4ddd-88fa-5089e742fd90 tempest-TestMinimumBasicScenario-2115265487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:54:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-93a8cab9-0cd8-4ddd-88fa-5089e742fd90 tempest-TestMinimumBasicScenario-2115265487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:54:10 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-93a8cab9-0cd8-4ddd-88fa-5089e742fd90 tempest-TestMinimumBasicScenario-2115265487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:54:10 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-93a8cab9-0cd8-4ddd-88fa-5089e742fd90 tempest-TestMinimumBasicScenario-2115265487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:54:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-93a8cab9-0cd8-4ddd-88fa-5089e742fd90 tempest-TestMinimumBasicScenario-2115265487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:54:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-93a8cab9-0cd8-4ddd-88fa-5089e742fd90 tempest-TestMinimumBasicScenario-2115265487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:54:10 devstack sudo[102020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:54:10 devstack sudo[102020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:54:10 devstack sudo[102020]: pam_unix(sudo:session): session closed for user root
Jul 10 12:54:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-93a8cab9-0cd8-4ddd-88fa-5089e742fd90 tempest-TestMinimumBasicScenario-2115265487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.666s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:54:10 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-93a8cab9-0cd8-4ddd-88fa-5089e742fd90 tempest-TestMinimumBasicScenario-2115265487 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:54:10 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-93a8cab9-0cd8-4ddd-88fa-5089e742fd90 tempest-TestMinimumBasicScenario-2115265487 None] Deleted volume successfully.
Jul 10 12:54:10 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-93a8cab9-0cd8-4ddd-88fa-5089e742fd90 tempest-TestMinimumBasicScenario-2115265487 None] Lock "cinder-597918c0-f3a5-4c6d-8377-cf0a9a95c500-delete_volume" released by "delete_volume" :: held 2.590s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:54:12 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:54:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:54:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:54:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:54:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:54:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:54:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:54:13 devstack sudo[102046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:54:13 devstack sudo[102046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:54:13 devstack sudo[102046]: pam_unix(sudo:session): session closed for user root
Jul 10 12:54:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.808s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:54:13 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:54:13 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager._thread_info {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:54:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread count: 28 {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 10 12:54:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread info: [<_MainThread(MainThread, started 128233544536192)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128233445424704)>, <Thread(Thread-3 (stat_writer), started daemon 128233435118528)>, <Thread(Rabbit-heartbeat, started daemon 128233435718016)>, <Thread(Thread-5 (_runner), started daemon 128233432624448)>, <Thread(Thread-7 (_runner), started daemon 128233432674688)>, <Thread(fd_logger, started daemon 128233428569472)>, <Thread(privsep_reader, started daemon 128233429417088)>, <Thread(tpool_thread_0, started daemon 128233421182656)>, <Thread(tpool_thread_1, started daemon 128233412789952)>, <Thread(tpool_thread_2, started daemon 128233404397248)>, <Thread(tpool_thread_3, started daemon 128233396004544)>, <Thread(tpool_thread_4, started daemon 128233387611840)>, <Thread(tpool_thread_5, started daemon 128233379219136)>, <Thread(tpool_thread_6, started daemon 128233370826432)>, <Thread(tpool_thread_7, started daemon 128233362433728)>, <Thread(tpool_thread_8, started daemon 128233354041024)>, <Thread(tpool_thread_9, started daemon 128233345631936)>, <Thread(tpool_thread_10, started daemon 128233337222848)>, <Thread(tpool_thread_11, started daemon 128233328813760)>, <Thread(tpool_thread_12, started daemon 128233320404672)>, <Thread(tpool_thread_13, started daemon 128233311995584)>, <Thread(tpool_thread_14, started daemon 128233303586496)>, <Thread(tpool_thread_15, started daemon 128233295177408)>, <Thread(tpool_thread_16, started daemon 128233286768320)>, <Thread(tpool_thread_17, started daemon 128233278359232)>, <Thread(tpool_thread_18, started daemon 128233269950144)>, <Thread(tpool_thread_19, started daemon 128233261541056)>] {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 10 12:54:15 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:54:15 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] Flow 'volume_create_manager' (62886489-a25d-485d-ac87-4933f53bc5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:54:15 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb92e685-57f8-4904-946c-bc1b35086d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:54:15 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb92e685-57f8-4904-946c-bc1b35086d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1916770441',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f7c55b0-13b1-486e-9b6c-ef4560d1e431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24036e81ee3549a2a8afac5a72ee58b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:54:15Z,use_quota=True,user_id='452887c247104947988e46b01145861e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:54:15 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91ac55a5-3d0d-44a4-a50b-95c5ed63415d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:54:15 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91ac55a5-3d0d-44a4-a50b-95c5ed63415d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:54:15 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b81a0eff-96bb-4601-b463-2f5e2463898b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:54:15 devstack cinder-volume[87378]: DEBUG cinder.image.glance [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] Creating Keystone auth plugin from conf {{(pid=87378) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 10 12:54:15 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b81a0eff-96bb-4601-b463-2f5e2463898b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2f7c55b0-13b1-486e-9b6c-ef4560d1e431', 'volume_name': 'volume-2f7c55b0-13b1-486e-9b6c-ef4560d1e431', 'volume_size': 1, 'image_id': 'c73e431b-92e2-4ca0-8142-903361296a8f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c73e431b-92e2-4ca0-8142-903361296a8f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ea129ca6c904ec8b3827a458726b692', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c73e431b-92e2-4ca0-8142-903361296a8f', 'created_at': datetime.datetime(2026, 7, 10, 10, 26, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 10, 26, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c73e431b-92e2-4ca0-8142-903361296a8f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74a0a16c86e0>}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:54:15 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d81d3f90-fcc1-4296-a907-3f43a951d2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:54:15 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d81d3f90-fcc1-4296-a907-3f43a951d2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:54:15 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dca706ad-c4e7-49c2-955d-600732318587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:54:15 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] Volume 2f7c55b0-13b1-486e-9b6c-ef4560d1e431: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2f7c55b0-13b1-486e-9b6c-ef4560d1e431', 'volume_size': 1, 'image_id': 'c73e431b-92e2-4ca0-8142-903361296a8f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c73e431b-92e2-4ca0-8142-903361296a8f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ea129ca6c904ec8b3827a458726b692', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c73e431b-92e2-4ca0-8142-903361296a8f', 'created_at': datetime.datetime(2026, 7, 10, 10, 26, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 10, 26, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c73e431b-92e2-4ca0-8142-903361296a8f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74a0a16c86e0>}
Jul 10 12:54:15 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] Trying to clone 2f7c55b0-13b1-486e-9b6c-ef4560d1e431 from image c73e431b-92e2-4ca0-8142-903361296a8f at location (None, [{'url': 'file:///opt/stack/data/glance/images/c73e431b-92e2-4ca0-8142-903361296a8f', 'metadata': {}}]). {{(pid=87378) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 10 12:54:16 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_e0oop0f3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87378) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 10 12:54:16 devstack cinder-volume[87378]: INFO cinder.image.image_utils [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] Image download 20.69 MB at 20.69 MB/s
Jul 10 12:54:16 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b9fef6-bb45-4de0-8fee-ae655c7ac029]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:54:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_e0oop0f3devstack@QuobyteHD {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:54:16 devstack sudo[102052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_e0oop0f3devstack@QuobyteHD
Jul 10 12:54:16 devstack sudo[102052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:54:17 devstack sudo[102052]: pam_unix(sudo:session): session closed for user root
Jul 10 12:54:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_e0oop0f3devstack@QuobyteHD" returned: 0 in 0.742s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:54:17 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] Temporary image c73e431b-92e2-4ca0-8142-903361296a8f is fetched for user 452887c247104947988e46b01145861e. {{(pid=87378) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 10 12:54:17 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c4d0ac-2722-43da-8cf2-db4a28b58458]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:54:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_e0oop0f3devstack@QuobyteHD {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:54:17 devstack sudo[102057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_e0oop0f3devstack@QuobyteHD
Jul 10 12:54:17 devstack sudo[102057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:54:17 devstack sudo[102057]: pam_unix(sudo:session): session closed for user root
Jul 10 12:54:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_e0oop0f3devstack@QuobyteHD" returned: 0 in 0.752s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:54:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:54:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:54:17 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1916770441',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f7c55b0-13b1-486e-9b6c-ef4560d1e431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24036e81ee3549a2a8afac5a72ee58b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:54:15Z,use_quota=True,user_id='452887c247104947988e46b01145861e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:54:17 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] Creating volume 2f7c55b0-13b1-486e-9b6c-ef4560d1e431 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:54:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:54:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:54:17 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:54:17 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:54:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:54:17 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:54:17 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:54:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2f7c55b0-13b1-486e-9b6c-ef4560d1e431 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:54:17 devstack sudo[102062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2f7c55b0-13b1-486e-9b6c-ef4560d1e431 1073741824
Jul 10 12:54:18 devstack sudo[102062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:54:18 devstack sudo[102062]: pam_unix(sudo:session): session closed for user root
Jul 10 12:54:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2f7c55b0-13b1-486e-9b6c-ef4560d1e431 1073741824" returned: 0 in 0.919s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:54:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2f7c55b0-13b1-486e-9b6c-ef4560d1e431 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:54:18 devstack sudo[102069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2f7c55b0-13b1-486e-9b6c-ef4560d1e431
Jul 10 12:54:18 devstack sudo[102069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:54:19 devstack sudo[102069]: pam_unix(sudo:session): session closed for user root
Jul 10 12:54:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2f7c55b0-13b1-486e-9b6c-ef4560d1e431" returned: 0 in 0.708s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:54:19 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] <== create_volume: return (1677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:54:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.682s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:54:19 devstack cinder-volume[87378]: DEBUG cinder.volume.volume_utils [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] Attempting download of c73e431b-92e2-4ca0-8142-903361296a8f ((None, [{'url': 'file:///opt/stack/data/glance/images/c73e431b-92e2-4ca0-8142-903361296a8f', 'metadata': {}}])) to volume 2f7c55b0-13b1-486e-9b6c-ef4560d1e431. {{(pid=87378) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 10 12:54:19 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[8041648d-8e72-4bc3-8bba-0e7b5157925f]: (4, 'raw') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:54:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c73e431b-92e2-4ca0-8142-903361296a8f_vpy7zu45 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:54:19 devstack sudo[102073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c73e431b-92e2-4ca0-8142-903361296a8f_vpy7zu45
Jul 10 12:54:19 devstack sudo[102073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:54:20 devstack sudo[102073]: pam_unix(sudo:session): session closed for user root
Jul 10 12:54:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c73e431b-92e2-4ca0-8142-903361296a8f_vpy7zu45" returned: 0 in 0.815s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:54:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c73e431b-92e2-4ca0-8142-903361296a8f_vpy7zu45 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:54:20 devstack sudo[102077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c73e431b-92e2-4ca0-8142-903361296a8f_vpy7zu45
Jul 10 12:54:20 devstack sudo[102077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:54:21 devstack sudo[102077]: pam_unix(sudo:session): session closed for user root
Jul 10 12:54:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c73e431b-92e2-4ca0-8142-903361296a8f_vpy7zu45" returned: 1 in 0.744s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:54:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c73e431b-92e2-4ca0-8142-903361296a8f_vpy7zu45' failed. Not Retrying. {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 10 12:54:21 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e67d9b-90ce-4f53-a896-94fbbf2a0c12]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:54:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_e0oop0f3devstack@QuobyteHD {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:54:21 devstack sudo[102082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_e0oop0f3devstack@QuobyteHD
Jul 10 12:54:21 devstack sudo[102082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:54:22 devstack sudo[102082]: pam_unix(sudo:session): session closed for user root
Jul 10 12:54:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_e0oop0f3devstack@QuobyteHD" returned: 0 in 0.747s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:54:22 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] c73e431b-92e2-4ca0-8142-903361296a8f was qcow2, converting to raw {{(pid=87378) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 10 12:54:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_e0oop0f3devstack@QuobyteHD /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2f7c55b0-13b1-486e-9b6c-ef4560d1e431 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:54:22 devstack sudo[102087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_e0oop0f3devstack@QuobyteHD /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2f7c55b0-13b1-486e-9b6c-ef4560d1e431
Jul 10 12:54:22 devstack sudo[102087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:54:24 devstack sudo[102087]: pam_unix(sudo:session): session closed for user root
Jul 10 12:54:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_e0oop0f3devstack@QuobyteHD /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2f7c55b0-13b1-486e-9b6c-ef4560d1e431" returned: 0 in 2.031s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:54:24 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c73e431b-92e2-4ca0-8142-903361296a8f_e0oop0f3devstack@QuobyteHD, size 112.00 MB, duration 2.03 sec, destination /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2f7c55b0-13b1-486e-9b6c-ef4560d1e431 {{(pid=87378) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 10 12:54:24 devstack cinder-volume[87378]: INFO cinder.image.image_utils [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] Converted 112.00 MB image at 55.09 MB/s
Jul 10 12:54:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2f7c55b0-13b1-486e-9b6c-ef4560d1e431 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:54:24 devstack sudo[102097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2f7c55b0-13b1-486e-9b6c-ef4560d1e431 1G
Jul 10 12:54:24 devstack sudo[102097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:54:24 devstack sudo[102097]: pam_unix(sudo:session): session closed for user root
Jul 10 12:54:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2f7c55b0-13b1-486e-9b6c-ef4560d1e431 1G" returned: 0 in 0.764s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:54:24 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[8134b306-47b1-4f18-b444-e0841dd44a1e]: (4, 'raw') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:54:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2f7c55b0-13b1-486e-9b6c-ef4560d1e431 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:54:24 devstack sudo[102103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2f7c55b0-13b1-486e-9b6c-ef4560d1e431
Jul 10 12:54:24 devstack sudo[102103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:54:25 devstack sudo[102103]: pam_unix(sudo:session): session closed for user root
Jul 10 12:54:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2f7c55b0-13b1-486e-9b6c-ef4560d1e431" returned: 0 in 0.860s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:54:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2f7c55b0-13b1-486e-9b6c-ef4560d1e431 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:54:25 devstack sudo[102143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2f7c55b0-13b1-486e-9b6c-ef4560d1e431
Jul 10 12:54:25 devstack sudo[102143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:54:26 devstack sudo[102143]: pam_unix(sudo:session): session closed for user root
Jul 10 12:54:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2f7c55b0-13b1-486e-9b6c-ef4560d1e431" returned: 1 in 0.818s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:54:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2f7c55b0-13b1-486e-9b6c-ef4560d1e431' failed. Not Retrying. {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 10 12:54:26 devstack cinder-volume[87378]: DEBUG cinder.volume.volume_utils [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] Downloaded image c73e431b-92e2-4ca0-8142-903361296a8f ((None, [{'url': 'file:///opt/stack/data/glance/images/c73e431b-92e2-4ca0-8142-903361296a8f', 'metadata': {}}])) to volume 2f7c55b0-13b1-486e-9b6c-ef4560d1e431 successfully. {{(pid=87378) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 10 12:54:26 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] Temporary image c73e431b-92e2-4ca0-8142-903361296a8f for user 452887c247104947988e46b01145861e is deleted. {{(pid=87378) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 10 12:54:26 devstack cinder-volume[87378]: DEBUG cinder.volume.volume_utils [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] Marking volume 2f7c55b0-13b1-486e-9b6c-ef4560d1e431 as bootable. {{(pid=87378) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 10 12:54:26 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] Copying metadata from image c73e431b-92e2-4ca0-8142-903361296a8f to 2f7c55b0-13b1-486e-9b6c-ef4560d1e431. {{(pid=87378) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 10 12:54:26 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] Creating volume glance metadata for volume 2f7c55b0-13b1-486e-9b6c-ef4560d1e431 backed by image c73e431b-92e2-4ca0-8142-903361296a8f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c73e431b-92e2-4ca0-8142-903361296a8f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87378) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 10 12:54:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dca706ad-c4e7-49c2-955d-600732318587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f7c55b0-13b1-486e-9b6c-ef4560d1e431', 'volume_size': 1, 'image_id': 'c73e431b-92e2-4ca0-8142-903361296a8f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c73e431b-92e2-4ca0-8142-903361296a8f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1ea129ca6c904ec8b3827a458726b692', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c73e431b-92e2-4ca0-8142-903361296a8f', 'created_at': datetime.datetime(2026, 7, 10, 10, 26, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 10, 26, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c73e431b-92e2-4ca0-8142-903361296a8f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74a0a16c86e0>}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:54:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb23b75d-76d3-49c3-af6d-cb06b2a66560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:54:26 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] Volume volume-2f7c55b0-13b1-486e-9b6c-ef4560d1e431 (2f7c55b0-13b1-486e-9b6c-ef4560d1e431): created successfully
Jul 10 12:54:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb23b75d-76d3-49c3-af6d-cb06b2a66560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:54:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] Flow 'volume_create_manager' (62886489-a25d-485d-ac87-4933f53bc5b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:54:26 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-9c3cc6d2-9536-4cc3-9b30-12ecc5dc8e9c tempest-TestShelveInstance-543572003 None] Created volume successfully.
Jul 10 12:54:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-2377463d-6a54-49f6-8e5c-571106eba3ee req-5dcdc45e-7b02-4fba-8442-cc6177235b45 tempest-TestShelveInstance-543572003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:54:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-2377463d-6a54-49f6-8e5c-571106eba3ee req-5dcdc45e-7b02-4fba-8442-cc6177235b45 tempest-TestShelveInstance-543572003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:54:34 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c117b43-be3b-461a-a06d-fea5360d1ed9]: (4, 'raw') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:54:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-2377463d-6a54-49f6-8e5c-571106eba3ee req-5dcdc45e-7b02-4fba-8442-cc6177235b45 tempest-TestShelveInstance-543572003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2f7c55b0-13b1-486e-9b6c-ef4560d1e431 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:54:35 devstack sudo[102162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2f7c55b0-13b1-486e-9b6c-ef4560d1e431
Jul 10 12:54:35 devstack sudo[102162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:54:35 devstack sudo[102162]: pam_unix(sudo:session): session closed for user root
Jul 10 12:54:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-2377463d-6a54-49f6-8e5c-571106eba3ee req-5dcdc45e-7b02-4fba-8442-cc6177235b45 tempest-TestShelveInstance-543572003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2f7c55b0-13b1-486e-9b6c-ef4560d1e431" returned: 0 in 1.070s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:54:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-2377463d-6a54-49f6-8e5c-571106eba3ee req-5dcdc45e-7b02-4fba-8442-cc6177235b45 tempest-TestShelveInstance-543572003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2f7c55b0-13b1-486e-9b6c-ef4560d1e431 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:54:35 devstack sudo[102172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2f7c55b0-13b1-486e-9b6c-ef4560d1e431
Jul 10 12:54:35 devstack sudo[102172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:54:36 devstack sudo[102172]: pam_unix(sudo:session): session closed for user root
Jul 10 12:54:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-2377463d-6a54-49f6-8e5c-571106eba3ee req-5dcdc45e-7b02-4fba-8442-cc6177235b45 tempest-TestShelveInstance-543572003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2f7c55b0-13b1-486e-9b6c-ef4560d1e431" returned: 1 in 0.835s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:54:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-2377463d-6a54-49f6-8e5c-571106eba3ee req-5dcdc45e-7b02-4fba-8442-cc6177235b45 tempest-TestShelveInstance-543572003 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2f7c55b0-13b1-486e-9b6c-ef4560d1e431' failed. Not Retrying. {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 10 12:54:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-2377463d-6a54-49f6-8e5c-571106eba3ee req-5dcdc45e-7b02-4fba-8442-cc6177235b45 tempest-TestShelveInstance-543572003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.958s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:54:36 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-2377463d-6a54-49f6-8e5c-571106eba3ee req-5dcdc45e-7b02-4fba-8442-cc6177235b45 tempest-TestShelveInstance-543572003 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be', 'name': 'volume-2f7c55b0-13b1-486e-9b6c-ef4560d1e431', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '10681c01-f635-4edb-bbcd-10639b007b6b', 'enforce_multipath': True} {{(pid=87378) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 10 12:54:36 devstack cinder-volume[87378]: INFO cinder.volume.manager [req-2377463d-6a54-49f6-8e5c-571106eba3ee req-5dcdc45e-7b02-4fba-8442-cc6177235b45 tempest-TestShelveInstance-543572003 None] attachment_update completed successfully.
Jul 10 12:54:46 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:SELECT=20,cinder:UPDATE=13,cinder:INSERT=12 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:54:46 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:SELECT=23,cinder:INSERT=6,cinder:UPDATE=16,cinder:DELETE=2 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:55:12 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:55:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:55:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:55:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:55:13 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:55:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:55:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:55:13 devstack sudo[103249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:55:13 devstack sudo[103249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:55:13 devstack sudo[103249]: pam_unix(sudo:session): session closed for user root
Jul 10 12:55:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.780s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:55:13 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:55:13 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager._thread_info {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:55:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread count: 28 {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 10 12:55:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread info: [<_MainThread(MainThread, started 128233544536192)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128233445424704)>, <Thread(Thread-3 (stat_writer), started daemon 128233435118528)>, <Thread(Rabbit-heartbeat, started daemon 128233435718016)>, <Thread(Thread-5 (_runner), started daemon 128233432624448)>, <Thread(Thread-7 (_runner), started daemon 128233432674688)>, <Thread(fd_logger, started daemon 128233428569472)>, <Thread(privsep_reader, started daemon 128233429417088)>, <Thread(tpool_thread_0, started daemon 128233421182656)>, <Thread(tpool_thread_1, started daemon 128233412789952)>, <Thread(tpool_thread_2, started daemon 128233404397248)>, <Thread(tpool_thread_3, started daemon 128233396004544)>, <Thread(tpool_thread_4, started daemon 128233387611840)>, <Thread(tpool_thread_5, started daemon 128233379219136)>, <Thread(tpool_thread_6, started daemon 128233370826432)>, <Thread(tpool_thread_7, started daemon 128233362433728)>, <Thread(tpool_thread_8, started daemon 128233354041024)>, <Thread(tpool_thread_9, started daemon 128233345631936)>, <Thread(tpool_thread_10, started daemon 128233337222848)>, <Thread(tpool_thread_11, started daemon 128233328813760)>, <Thread(tpool_thread_12, started daemon 128233320404672)>, <Thread(tpool_thread_13, started daemon 128233311995584)>, <Thread(tpool_thread_14, started daemon 128233303586496)>, <Thread(tpool_thread_15, started daemon 128233295177408)>, <Thread(tpool_thread_16, started daemon 128233286768320)>, <Thread(tpool_thread_17, started daemon 128233278359232)>, <Thread(tpool_thread_18, started daemon 128233269950144)>, <Thread(tpool_thread_19, started daemon 128233261541056)>] {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 10 12:55:15 devstack cinder-volume[87378]: INFO cinder.volume.manager [req-0618cf3c-254b-4113-b788-eb5fc78f7c70 req-c95380c2-c31c-4634-952e-d6b4648da123 tempest-TestShelveInstance-543572003 None] Terminate volume connection completed successfully.
Jul 10 12:55:15 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-0618cf3c-254b-4113-b788-eb5fc78f7c70 req-c95380c2-c31c-4634-952e-d6b4648da123 tempest-TestShelveInstance-543572003 None] Deleting attachment 10681c01-f635-4edb-bbcd-10639b007b6b. {{(pid=87378) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 10 12:55:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-3a8ebee3-d4f2-499d-ae97-e0f55bc8fcd2 req-6243887e-0fe2-48ba-97a0-8614df54a223 tempest-TestShelveInstance-543572003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:55:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-3a8ebee3-d4f2-499d-ae97-e0f55bc8fcd2 req-6243887e-0fe2-48ba-97a0-8614df54a223 tempest-TestShelveInstance-543572003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:55:20 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f024194-d6e4-4cab-9a7a-3c8c26087fad]: (4, 'raw') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:55:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-3a8ebee3-d4f2-499d-ae97-e0f55bc8fcd2 req-6243887e-0fe2-48ba-97a0-8614df54a223 tempest-TestShelveInstance-543572003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2f7c55b0-13b1-486e-9b6c-ef4560d1e431 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:55:20 devstack sudo[103307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2f7c55b0-13b1-486e-9b6c-ef4560d1e431
Jul 10 12:55:20 devstack sudo[103307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:55:20 devstack sudo[103307]: pam_unix(sudo:session): session closed for user root
Jul 10 12:55:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-3a8ebee3-d4f2-499d-ae97-e0f55bc8fcd2 req-6243887e-0fe2-48ba-97a0-8614df54a223 tempest-TestShelveInstance-543572003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2f7c55b0-13b1-486e-9b6c-ef4560d1e431" returned: 0 in 0.714s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:55:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-3a8ebee3-d4f2-499d-ae97-e0f55bc8fcd2 req-6243887e-0fe2-48ba-97a0-8614df54a223 tempest-TestShelveInstance-543572003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2f7c55b0-13b1-486e-9b6c-ef4560d1e431 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:55:21 devstack sudo[103311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2f7c55b0-13b1-486e-9b6c-ef4560d1e431
Jul 10 12:55:21 devstack sudo[103311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:55:21 devstack sudo[103311]: pam_unix(sudo:session): session closed for user root
Jul 10 12:55:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-3a8ebee3-d4f2-499d-ae97-e0f55bc8fcd2 req-6243887e-0fe2-48ba-97a0-8614df54a223 tempest-TestShelveInstance-543572003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2f7c55b0-13b1-486e-9b6c-ef4560d1e431" returned: 1 in 0.726s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:55:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-3a8ebee3-d4f2-499d-ae97-e0f55bc8fcd2 req-6243887e-0fe2-48ba-97a0-8614df54a223 tempest-TestShelveInstance-543572003 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2f7c55b0-13b1-486e-9b6c-ef4560d1e431' failed. Not Retrying. {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 10 12:55:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-3a8ebee3-d4f2-499d-ae97-e0f55bc8fcd2 req-6243887e-0fe2-48ba-97a0-8614df54a223 tempest-TestShelveInstance-543572003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.478s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:55:21 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-3a8ebee3-d4f2-499d-ae97-e0f55bc8fcd2 req-6243887e-0fe2-48ba-97a0-8614df54a223 tempest-TestShelveInstance-543572003 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be', 'name': 'volume-2f7c55b0-13b1-486e-9b6c-ef4560d1e431', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0d095993-9657-406c-ac66-ec6caa924af9', 'enforce_multipath': True} {{(pid=87378) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 10 12:55:21 devstack cinder-volume[87378]: INFO cinder.volume.manager [req-3a8ebee3-d4f2-499d-ae97-e0f55bc8fcd2 req-6243887e-0fe2-48ba-97a0-8614df54a223 tempest-TestShelveInstance-543572003 None] attachment_update completed successfully.
Jul 10 12:55:26 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-07c8b18f-16e3-4877-8ef2-dde0a9e200b0 tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:55:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-07c8b18f-16e3-4877-8ef2-dde0a9e200b0 tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Flow 'volume_create_manager' (f39756d9-4cb4-4406-8199-a14619b990f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:55:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-07c8b18f-16e3-4877-8ef2-dde0a9e200b0 tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (663361fa-5431-4ffd-ad4c-fbb7c3966646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:55:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-07c8b18f-16e3-4877-8ef2-dde0a9e200b0 tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (663361fa-5431-4ffd-ad4c-fbb7c3966646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1147261559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15b71754-b383-48fd-990e-d138f84d4ada,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bd6c508672943d481e26a6fb1e9071a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:55:26Z,use_quota=True,user_id='e0e568e4c0a145a39499f7d78ea3f549',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:55:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-07c8b18f-16e3-4877-8ef2-dde0a9e200b0 tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9aeec43-25af-42da-bca7-2d6a2c1b1e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:55:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-07c8b18f-16e3-4877-8ef2-dde0a9e200b0 tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9aeec43-25af-42da-bca7-2d6a2c1b1e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:55:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-07c8b18f-16e3-4877-8ef2-dde0a9e200b0 tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3a51287-d72d-4716-82c8-2ed3115ea123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:55:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-07c8b18f-16e3-4877-8ef2-dde0a9e200b0 tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3a51287-d72d-4716-82c8-2ed3115ea123) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15b71754-b383-48fd-990e-d138f84d4ada', 'volume_name': 'volume-15b71754-b383-48fd-990e-d138f84d4ada', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:55:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-07c8b18f-16e3-4877-8ef2-dde0a9e200b0 tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (892a258e-fa30-4e03-a285-795e71275d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:55:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-07c8b18f-16e3-4877-8ef2-dde0a9e200b0 tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (892a258e-fa30-4e03-a285-795e71275d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:55:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-07c8b18f-16e3-4877-8ef2-dde0a9e200b0 tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdac96ae-2bbe-4295-acb4-e1f8a3148180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:55:26 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-07c8b18f-16e3-4877-8ef2-dde0a9e200b0 tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Volume 15b71754-b383-48fd-990e-d138f84d4ada: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15b71754-b383-48fd-990e-d138f84d4ada', 'volume_size': 1}
Jul 10 12:55:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-07c8b18f-16e3-4877-8ef2-dde0a9e200b0 tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:55:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-07c8b18f-16e3-4877-8ef2-dde0a9e200b0 tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:55:26 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-07c8b18f-16e3-4877-8ef2-dde0a9e200b0 tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1147261559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15b71754-b383-48fd-990e-d138f84d4ada,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bd6c508672943d481e26a6fb1e9071a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:55:26Z,use_quota=True,user_id='e0e568e4c0a145a39499f7d78ea3f549',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:55:26 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-07c8b18f-16e3-4877-8ef2-dde0a9e200b0 tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Creating volume 15b71754-b383-48fd-990e-d138f84d4ada {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:55:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-07c8b18f-16e3-4877-8ef2-dde0a9e200b0 tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:55:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-07c8b18f-16e3-4877-8ef2-dde0a9e200b0 tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:55:26 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-07c8b18f-16e3-4877-8ef2-dde0a9e200b0 tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:55:26 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-07c8b18f-16e3-4877-8ef2-dde0a9e200b0 tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:55:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-07c8b18f-16e3-4877-8ef2-dde0a9e200b0 tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:55:26 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-07c8b18f-16e3-4877-8ef2-dde0a9e200b0 tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:55:26 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-07c8b18f-16e3-4877-8ef2-dde0a9e200b0 tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:55:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-07c8b18f-16e3-4877-8ef2-dde0a9e200b0 tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-15b71754-b383-48fd-990e-d138f84d4ada 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:55:26 devstack sudo[103354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-15b71754-b383-48fd-990e-d138f84d4ada 1073741824
Jul 10 12:55:26 devstack sudo[103354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:55:27 devstack sudo[103354]: pam_unix(sudo:session): session closed for user root
Jul 10 12:55:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-07c8b18f-16e3-4877-8ef2-dde0a9e200b0 tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-15b71754-b383-48fd-990e-d138f84d4ada 1073741824" returned: 0 in 0.910s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:55:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-07c8b18f-16e3-4877-8ef2-dde0a9e200b0 tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-15b71754-b383-48fd-990e-d138f84d4ada {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:55:27 devstack sudo[103360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-15b71754-b383-48fd-990e-d138f84d4ada
Jul 10 12:55:27 devstack sudo[103360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:55:28 devstack sudo[103360]: pam_unix(sudo:session): session closed for user root
Jul 10 12:55:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-07c8b18f-16e3-4877-8ef2-dde0a9e200b0 tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-15b71754-b383-48fd-990e-d138f84d4ada" returned: 0 in 0.693s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:55:28 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-07c8b18f-16e3-4877-8ef2-dde0a9e200b0 tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] <== create_volume: return (1659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:55:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-07c8b18f-16e3-4877-8ef2-dde0a9e200b0 tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.662s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:55:28 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-07c8b18f-16e3-4877-8ef2-dde0a9e200b0 tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdac96ae-2bbe-4295-acb4-e1f8a3148180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15b71754-b383-48fd-990e-d138f84d4ada', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:55:28 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-07c8b18f-16e3-4877-8ef2-dde0a9e200b0 tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ef4e1f5-e5d9-4e68-8fa6-060eb90647fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:55:28 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-07c8b18f-16e3-4877-8ef2-dde0a9e200b0 tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Volume volume-15b71754-b383-48fd-990e-d138f84d4ada (15b71754-b383-48fd-990e-d138f84d4ada): created successfully
Jul 10 12:55:28 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-07c8b18f-16e3-4877-8ef2-dde0a9e200b0 tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ef4e1f5-e5d9-4e68-8fa6-060eb90647fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:55:28 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-07c8b18f-16e3-4877-8ef2-dde0a9e200b0 tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Flow 'volume_create_manager' (f39756d9-4cb4-4406-8199-a14619b990f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:55:28 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-07c8b18f-16e3-4877-8ef2-dde0a9e200b0 tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Created volume successfully.
Jul 10 12:55:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-541a1e7e-002b-455a-965e-f44d8e088249 req-344bfbfc-5317-456a-b2d2-09ac6c351ae6 tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:55:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-541a1e7e-002b-455a-965e-f44d8e088249 req-344bfbfc-5317-456a-b2d2-09ac6c351ae6 tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:55:31 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[265b3657-871b-4fb8-a0ae-e66550af14ef]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:55:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-541a1e7e-002b-455a-965e-f44d8e088249 req-344bfbfc-5317-456a-b2d2-09ac6c351ae6 tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-15b71754-b383-48fd-990e-d138f84d4ada {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:55:31 devstack sudo[103487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-15b71754-b383-48fd-990e-d138f84d4ada
Jul 10 12:55:31 devstack sudo[103487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:55:32 devstack sudo[103487]: pam_unix(sudo:session): session closed for user root
Jul 10 12:55:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-541a1e7e-002b-455a-965e-f44d8e088249 req-344bfbfc-5317-456a-b2d2-09ac6c351ae6 tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-15b71754-b383-48fd-990e-d138f84d4ada" returned: 0 in 0.791s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:55:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-541a1e7e-002b-455a-965e-f44d8e088249 req-344bfbfc-5317-456a-b2d2-09ac6c351ae6 tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.818s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:55:32 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-541a1e7e-002b-455a-965e-f44d8e088249 req-344bfbfc-5317-456a-b2d2-09ac6c351ae6 tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be', 'name': 'volume-15b71754-b383-48fd-990e-d138f84d4ada', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9f760b00-bd66-47ee-88ac-f395c423984b', 'enforce_multipath': True} {{(pid=87378) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 10 12:55:32 devstack cinder-volume[87378]: INFO cinder.volume.manager [req-541a1e7e-002b-455a-965e-f44d8e088249 req-344bfbfc-5317-456a-b2d2-09ac6c351ae6 tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] attachment_update completed successfully.
Jul 10 12:55:39 devstack cinder-volume[87378]: INFO cinder.volume.manager [req-5f741768-2923-435f-8914-b71346f76166 req-ad9cae06-9e63-4706-81ba-e302e1a7c30d tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Terminate volume connection completed successfully.
Jul 10 12:55:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-5f741768-2923-435f-8914-b71346f76166 req-ad9cae06-9e63-4706-81ba-e302e1a7c30d tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Deleting attachment 9f760b00-bd66-47ee-88ac-f395c423984b. {{(pid=87378) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 10 12:55:41 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-7edd237e-8188-44d9-95d7-d6764c0021cb tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Acquiring lock "cinder-15b71754-b383-48fd-990e-d138f84d4ada-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:55:41 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-7edd237e-8188-44d9-95d7-d6764c0021cb tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Lock "cinder-15b71754-b383-48fd-990e-d138f84d4ada-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:55:41 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-7edd237e-8188-44d9-95d7-d6764c0021cb tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Acquiring lock "cinder-quobyte-15b71754-b383-48fd-990e-d138f84d4ada" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:55:41 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-7edd237e-8188-44d9-95d7-d6764c0021cb tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Lock "cinder-quobyte-15b71754-b383-48fd-990e-d138f84d4ada" acquired by "delete_volume" :: waited 0.018s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:55:41 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed330592-d03c-4daf-b9a1-44382cbfdd2d]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:55:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7edd237e-8188-44d9-95d7-d6764c0021cb tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-15b71754-b383-48fd-990e-d138f84d4ada {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:55:41 devstack sudo[103846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-15b71754-b383-48fd-990e-d138f84d4ada
Jul 10 12:55:41 devstack sudo[103846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:55:42 devstack sudo[103846]: pam_unix(sudo:session): session closed for user root
Jul 10 12:55:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7edd237e-8188-44d9-95d7-d6764c0021cb tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-15b71754-b383-48fd-990e-d138f84d4ada" returned: 0 in 0.767s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:55:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7edd237e-8188-44d9-95d7-d6764c0021cb tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-15b71754-b383-48fd-990e-d138f84d4ada {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:55:42 devstack sudo[103851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-15b71754-b383-48fd-990e-d138f84d4ada
Jul 10 12:55:42 devstack sudo[103851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:55:42 devstack sudo[103851]: pam_unix(sudo:session): session closed for user root
Jul 10 12:55:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7edd237e-8188-44d9-95d7-d6764c0021cb tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-15b71754-b383-48fd-990e-d138f84d4ada" returned: 0 in 0.652s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:55:42 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-7edd237e-8188-44d9-95d7-d6764c0021cb tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Lock "cinder-quobyte-15b71754-b383-48fd-990e-d138f84d4ada" released by "delete_volume" :: held 1.463s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:55:42 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-7edd237e-8188-44d9-95d7-d6764c0021cb tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Created reservations ['055fc959-34fc-4a9e-a668-f3ba29b9d09b', 'adac61df-3d9f-4fb3-85dc-e41f4cc23ee8', '7b5658f7-697b-46e4-858a-8bdb1683038f', '499db0a9-799b-4aa7-acf6-a0c380192650'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:55:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-7edd237e-8188-44d9-95d7-d6764c0021cb tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:55:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-7edd237e-8188-44d9-95d7-d6764c0021cb tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:55:42 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-7edd237e-8188-44d9-95d7-d6764c0021cb tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:55:42 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-7edd237e-8188-44d9-95d7-d6764c0021cb tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:55:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-7edd237e-8188-44d9-95d7-d6764c0021cb tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:55:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7edd237e-8188-44d9-95d7-d6764c0021cb tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:55:42 devstack sudo[103854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:55:42 devstack sudo[103854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:55:43 devstack sudo[103854]: pam_unix(sudo:session): session closed for user root
Jul 10 12:55:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7edd237e-8188-44d9-95d7-d6764c0021cb tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.692s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:55:43 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-7edd237e-8188-44d9-95d7-d6764c0021cb tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:55:43 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-7edd237e-8188-44d9-95d7-d6764c0021cb tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Deleted volume successfully.
Jul 10 12:55:43 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-7edd237e-8188-44d9-95d7-d6764c0021cb tempest-TestServerVolumeAttachScenarioOldVersion-2059574961 None] Lock "cinder-15b71754-b383-48fd-990e-d138f84d4ada-delete_volume" released by "delete_volume" :: held 2.401s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:55:52 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:SELECT=22,cinder:UPDATE=12,cinder:DELETE=1,cinder:INSERT=2 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:55:53 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:SELECT=18,cinder:UPDATE=16,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:56:02 devstack cinder-volume[87378]: INFO cinder.volume.manager [req-594ad07f-51b5-4558-83bd-04a5f5415fee req-73e6240d-4d9e-4aa3-a070-52887972f7bb tempest-TestShelveInstance-543572003 None] Terminate volume connection completed successfully.
Jul 10 12:56:02 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-594ad07f-51b5-4558-83bd-04a5f5415fee req-73e6240d-4d9e-4aa3-a070-52887972f7bb tempest-TestShelveInstance-543572003 None] Deleting attachment 0d095993-9657-406c-ac66-ec6caa924af9. {{(pid=87378) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 10 12:56:02 devstack cinder-volume[87378]: DEBUG cinder.coordination [req-594ad07f-51b5-4558-83bd-04a5f5415fee req-83cdd2c3-360e-4131-9a0f-efa1f8d23df2 tempest-TestShelveInstance-543572003 None] Acquiring lock "cinder-2f7c55b0-13b1-486e-9b6c-ef4560d1e431-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:56:02 devstack cinder-volume[87378]: DEBUG cinder.coordination [req-594ad07f-51b5-4558-83bd-04a5f5415fee req-83cdd2c3-360e-4131-9a0f-efa1f8d23df2 tempest-TestShelveInstance-543572003 None] Lock "cinder-2f7c55b0-13b1-486e-9b6c-ef4560d1e431-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:56:02 devstack cinder-volume[87378]: DEBUG cinder.coordination [req-594ad07f-51b5-4558-83bd-04a5f5415fee req-83cdd2c3-360e-4131-9a0f-efa1f8d23df2 tempest-TestShelveInstance-543572003 None] Acquiring lock "cinder-quobyte-2f7c55b0-13b1-486e-9b6c-ef4560d1e431" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:56:03 devstack cinder-volume[87378]: DEBUG cinder.coordination [req-594ad07f-51b5-4558-83bd-04a5f5415fee req-83cdd2c3-360e-4131-9a0f-efa1f8d23df2 tempest-TestShelveInstance-543572003 None] Lock "cinder-quobyte-2f7c55b0-13b1-486e-9b6c-ef4560d1e431" acquired by "delete_volume" :: waited 0.019s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:56:03 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be5ad79-1da8-4ccf-99e1-c6dc1b1139f0]: (4, 'raw') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:56:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-594ad07f-51b5-4558-83bd-04a5f5415fee req-83cdd2c3-360e-4131-9a0f-efa1f8d23df2 tempest-TestShelveInstance-543572003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2f7c55b0-13b1-486e-9b6c-ef4560d1e431 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:56:03 devstack sudo[103955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2f7c55b0-13b1-486e-9b6c-ef4560d1e431
Jul 10 12:56:03 devstack sudo[103955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:56:03 devstack sudo[103955]: pam_unix(sudo:session): session closed for user root
Jul 10 12:56:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-594ad07f-51b5-4558-83bd-04a5f5415fee req-83cdd2c3-360e-4131-9a0f-efa1f8d23df2 tempest-TestShelveInstance-543572003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2f7c55b0-13b1-486e-9b6c-ef4560d1e431" returned: 0 in 0.838s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:56:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-594ad07f-51b5-4558-83bd-04a5f5415fee req-83cdd2c3-360e-4131-9a0f-efa1f8d23df2 tempest-TestShelveInstance-543572003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2f7c55b0-13b1-486e-9b6c-ef4560d1e431 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:56:04 devstack sudo[103959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2f7c55b0-13b1-486e-9b6c-ef4560d1e431
Jul 10 12:56:04 devstack sudo[103959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:56:04 devstack sudo[103959]: pam_unix(sudo:session): session closed for user root
Jul 10 12:56:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-594ad07f-51b5-4558-83bd-04a5f5415fee req-83cdd2c3-360e-4131-9a0f-efa1f8d23df2 tempest-TestShelveInstance-543572003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2f7c55b0-13b1-486e-9b6c-ef4560d1e431" returned: 1 in 0.904s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:56:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-594ad07f-51b5-4558-83bd-04a5f5415fee req-83cdd2c3-360e-4131-9a0f-efa1f8d23df2 tempest-TestShelveInstance-543572003 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2f7c55b0-13b1-486e-9b6c-ef4560d1e431' failed. Not Retrying. {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 10 12:56:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-594ad07f-51b5-4558-83bd-04a5f5415fee req-83cdd2c3-360e-4131-9a0f-efa1f8d23df2 tempest-TestShelveInstance-543572003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2f7c55b0-13b1-486e-9b6c-ef4560d1e431 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:56:04 devstack sudo[103965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2f7c55b0-13b1-486e-9b6c-ef4560d1e431
Jul 10 12:56:04 devstack sudo[103965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:56:05 devstack sudo[103965]: pam_unix(sudo:session): session closed for user root
Jul 10 12:56:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-594ad07f-51b5-4558-83bd-04a5f5415fee req-83cdd2c3-360e-4131-9a0f-efa1f8d23df2 tempest-TestShelveInstance-543572003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2f7c55b0-13b1-486e-9b6c-ef4560d1e431" returned: 0 in 0.668s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:56:05 devstack cinder-volume[87378]: DEBUG cinder.coordination [req-594ad07f-51b5-4558-83bd-04a5f5415fee req-83cdd2c3-360e-4131-9a0f-efa1f8d23df2 tempest-TestShelveInstance-543572003 None] Lock "cinder-quobyte-2f7c55b0-13b1-486e-9b6c-ef4560d1e431" released by "delete_volume" :: held 2.488s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:56:05 devstack cinder-volume[87378]: DEBUG cinder.quota [req-594ad07f-51b5-4558-83bd-04a5f5415fee req-83cdd2c3-360e-4131-9a0f-efa1f8d23df2 tempest-TestShelveInstance-543572003 None] Created reservations ['f941accf-191e-41d4-8619-a00bdce2b751', '34367733-b0d7-4df5-953c-a99d0f194923', '750c8be6-b489-4f36-93da-3a61abc6f752', '3a439812-dfa1-45a9-b4ac-de35694a218b'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:56:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-594ad07f-51b5-4558-83bd-04a5f5415fee req-83cdd2c3-360e-4131-9a0f-efa1f8d23df2 tempest-TestShelveInstance-543572003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:56:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-594ad07f-51b5-4558-83bd-04a5f5415fee req-83cdd2c3-360e-4131-9a0f-efa1f8d23df2 tempest-TestShelveInstance-543572003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:56:05 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [req-594ad07f-51b5-4558-83bd-04a5f5415fee req-83cdd2c3-360e-4131-9a0f-efa1f8d23df2 tempest-TestShelveInstance-543572003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:56:05 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [req-594ad07f-51b5-4558-83bd-04a5f5415fee req-83cdd2c3-360e-4131-9a0f-efa1f8d23df2 tempest-TestShelveInstance-543572003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:56:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-594ad07f-51b5-4558-83bd-04a5f5415fee req-83cdd2c3-360e-4131-9a0f-efa1f8d23df2 tempest-TestShelveInstance-543572003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:56:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-594ad07f-51b5-4558-83bd-04a5f5415fee req-83cdd2c3-360e-4131-9a0f-efa1f8d23df2 tempest-TestShelveInstance-543572003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:56:05 devstack sudo[103968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:56:05 devstack sudo[103968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:56:06 devstack sudo[103968]: pam_unix(sudo:session): session closed for user root
Jul 10 12:56:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-594ad07f-51b5-4558-83bd-04a5f5415fee req-83cdd2c3-360e-4131-9a0f-efa1f8d23df2 tempest-TestShelveInstance-543572003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.741s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:56:06 devstack cinder-volume[87378]: DEBUG cinder.manager [req-594ad07f-51b5-4558-83bd-04a5f5415fee req-83cdd2c3-360e-4131-9a0f-efa1f8d23df2 tempest-TestShelveInstance-543572003 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:56:06 devstack cinder-volume[87378]: INFO cinder.volume.manager [req-594ad07f-51b5-4558-83bd-04a5f5415fee req-83cdd2c3-360e-4131-9a0f-efa1f8d23df2 tempest-TestShelveInstance-543572003 None] Deleted volume successfully.
Jul 10 12:56:06 devstack cinder-volume[87378]: DEBUG cinder.coordination [req-594ad07f-51b5-4558-83bd-04a5f5415fee req-83cdd2c3-360e-4131-9a0f-efa1f8d23df2 tempest-TestShelveInstance-543572003 None] Lock "cinder-2f7c55b0-13b1-486e-9b6c-ef4560d1e431-delete_volume" released by "delete_volume" :: held 3.572s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:56:12 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:56:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:56:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:56:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:56:13 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:56:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:56:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:56:13 devstack sudo[103976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:56:13 devstack sudo[103976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:56:13 devstack sudo[103976]: pam_unix(sudo:session): session closed for user root
Jul 10 12:56:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.736s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:56:13 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:56:13 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager._thread_info {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:56:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread count: 28 {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 10 12:56:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread info: [<_MainThread(MainThread, started 128233544536192)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128233445424704)>, <Thread(Thread-3 (stat_writer), started daemon 128233435118528)>, <Thread(Rabbit-heartbeat, started daemon 128233435718016)>, <Thread(Thread-5 (_runner), started daemon 128233432624448)>, <Thread(Thread-7 (_runner), started daemon 128233432674688)>, <Thread(fd_logger, started daemon 128233428569472)>, <Thread(privsep_reader, started daemon 128233429417088)>, <Thread(tpool_thread_0, started daemon 128233421182656)>, <Thread(tpool_thread_1, started daemon 128233412789952)>, <Thread(tpool_thread_2, started daemon 128233404397248)>, <Thread(tpool_thread_3, started daemon 128233396004544)>, <Thread(tpool_thread_4, started daemon 128233387611840)>, <Thread(tpool_thread_5, started daemon 128233379219136)>, <Thread(tpool_thread_6, started daemon 128233370826432)>, <Thread(tpool_thread_7, started daemon 128233362433728)>, <Thread(tpool_thread_8, started daemon 128233354041024)>, <Thread(tpool_thread_9, started daemon 128233345631936)>, <Thread(tpool_thread_10, started daemon 128233337222848)>, <Thread(tpool_thread_11, started daemon 128233328813760)>, <Thread(tpool_thread_12, started daemon 128233320404672)>, <Thread(tpool_thread_13, started daemon 128233311995584)>, <Thread(tpool_thread_14, started daemon 128233303586496)>, <Thread(tpool_thread_15, started daemon 128233295177408)>, <Thread(tpool_thread_16, started daemon 128233286768320)>, <Thread(tpool_thread_17, started daemon 128233278359232)>, <Thread(tpool_thread_18, started daemon 128233269950144)>, <Thread(tpool_thread_19, started daemon 128233261541056)>] {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 10 12:56:15 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=9 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:56:16 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:SELECT=6,cinder:UPDATE=7,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:56:24 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-3172f1ad-cd74-4c1c-b233-3b1d0537c82d tempest-TestServerVolumeAttachmentScenario-787785620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:56:24 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3172f1ad-cd74-4c1c-b233-3b1d0537c82d tempest-TestServerVolumeAttachmentScenario-787785620 None] Flow 'volume_create_manager' (b61fdc5c-8ed0-4294-a807-35be5c206700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:56:24 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3172f1ad-cd74-4c1c-b233-3b1d0537c82d tempest-TestServerVolumeAttachmentScenario-787785620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc5126bd-304e-489d-9c0b-3201c5223aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:56:24 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3172f1ad-cd74-4c1c-b233-3b1d0537c82d tempest-TestServerVolumeAttachmentScenario-787785620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc5126bd-304e-489d-9c0b-3201c5223aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-224143668',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86e07abd-1b6d-4851-8ac6-31c989f36305,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='226ad2ce5a6f437b98145c2e40f1df88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:56:25Z,use_quota=True,user_id='d16727df0604417584f6fd7a12a18889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:56:24 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3172f1ad-cd74-4c1c-b233-3b1d0537c82d tempest-TestServerVolumeAttachmentScenario-787785620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6df2e839-e31e-4671-9428-cee1c319a214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:56:24 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3172f1ad-cd74-4c1c-b233-3b1d0537c82d tempest-TestServerVolumeAttachmentScenario-787785620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6df2e839-e31e-4671-9428-cee1c319a214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:56:24 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3172f1ad-cd74-4c1c-b233-3b1d0537c82d tempest-TestServerVolumeAttachmentScenario-787785620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77b616a7-feeb-4cf4-851c-c574b8c46556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:56:24 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3172f1ad-cd74-4c1c-b233-3b1d0537c82d tempest-TestServerVolumeAttachmentScenario-787785620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77b616a7-feeb-4cf4-851c-c574b8c46556) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86e07abd-1b6d-4851-8ac6-31c989f36305', 'volume_name': 'volume-86e07abd-1b6d-4851-8ac6-31c989f36305', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:56:25 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3172f1ad-cd74-4c1c-b233-3b1d0537c82d tempest-TestServerVolumeAttachmentScenario-787785620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a254dc6f-9df2-44f6-ad12-e9a00194d459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:56:25 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3172f1ad-cd74-4c1c-b233-3b1d0537c82d tempest-TestServerVolumeAttachmentScenario-787785620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a254dc6f-9df2-44f6-ad12-e9a00194d459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:56:25 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3172f1ad-cd74-4c1c-b233-3b1d0537c82d tempest-TestServerVolumeAttachmentScenario-787785620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54a45dcc-1c24-44b9-95d8-22eb3164e9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:56:25 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-3172f1ad-cd74-4c1c-b233-3b1d0537c82d tempest-TestServerVolumeAttachmentScenario-787785620 None] Volume 86e07abd-1b6d-4851-8ac6-31c989f36305: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86e07abd-1b6d-4851-8ac6-31c989f36305', 'volume_size': 1}
Jul 10 12:56:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3172f1ad-cd74-4c1c-b233-3b1d0537c82d tempest-TestServerVolumeAttachmentScenario-787785620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:56:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3172f1ad-cd74-4c1c-b233-3b1d0537c82d tempest-TestServerVolumeAttachmentScenario-787785620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:56:25 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3172f1ad-cd74-4c1c-b233-3b1d0537c82d tempest-TestServerVolumeAttachmentScenario-787785620 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-224143668',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86e07abd-1b6d-4851-8ac6-31c989f36305,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='226ad2ce5a6f437b98145c2e40f1df88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:56:25Z,use_quota=True,user_id='d16727df0604417584f6fd7a12a18889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:56:25 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-3172f1ad-cd74-4c1c-b233-3b1d0537c82d tempest-TestServerVolumeAttachmentScenario-787785620 None] Creating volume 86e07abd-1b6d-4851-8ac6-31c989f36305 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:56:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3172f1ad-cd74-4c1c-b233-3b1d0537c82d tempest-TestServerVolumeAttachmentScenario-787785620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:56:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3172f1ad-cd74-4c1c-b233-3b1d0537c82d tempest-TestServerVolumeAttachmentScenario-787785620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:56:25 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3172f1ad-cd74-4c1c-b233-3b1d0537c82d tempest-TestServerVolumeAttachmentScenario-787785620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:56:25 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3172f1ad-cd74-4c1c-b233-3b1d0537c82d tempest-TestServerVolumeAttachmentScenario-787785620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:56:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3172f1ad-cd74-4c1c-b233-3b1d0537c82d tempest-TestServerVolumeAttachmentScenario-787785620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:56:25 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3172f1ad-cd74-4c1c-b233-3b1d0537c82d tempest-TestServerVolumeAttachmentScenario-787785620 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:56:25 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-3172f1ad-cd74-4c1c-b233-3b1d0537c82d tempest-TestServerVolumeAttachmentScenario-787785620 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:56:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3172f1ad-cd74-4c1c-b233-3b1d0537c82d tempest-TestServerVolumeAttachmentScenario-787785620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-86e07abd-1b6d-4851-8ac6-31c989f36305 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:56:25 devstack sudo[103981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-86e07abd-1b6d-4851-8ac6-31c989f36305 1073741824
Jul 10 12:56:25 devstack sudo[103981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:56:25 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a13718d-6df2-4037-b97c-b6ff711ed340 tempest-TestServerVolumeAttachmentScenario-787785620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:56:25 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6a13718d-6df2-4037-b97c-b6ff711ed340 tempest-TestServerVolumeAttachmentScenario-787785620 None] Flow 'volume_create_manager' (99c28c8e-d0c9-413d-93c2-6041392b035f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:56:25 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6a13718d-6df2-4037-b97c-b6ff711ed340 tempest-TestServerVolumeAttachmentScenario-787785620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3aa8a95-8f8d-423f-90b0-8ba0cf73e6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:56:25 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6a13718d-6df2-4037-b97c-b6ff711ed340 tempest-TestServerVolumeAttachmentScenario-787785620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3aa8a95-8f8d-423f-90b0-8ba0cf73e6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1647182513',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9185dce5-2fe5-42e4-ab7b-a9994a16b12d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='226ad2ce5a6f437b98145c2e40f1df88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:56:25Z,use_quota=True,user_id='d16727df0604417584f6fd7a12a18889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:56:25 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6a13718d-6df2-4037-b97c-b6ff711ed340 tempest-TestServerVolumeAttachmentScenario-787785620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0af23d90-fbcc-463d-ba70-eba976757e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:56:25 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6a13718d-6df2-4037-b97c-b6ff711ed340 tempest-TestServerVolumeAttachmentScenario-787785620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0af23d90-fbcc-463d-ba70-eba976757e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:56:25 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6a13718d-6df2-4037-b97c-b6ff711ed340 tempest-TestServerVolumeAttachmentScenario-787785620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28c4e19b-8d7d-4bf2-a9c8-e2c52ef904e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:56:25 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6a13718d-6df2-4037-b97c-b6ff711ed340 tempest-TestServerVolumeAttachmentScenario-787785620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28c4e19b-8d7d-4bf2-a9c8-e2c52ef904e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9185dce5-2fe5-42e4-ab7b-a9994a16b12d', 'volume_name': 'volume-9185dce5-2fe5-42e4-ab7b-a9994a16b12d', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:56:25 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6a13718d-6df2-4037-b97c-b6ff711ed340 tempest-TestServerVolumeAttachmentScenario-787785620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5404a55-7c86-4cb3-986b-7dd16f5db35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:56:25 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6a13718d-6df2-4037-b97c-b6ff711ed340 tempest-TestServerVolumeAttachmentScenario-787785620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5404a55-7c86-4cb3-986b-7dd16f5db35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:56:25 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6a13718d-6df2-4037-b97c-b6ff711ed340 tempest-TestServerVolumeAttachmentScenario-787785620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d02498fc-f5d6-47c9-97d2-aa9274d86eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:56:25 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-6a13718d-6df2-4037-b97c-b6ff711ed340 tempest-TestServerVolumeAttachmentScenario-787785620 None] Volume 9185dce5-2fe5-42e4-ab7b-a9994a16b12d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9185dce5-2fe5-42e4-ab7b-a9994a16b12d', 'volume_size': 1}
Jul 10 12:56:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-6a13718d-6df2-4037-b97c-b6ff711ed340 tempest-TestServerVolumeAttachmentScenario-787785620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:56:26 devstack sudo[103981]: pam_unix(sudo:session): session closed for user root
Jul 10 12:56:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3172f1ad-cd74-4c1c-b233-3b1d0537c82d tempest-TestServerVolumeAttachmentScenario-787785620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-86e07abd-1b6d-4851-8ac6-31c989f36305 1073741824" returned: 0 in 1.241s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:56:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3172f1ad-cd74-4c1c-b233-3b1d0537c82d tempest-TestServerVolumeAttachmentScenario-787785620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-86e07abd-1b6d-4851-8ac6-31c989f36305 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:56:26 devstack sudo[104023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-86e07abd-1b6d-4851-8ac6-31c989f36305
Jul 10 12:56:26 devstack sudo[104023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:56:27 devstack sudo[104023]: pam_unix(sudo:session): session closed for user root
Jul 10 12:56:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3172f1ad-cd74-4c1c-b233-3b1d0537c82d tempest-TestServerVolumeAttachmentScenario-787785620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-86e07abd-1b6d-4851-8ac6-31c989f36305" returned: 0 in 0.823s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:56:27 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3172f1ad-cd74-4c1c-b233-3b1d0537c82d tempest-TestServerVolumeAttachmentScenario-787785620 None] <== create_volume: return (2137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:56:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3172f1ad-cd74-4c1c-b233-3b1d0537c82d tempest-TestServerVolumeAttachmentScenario-787785620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.141s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:56:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-6a13718d-6df2-4037-b97c-b6ff711ed340 tempest-TestServerVolumeAttachmentScenario-787785620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.558s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:56:27 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-6a13718d-6df2-4037-b97c-b6ff711ed340 tempest-TestServerVolumeAttachmentScenario-787785620 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1647182513',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9185dce5-2fe5-42e4-ab7b-a9994a16b12d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='226ad2ce5a6f437b98145c2e40f1df88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:56:25Z,use_quota=True,user_id='d16727df0604417584f6fd7a12a18889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:56:27 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-6a13718d-6df2-4037-b97c-b6ff711ed340 tempest-TestServerVolumeAttachmentScenario-787785620 None] Creating volume 9185dce5-2fe5-42e4-ab7b-a9994a16b12d {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:56:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-6a13718d-6df2-4037-b97c-b6ff711ed340 tempest-TestServerVolumeAttachmentScenario-787785620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:56:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-6a13718d-6df2-4037-b97c-b6ff711ed340 tempest-TestServerVolumeAttachmentScenario-787785620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:56:27 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-6a13718d-6df2-4037-b97c-b6ff711ed340 tempest-TestServerVolumeAttachmentScenario-787785620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:56:27 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-6a13718d-6df2-4037-b97c-b6ff711ed340 tempest-TestServerVolumeAttachmentScenario-787785620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:56:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-6a13718d-6df2-4037-b97c-b6ff711ed340 tempest-TestServerVolumeAttachmentScenario-787785620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:56:27 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-6a13718d-6df2-4037-b97c-b6ff711ed340 tempest-TestServerVolumeAttachmentScenario-787785620 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:56:27 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-6a13718d-6df2-4037-b97c-b6ff711ed340 tempest-TestServerVolumeAttachmentScenario-787785620 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:56:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6a13718d-6df2-4037-b97c-b6ff711ed340 tempest-TestServerVolumeAttachmentScenario-787785620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9185dce5-2fe5-42e4-ab7b-a9994a16b12d 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:56:27 devstack sudo[104026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9185dce5-2fe5-42e4-ab7b-a9994a16b12d 1073741824
Jul 10 12:56:27 devstack sudo[104026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:56:27 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3172f1ad-cd74-4c1c-b233-3b1d0537c82d tempest-TestServerVolumeAttachmentScenario-787785620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54a45dcc-1c24-44b9-95d8-22eb3164e9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86e07abd-1b6d-4851-8ac6-31c989f36305', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:56:27 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3172f1ad-cd74-4c1c-b233-3b1d0537c82d tempest-TestServerVolumeAttachmentScenario-787785620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7856fec-8fbd-4019-8ebd-0b777ddf63f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:56:27 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-3172f1ad-cd74-4c1c-b233-3b1d0537c82d tempest-TestServerVolumeAttachmentScenario-787785620 None] Volume volume-86e07abd-1b6d-4851-8ac6-31c989f36305 (86e07abd-1b6d-4851-8ac6-31c989f36305): created successfully
Jul 10 12:56:27 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3172f1ad-cd74-4c1c-b233-3b1d0537c82d tempest-TestServerVolumeAttachmentScenario-787785620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7856fec-8fbd-4019-8ebd-0b777ddf63f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:56:27 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3172f1ad-cd74-4c1c-b233-3b1d0537c82d tempest-TestServerVolumeAttachmentScenario-787785620 None] Flow 'volume_create_manager' (b61fdc5c-8ed0-4294-a807-35be5c206700) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:56:27 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-3172f1ad-cd74-4c1c-b233-3b1d0537c82d tempest-TestServerVolumeAttachmentScenario-787785620 None] Created volume successfully.
Jul 10 12:56:28 devstack sudo[104026]: pam_unix(sudo:session): session closed for user root
Jul 10 12:56:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6a13718d-6df2-4037-b97c-b6ff711ed340 tempest-TestServerVolumeAttachmentScenario-787785620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9185dce5-2fe5-42e4-ab7b-a9994a16b12d 1073741824" returned: 0 in 1.108s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:56:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6a13718d-6df2-4037-b97c-b6ff711ed340 tempest-TestServerVolumeAttachmentScenario-787785620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9185dce5-2fe5-42e4-ab7b-a9994a16b12d {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:56:28 devstack sudo[104032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9185dce5-2fe5-42e4-ab7b-a9994a16b12d
Jul 10 12:56:28 devstack sudo[104032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:56:29 devstack sudo[104032]: pam_unix(sudo:session): session closed for user root
Jul 10 12:56:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6a13718d-6df2-4037-b97c-b6ff711ed340 tempest-TestServerVolumeAttachmentScenario-787785620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9185dce5-2fe5-42e4-ab7b-a9994a16b12d" returned: 0 in 0.720s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:56:29 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-6a13718d-6df2-4037-b97c-b6ff711ed340 tempest-TestServerVolumeAttachmentScenario-787785620 None] <== create_volume: return (1889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:56:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-6a13718d-6df2-4037-b97c-b6ff711ed340 tempest-TestServerVolumeAttachmentScenario-787785620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.892s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:56:29 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6a13718d-6df2-4037-b97c-b6ff711ed340 tempest-TestServerVolumeAttachmentScenario-787785620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d02498fc-f5d6-47c9-97d2-aa9274d86eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9185dce5-2fe5-42e4-ab7b-a9994a16b12d', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:56:29 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6a13718d-6df2-4037-b97c-b6ff711ed340 tempest-TestServerVolumeAttachmentScenario-787785620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74386bb8-f302-4fc9-bd3e-e8a6790d6d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:56:29 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-6a13718d-6df2-4037-b97c-b6ff711ed340 tempest-TestServerVolumeAttachmentScenario-787785620 None] Volume volume-9185dce5-2fe5-42e4-ab7b-a9994a16b12d (9185dce5-2fe5-42e4-ab7b-a9994a16b12d): created successfully
Jul 10 12:56:29 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6a13718d-6df2-4037-b97c-b6ff711ed340 tempest-TestServerVolumeAttachmentScenario-787785620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74386bb8-f302-4fc9-bd3e-e8a6790d6d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:56:29 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6a13718d-6df2-4037-b97c-b6ff711ed340 tempest-TestServerVolumeAttachmentScenario-787785620 None] Flow 'volume_create_manager' (99c28c8e-d0c9-413d-93c2-6041392b035f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:56:29 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-6a13718d-6df2-4037-b97c-b6ff711ed340 tempest-TestServerVolumeAttachmentScenario-787785620 None] Created volume successfully.
Jul 10 12:56:39 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:SELECT=5,cinder:UPDATE=5,cinder:DELETE=1,cinder:INSERT=1 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:56:39 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:UPDATE=8,cinder:SELECT=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:56:42 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-78500576-8a44-4fa4-823d-37851d191a43 tempest-TestStampPattern-290201722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:56:42 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-78500576-8a44-4fa4-823d-37851d191a43 tempest-TestStampPattern-290201722 None] Flow 'volume_create_manager' (ffa6f373-7227-401d-a2f3-f70d992912a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:56:42 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-78500576-8a44-4fa4-823d-37851d191a43 tempest-TestStampPattern-290201722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e05830ca-d1d1-4ac4-8c1a-bd8c39c94c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:56:42 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-78500576-8a44-4fa4-823d-37851d191a43 tempest-TestStampPattern-290201722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e05830ca-d1d1-4ac4-8c1a-bd8c39c94c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-357004188',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87b6f1ae-2c78-4afe-a4a1-25675f03f58d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb44f66040cc4aff909da7cf68180024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:56:42Z,use_quota=True,user_id='d7fd951f03ef4508ab8bcf591b1757f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:56:42 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-78500576-8a44-4fa4-823d-37851d191a43 tempest-TestStampPattern-290201722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45b3a35a-d118-4032-a147-b4ae6fbb0b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:56:42 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-78500576-8a44-4fa4-823d-37851d191a43 tempest-TestStampPattern-290201722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45b3a35a-d118-4032-a147-b4ae6fbb0b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:56:42 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-78500576-8a44-4fa4-823d-37851d191a43 tempest-TestStampPattern-290201722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87e613ee-26b3-407b-a798-671b848131b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:56:42 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-78500576-8a44-4fa4-823d-37851d191a43 tempest-TestStampPattern-290201722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87e613ee-26b3-407b-a798-671b848131b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87b6f1ae-2c78-4afe-a4a1-25675f03f58d', 'volume_name': 'volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:56:42 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-78500576-8a44-4fa4-823d-37851d191a43 tempest-TestStampPattern-290201722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ac30316-10b1-4016-b5cb-c610a4b6bd4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:56:42 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-78500576-8a44-4fa4-823d-37851d191a43 tempest-TestStampPattern-290201722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ac30316-10b1-4016-b5cb-c610a4b6bd4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:56:42 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-78500576-8a44-4fa4-823d-37851d191a43 tempest-TestStampPattern-290201722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83259431-dae8-4262-a4e3-6291240f70a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:56:42 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-78500576-8a44-4fa4-823d-37851d191a43 tempest-TestStampPattern-290201722 None] Volume 87b6f1ae-2c78-4afe-a4a1-25675f03f58d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d', 'volume_size': 1}
Jul 10 12:56:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-78500576-8a44-4fa4-823d-37851d191a43 tempest-TestStampPattern-290201722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:56:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-78500576-8a44-4fa4-823d-37851d191a43 tempest-TestStampPattern-290201722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:56:42 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-78500576-8a44-4fa4-823d-37851d191a43 tempest-TestStampPattern-290201722 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-357004188',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87b6f1ae-2c78-4afe-a4a1-25675f03f58d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb44f66040cc4aff909da7cf68180024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:56:42Z,use_quota=True,user_id='d7fd951f03ef4508ab8bcf591b1757f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:56:42 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-78500576-8a44-4fa4-823d-37851d191a43 tempest-TestStampPattern-290201722 None] Creating volume 87b6f1ae-2c78-4afe-a4a1-25675f03f58d {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:56:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-78500576-8a44-4fa4-823d-37851d191a43 tempest-TestStampPattern-290201722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:56:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-78500576-8a44-4fa4-823d-37851d191a43 tempest-TestStampPattern-290201722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:56:42 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-78500576-8a44-4fa4-823d-37851d191a43 tempest-TestStampPattern-290201722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:56:42 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-78500576-8a44-4fa4-823d-37851d191a43 tempest-TestStampPattern-290201722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:56:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-78500576-8a44-4fa4-823d-37851d191a43 tempest-TestStampPattern-290201722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:56:42 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-78500576-8a44-4fa4-823d-37851d191a43 tempest-TestStampPattern-290201722 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:56:42 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-78500576-8a44-4fa4-823d-37851d191a43 tempest-TestStampPattern-290201722 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:56:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-78500576-8a44-4fa4-823d-37851d191a43 tempest-TestStampPattern-290201722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:56:42 devstack sudo[104099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d 1073741824
Jul 10 12:56:42 devstack sudo[104099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:56:43 devstack sudo[104099]: pam_unix(sudo:session): session closed for user root
Jul 10 12:56:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-78500576-8a44-4fa4-823d-37851d191a43 tempest-TestStampPattern-290201722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d 1073741824" returned: 0 in 1.027s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:56:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-78500576-8a44-4fa4-823d-37851d191a43 tempest-TestStampPattern-290201722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:56:43 devstack sudo[104120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d
Jul 10 12:56:43 devstack sudo[104120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:56:44 devstack sudo[104120]: pam_unix(sudo:session): session closed for user root
Jul 10 12:56:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-78500576-8a44-4fa4-823d-37851d191a43 tempest-TestStampPattern-290201722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d" returned: 0 in 0.756s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:56:44 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-78500576-8a44-4fa4-823d-37851d191a43 tempest-TestStampPattern-290201722 None] <== create_volume: return (1825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:56:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-78500576-8a44-4fa4-823d-37851d191a43 tempest-TestStampPattern-290201722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.828s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:56:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-78500576-8a44-4fa4-823d-37851d191a43 tempest-TestStampPattern-290201722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83259431-dae8-4262-a4e3-6291240f70a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:56:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-78500576-8a44-4fa4-823d-37851d191a43 tempest-TestStampPattern-290201722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3db949bc-1687-4b10-9b6f-9d57e2eb908e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:56:44 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-78500576-8a44-4fa4-823d-37851d191a43 tempest-TestStampPattern-290201722 None] Volume volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d (87b6f1ae-2c78-4afe-a4a1-25675f03f58d): created successfully
Jul 10 12:56:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-78500576-8a44-4fa4-823d-37851d191a43 tempest-TestStampPattern-290201722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3db949bc-1687-4b10-9b6f-9d57e2eb908e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:56:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-78500576-8a44-4fa4-823d-37851d191a43 tempest-TestStampPattern-290201722 None] Flow 'volume_create_manager' (ffa6f373-7227-401d-a2f3-f70d992912a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:56:44 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-78500576-8a44-4fa4-823d-37851d191a43 tempest-TestStampPattern-290201722 None] Created volume successfully.
Jul 10 12:56:54 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:56:54 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:57:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-afa5aac8-7950-44cf-b699-e98d2c388e37 req-265c3e00-0279-4198-9a11-da2ecbd7a049 tempest-TestServerVolumeAttachmentScenario-787785620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:57:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-afa5aac8-7950-44cf-b699-e98d2c388e37 req-265c3e00-0279-4198-9a11-da2ecbd7a049 tempest-TestServerVolumeAttachmentScenario-787785620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:57:11 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98e0a59-9b0c-4421-8996-55165e0f0222]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:57:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-afa5aac8-7950-44cf-b699-e98d2c388e37 req-265c3e00-0279-4198-9a11-da2ecbd7a049 tempest-TestServerVolumeAttachmentScenario-787785620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-86e07abd-1b6d-4851-8ac6-31c989f36305 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:57:11 devstack sudo[104287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-86e07abd-1b6d-4851-8ac6-31c989f36305
Jul 10 12:57:11 devstack sudo[104287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:57:11 devstack sudo[104287]: pam_unix(sudo:session): session closed for user root
Jul 10 12:57:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-afa5aac8-7950-44cf-b699-e98d2c388e37 req-265c3e00-0279-4198-9a11-da2ecbd7a049 tempest-TestServerVolumeAttachmentScenario-787785620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-86e07abd-1b6d-4851-8ac6-31c989f36305" returned: 0 in 0.736s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:57:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-afa5aac8-7950-44cf-b699-e98d2c388e37 req-265c3e00-0279-4198-9a11-da2ecbd7a049 tempest-TestServerVolumeAttachmentScenario-787785620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.751s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:57:11 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-afa5aac8-7950-44cf-b699-e98d2c388e37 req-265c3e00-0279-4198-9a11-da2ecbd7a049 tempest-TestServerVolumeAttachmentScenario-787785620 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be', 'name': 'volume-86e07abd-1b6d-4851-8ac6-31c989f36305', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '90d73fba-9b6e-477c-bf9c-a54f2ddcb234', 'enforce_multipath': True} {{(pid=87378) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 10 12:57:11 devstack cinder-volume[87378]: INFO cinder.volume.manager [req-afa5aac8-7950-44cf-b699-e98d2c388e37 req-265c3e00-0279-4198-9a11-da2ecbd7a049 tempest-TestServerVolumeAttachmentScenario-787785620 None] attachment_update completed successfully.
Jul 10 12:57:12 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:57:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:57:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:57:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:57:13 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:57:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:57:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:57:13 devstack sudo[104675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:57:13 devstack sudo[104675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:57:13 devstack sudo[104675]: pam_unix(sudo:session): session closed for user root
Jul 10 12:57:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.652s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:57:13 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:57:13 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager._thread_info {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:57:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread count: 28 {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 10 12:57:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread info: [<_MainThread(MainThread, started 128233544536192)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128233445424704)>, <Thread(Thread-3 (stat_writer), started daemon 128233435118528)>, <Thread(Rabbit-heartbeat, started daemon 128233435718016)>, <Thread(Thread-5 (_runner), started daemon 128233432624448)>, <Thread(Thread-7 (_runner), started daemon 128233432674688)>, <Thread(fd_logger, started daemon 128233428569472)>, <Thread(privsep_reader, started daemon 128233429417088)>, <Thread(tpool_thread_0, started daemon 128233421182656)>, <Thread(tpool_thread_1, started daemon 128233412789952)>, <Thread(tpool_thread_2, started daemon 128233404397248)>, <Thread(tpool_thread_3, started daemon 128233396004544)>, <Thread(tpool_thread_4, started daemon 128233387611840)>, <Thread(tpool_thread_5, started daemon 128233379219136)>, <Thread(tpool_thread_6, started daemon 128233370826432)>, <Thread(tpool_thread_7, started daemon 128233362433728)>, <Thread(tpool_thread_8, started daemon 128233354041024)>, <Thread(tpool_thread_9, started daemon 128233345631936)>, <Thread(tpool_thread_10, started daemon 128233337222848)>, <Thread(tpool_thread_11, started daemon 128233328813760)>, <Thread(tpool_thread_12, started daemon 128233320404672)>, <Thread(tpool_thread_13, started daemon 128233311995584)>, <Thread(tpool_thread_14, started daemon 128233303586496)>, <Thread(tpool_thread_15, started daemon 128233295177408)>, <Thread(tpool_thread_16, started daemon 128233286768320)>, <Thread(tpool_thread_17, started daemon 128233278359232)>, <Thread(tpool_thread_18, started daemon 128233269950144)>, <Thread(tpool_thread_19, started daemon 128233261541056)>] {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 10 12:57:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-d1a30e1a-e277-465a-b9b1-abee4885ed30 req-45a29512-a021-4ca3-836d-a39f6ae9dc5c tempest-TestServerVolumeAttachmentScenario-787785620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:57:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-d1a30e1a-e277-465a-b9b1-abee4885ed30 req-45a29512-a021-4ca3-836d-a39f6ae9dc5c tempest-TestServerVolumeAttachmentScenario-787785620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:57:20 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[57606c25-89e7-4d17-b6b9-f89d5bb57f2e]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:57:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-d1a30e1a-e277-465a-b9b1-abee4885ed30 req-45a29512-a021-4ca3-836d-a39f6ae9dc5c tempest-TestServerVolumeAttachmentScenario-787785620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9185dce5-2fe5-42e4-ab7b-a9994a16b12d {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:57:21 devstack sudo[104698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9185dce5-2fe5-42e4-ab7b-a9994a16b12d
Jul 10 12:57:21 devstack sudo[104698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:57:21 devstack sudo[104698]: pam_unix(sudo:session): session closed for user root
Jul 10 12:57:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-d1a30e1a-e277-465a-b9b1-abee4885ed30 req-45a29512-a021-4ca3-836d-a39f6ae9dc5c tempest-TestServerVolumeAttachmentScenario-787785620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9185dce5-2fe5-42e4-ab7b-a9994a16b12d" returned: 0 in 0.760s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:57:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-d1a30e1a-e277-465a-b9b1-abee4885ed30 req-45a29512-a021-4ca3-836d-a39f6ae9dc5c tempest-TestServerVolumeAttachmentScenario-787785620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.777s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:57:21 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-d1a30e1a-e277-465a-b9b1-abee4885ed30 req-45a29512-a021-4ca3-836d-a39f6ae9dc5c tempest-TestServerVolumeAttachmentScenario-787785620 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be', 'name': 'volume-9185dce5-2fe5-42e4-ab7b-a9994a16b12d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5bc2eb48-fa3c-40b9-b114-d6d73f3088e6', 'enforce_multipath': True} {{(pid=87378) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 10 12:57:21 devstack cinder-volume[87378]: INFO cinder.volume.manager [req-d1a30e1a-e277-465a-b9b1-abee4885ed30 req-45a29512-a021-4ca3-836d-a39f6ae9dc5c tempest-TestServerVolumeAttachmentScenario-787785620 None] attachment_update completed successfully.
Jul 10 12:57:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-e3a91a4c-82b1-4c48-9e72-0895b3bcabac req-a9aaab4e-78e2-4783-b7dd-06f25301a404 tempest-TestStampPattern-290201722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:57:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-e3a91a4c-82b1-4c48-9e72-0895b3bcabac req-a9aaab4e-78e2-4783-b7dd-06f25301a404 tempest-TestStampPattern-290201722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:57:23 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbc4cb2-29b2-444e-8c7a-3efa56d2a622]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:57:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-e3a91a4c-82b1-4c48-9e72-0895b3bcabac req-a9aaab4e-78e2-4783-b7dd-06f25301a404 tempest-TestStampPattern-290201722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:57:23 devstack sudo[104713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d
Jul 10 12:57:23 devstack sudo[104713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:57:24 devstack sudo[104713]: pam_unix(sudo:session): session closed for user root
Jul 10 12:57:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-e3a91a4c-82b1-4c48-9e72-0895b3bcabac req-a9aaab4e-78e2-4783-b7dd-06f25301a404 tempest-TestStampPattern-290201722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d" returned: 0 in 0.770s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:57:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-e3a91a4c-82b1-4c48-9e72-0895b3bcabac req-a9aaab4e-78e2-4783-b7dd-06f25301a404 tempest-TestStampPattern-290201722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.786s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:57:24 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-e3a91a4c-82b1-4c48-9e72-0895b3bcabac req-a9aaab4e-78e2-4783-b7dd-06f25301a404 tempest-TestStampPattern-290201722 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be', 'name': 'volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a3008bb3-190b-4710-b235-e49807d41ce3', 'enforce_multipath': True} {{(pid=87378) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 10 12:57:24 devstack cinder-volume[87378]: INFO cinder.volume.manager [req-e3a91a4c-82b1-4c48-9e72-0895b3bcabac req-a9aaab4e-78e2-4783-b7dd-06f25301a404 tempest-TestStampPattern-290201722 None] attachment_update completed successfully.
Jul 10 12:57:27 devstack cinder-volume[87378]: INFO cinder.volume.manager [req-4de67b37-b065-4f5d-8530-79ac897e72f7 req-fa2278b0-9159-4330-9031-78ec87921b61 tempest-TestServerVolumeAttachmentScenario-787785620 None] Terminate volume connection completed successfully.
Jul 10 12:57:27 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-4de67b37-b065-4f5d-8530-79ac897e72f7 req-fa2278b0-9159-4330-9031-78ec87921b61 tempest-TestServerVolumeAttachmentScenario-787785620 None] Deleting attachment 5bc2eb48-fa3c-40b9-b114-d6d73f3088e6. {{(pid=87378) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 10 12:57:31 devstack cinder-volume[87378]: INFO cinder.volume.manager [req-d98c7ce1-05b8-4b34-9cf9-b93a4df300dc req-eee7c883-6909-4100-a376-0605832dc79e tempest-TestServerVolumeAttachmentScenario-787785620 None] Terminate volume connection completed successfully.
Jul 10 12:57:31 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-d98c7ce1-05b8-4b34-9cf9-b93a4df300dc req-eee7c883-6909-4100-a376-0605832dc79e tempest-TestServerVolumeAttachmentScenario-787785620 None] Deleting attachment 90d73fba-9b6e-477c-bf9c-a54f2ddcb234. {{(pid=87378) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 10 12:57:32 devstack cinder-volume[87378]: INFO cinder.volume.manager [req-40424c02-6c13-4f26-8603-5b96c92b84ec req-cedc3478-4e08-4870-a786-691bf62bc4bc tempest-TestStampPattern-290201722 None] Terminate volume connection completed successfully.
Jul 10 12:57:32 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-40424c02-6c13-4f26-8603-5b96c92b84ec req-cedc3478-4e08-4870-a786-691bf62bc4bc tempest-TestStampPattern-290201722 None] Deleting attachment a3008bb3-190b-4710-b235-e49807d41ce3. {{(pid=87378) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 10 12:57:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-118b9442-698d-4308-becd-01f393f4ff2d tempest-TestStampPattern-290201722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:57:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-118b9442-698d-4308-becd-01f393f4ff2d tempest-TestStampPattern-290201722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:57:34 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-118b9442-698d-4308-becd-01f393f4ff2d tempest-TestStampPattern-290201722 None] Creating offline snapshot c58de987-32f5-457b-b7c8-032acb66b318 of volume 87b6f1ae-2c78-4afe-a4a1-25675f03f58d {{(pid=87378) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 10 12:57:34 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3943ef5c-2167-4efb-b918-b648b6f62e68]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:57:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-118b9442-698d-4308-becd-01f393f4ff2d tempest-TestStampPattern-290201722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:57:34 devstack sudo[104815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d
Jul 10 12:57:34 devstack sudo[104815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:57:35 devstack sudo[104815]: pam_unix(sudo:session): session closed for user root
Jul 10 12:57:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-118b9442-698d-4308-becd-01f393f4ff2d tempest-TestStampPattern-290201722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d" returned: 0 in 0.881s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:57:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-118b9442-698d-4308-becd-01f393f4ff2d tempest-TestStampPattern-290201722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d.c58de987-32f5-457b-b7c8-032acb66b318 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:57:35 devstack sudo[104845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d.c58de987-32f5-457b-b7c8-032acb66b318 1G
Jul 10 12:57:35 devstack sudo[104845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:57:36 devstack sudo[104845]: pam_unix(sudo:session): session closed for user root
Jul 10 12:57:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-118b9442-698d-4308-becd-01f393f4ff2d tempest-TestStampPattern-290201722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d.c58de987-32f5-457b-b7c8-032acb66b318 1G" returned: 0 in 0.930s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:57:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-118b9442-698d-4308-becd-01f393f4ff2d tempest-TestStampPattern-290201722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d.c58de987-32f5-457b-b7c8-032acb66b318 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:57:36 devstack sudo[104857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d.c58de987-32f5-457b-b7c8-032acb66b318
Jul 10 12:57:36 devstack sudo[104857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:57:37 devstack sudo[104857]: pam_unix(sudo:session): session closed for user root
Jul 10 12:57:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-118b9442-698d-4308-becd-01f393f4ff2d tempest-TestStampPattern-290201722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d.c58de987-32f5-457b-b7c8-032acb66b318" returned: 0 in 0.766s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:57:37 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-118b9442-698d-4308-becd-01f393f4ff2d tempest-TestStampPattern-290201722 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d.c58de987-32f5-457b-b7c8-032acb66b318 is being set with open permissions: ugo+rw
Jul 10 12:57:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-118b9442-698d-4308-becd-01f393f4ff2d tempest-TestStampPattern-290201722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d.c58de987-32f5-457b-b7c8-032acb66b318 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:57:37 devstack sudo[104863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d.c58de987-32f5-457b-b7c8-032acb66b318
Jul 10 12:57:37 devstack sudo[104863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:57:37 devstack sudo[104863]: pam_unix(sudo:session): session closed for user root
Jul 10 12:57:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-118b9442-698d-4308-becd-01f393f4ff2d tempest-TestStampPattern-290201722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d.c58de987-32f5-457b-b7c8-032acb66b318" returned: 0 in 0.656s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:57:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-118b9442-698d-4308-becd-01f393f4ff2d tempest-TestStampPattern-290201722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:57:37 devstack sudo[104866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d.info
Jul 10 12:57:37 devstack sudo[104866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:57:38 devstack sudo[104866]: pam_unix(sudo:session): session closed for user root
Jul 10 12:57:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-118b9442-698d-4308-becd-01f393f4ff2d tempest-TestStampPattern-290201722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d.info" returned: 0 in 0.643s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:57:38 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-118b9442-698d-4308-becd-01f393f4ff2d tempest-TestStampPattern-290201722 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d.info is being set with open permissions: ugo+rw
Jul 10 12:57:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-118b9442-698d-4308-becd-01f393f4ff2d tempest-TestStampPattern-290201722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:57:38 devstack sudo[104869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d.info
Jul 10 12:57:38 devstack sudo[104869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:57:39 devstack sudo[104869]: pam_unix(sudo:session): session closed for user root
Jul 10 12:57:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-118b9442-698d-4308-becd-01f393f4ff2d tempest-TestStampPattern-290201722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d.info" returned: 0 in 0.662s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:57:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-118b9442-698d-4308-becd-01f393f4ff2d tempest-TestStampPattern-290201722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.632s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:57:39 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-118b9442-698d-4308-becd-01f393f4ff2d tempest-TestStampPattern-290201722 None] Create snapshot completed successfully
Jul 10 12:57:41 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-39a045e6-d49a-4a1b-9c4c-44ac6e355468 tempest-TestServerVolumeAttachmentScenario-787785620 None] Acquiring lock "cinder-9185dce5-2fe5-42e4-ab7b-a9994a16b12d-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:57:41 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-39a045e6-d49a-4a1b-9c4c-44ac6e355468 tempest-TestServerVolumeAttachmentScenario-787785620 None] Lock "cinder-9185dce5-2fe5-42e4-ab7b-a9994a16b12d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:57:41 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-39a045e6-d49a-4a1b-9c4c-44ac6e355468 tempest-TestServerVolumeAttachmentScenario-787785620 None] Acquiring lock "cinder-quobyte-9185dce5-2fe5-42e4-ab7b-a9994a16b12d" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:57:41 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-39a045e6-d49a-4a1b-9c4c-44ac6e355468 tempest-TestServerVolumeAttachmentScenario-787785620 None] Lock "cinder-quobyte-9185dce5-2fe5-42e4-ab7b-a9994a16b12d" acquired by "delete_volume" :: waited 0.019s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:57:41 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ee124c-7f36-4416-8330-826288e804d0]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:57:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-39a045e6-d49a-4a1b-9c4c-44ac6e355468 tempest-TestServerVolumeAttachmentScenario-787785620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9185dce5-2fe5-42e4-ab7b-a9994a16b12d {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:57:41 devstack sudo[104873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9185dce5-2fe5-42e4-ab7b-a9994a16b12d
Jul 10 12:57:41 devstack sudo[104873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:57:42 devstack sudo[104873]: pam_unix(sudo:session): session closed for user root
Jul 10 12:57:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-39a045e6-d49a-4a1b-9c4c-44ac6e355468 tempest-TestServerVolumeAttachmentScenario-787785620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9185dce5-2fe5-42e4-ab7b-a9994a16b12d" returned: 0 in 0.795s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:57:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-39a045e6-d49a-4a1b-9c4c-44ac6e355468 tempest-TestServerVolumeAttachmentScenario-787785620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9185dce5-2fe5-42e4-ab7b-a9994a16b12d {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:57:42 devstack sudo[104878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9185dce5-2fe5-42e4-ab7b-a9994a16b12d
Jul 10 12:57:42 devstack sudo[104878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:57:43 devstack sudo[104878]: pam_unix(sudo:session): session closed for user root
Jul 10 12:57:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-39a045e6-d49a-4a1b-9c4c-44ac6e355468 tempest-TestServerVolumeAttachmentScenario-787785620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9185dce5-2fe5-42e4-ab7b-a9994a16b12d" returned: 0 in 0.639s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:57:43 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-39a045e6-d49a-4a1b-9c4c-44ac6e355468 tempest-TestServerVolumeAttachmentScenario-787785620 None] Lock "cinder-quobyte-9185dce5-2fe5-42e4-ab7b-a9994a16b12d" released by "delete_volume" :: held 1.475s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:57:43 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-39a045e6-d49a-4a1b-9c4c-44ac6e355468 tempest-TestServerVolumeAttachmentScenario-787785620 None] Created reservations ['4b27e823-b3b5-4738-9304-3427fc73cf8d', 'f1ef6a0f-9e92-422d-bc4c-4f77a01b314e', '845a0709-9d06-4fb0-9641-9eb4e31730ce', 'd55e1d62-7e77-4a06-9549-ae5fdcb6aa5f'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:57:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-39a045e6-d49a-4a1b-9c4c-44ac6e355468 tempest-TestServerVolumeAttachmentScenario-787785620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:57:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-39a045e6-d49a-4a1b-9c4c-44ac6e355468 tempest-TestServerVolumeAttachmentScenario-787785620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:57:43 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-39a045e6-d49a-4a1b-9c4c-44ac6e355468 tempest-TestServerVolumeAttachmentScenario-787785620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:57:43 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-39a045e6-d49a-4a1b-9c4c-44ac6e355468 tempest-TestServerVolumeAttachmentScenario-787785620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:57:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-39a045e6-d49a-4a1b-9c4c-44ac6e355468 tempest-TestServerVolumeAttachmentScenario-787785620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:57:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-39a045e6-d49a-4a1b-9c4c-44ac6e355468 tempest-TestServerVolumeAttachmentScenario-787785620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:57:43 devstack sudo[104881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:57:43 devstack sudo[104881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:57:43 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-a13b5194-377b-4a60-a92c-b26960a8b947 tempest-TestServerVolumeAttachmentScenario-787785620 None] Acquiring lock "cinder-86e07abd-1b6d-4851-8ac6-31c989f36305-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:57:43 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-a13b5194-377b-4a60-a92c-b26960a8b947 tempest-TestServerVolumeAttachmentScenario-787785620 None] Lock "cinder-86e07abd-1b6d-4851-8ac6-31c989f36305-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:57:43 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-a13b5194-377b-4a60-a92c-b26960a8b947 tempest-TestServerVolumeAttachmentScenario-787785620 None] Acquiring lock "cinder-quobyte-86e07abd-1b6d-4851-8ac6-31c989f36305" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:57:43 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-a13b5194-377b-4a60-a92c-b26960a8b947 tempest-TestServerVolumeAttachmentScenario-787785620 None] Lock "cinder-quobyte-86e07abd-1b6d-4851-8ac6-31c989f36305" acquired by "delete_volume" :: waited 0.021s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:57:43 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb49b0e-7d44-4118-b64f-77ea43523c1b]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:57:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a13b5194-377b-4a60-a92c-b26960a8b947 tempest-TestServerVolumeAttachmentScenario-787785620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-86e07abd-1b6d-4851-8ac6-31c989f36305 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:57:43 devstack sudo[104881]: pam_unix(sudo:session): session closed for user root
Jul 10 12:57:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-39a045e6-d49a-4a1b-9c4c-44ac6e355468 tempest-TestServerVolumeAttachmentScenario-787785620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.666s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:57:43 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-39a045e6-d49a-4a1b-9c4c-44ac6e355468 tempest-TestServerVolumeAttachmentScenario-787785620 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:57:43 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-39a045e6-d49a-4a1b-9c4c-44ac6e355468 tempest-TestServerVolumeAttachmentScenario-787785620 None] Deleted volume successfully.
Jul 10 12:57:43 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-39a045e6-d49a-4a1b-9c4c-44ac6e355468 tempest-TestServerVolumeAttachmentScenario-787785620 None] Lock "cinder-9185dce5-2fe5-42e4-ab7b-a9994a16b12d-delete_volume" released by "delete_volume" :: held 2.379s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:57:43 devstack sudo[104884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-86e07abd-1b6d-4851-8ac6-31c989f36305
Jul 10 12:57:43 devstack sudo[104884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:57:44 devstack sudo[104884]: pam_unix(sudo:session): session closed for user root
Jul 10 12:57:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a13b5194-377b-4a60-a92c-b26960a8b947 tempest-TestServerVolumeAttachmentScenario-787785620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-86e07abd-1b6d-4851-8ac6-31c989f36305" returned: 0 in 0.791s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:57:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a13b5194-377b-4a60-a92c-b26960a8b947 tempest-TestServerVolumeAttachmentScenario-787785620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-86e07abd-1b6d-4851-8ac6-31c989f36305 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:57:44 devstack sudo[104912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-86e07abd-1b6d-4851-8ac6-31c989f36305
Jul 10 12:57:44 devstack sudo[104912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:57:45 devstack sudo[104912]: pam_unix(sudo:session): session closed for user root
Jul 10 12:57:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a13b5194-377b-4a60-a92c-b26960a8b947 tempest-TestServerVolumeAttachmentScenario-787785620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-86e07abd-1b6d-4851-8ac6-31c989f36305" returned: 0 in 0.652s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:57:45 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-a13b5194-377b-4a60-a92c-b26960a8b947 tempest-TestServerVolumeAttachmentScenario-787785620 None] Lock "cinder-quobyte-86e07abd-1b6d-4851-8ac6-31c989f36305" released by "delete_volume" :: held 1.490s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:57:45 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-a13b5194-377b-4a60-a92c-b26960a8b947 tempest-TestServerVolumeAttachmentScenario-787785620 None] Created reservations ['02db5ecb-ab14-40cd-8387-f214efc96ec9', '30e6b3c2-a662-4774-adbe-7cf1f6e5dcd2', '098e5b4b-38e0-4068-b046-fd90c8bccda3', '300a1c16-5991-407c-9b04-c405e606b4ff'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:57:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a13b5194-377b-4a60-a92c-b26960a8b947 tempest-TestServerVolumeAttachmentScenario-787785620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:57:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a13b5194-377b-4a60-a92c-b26960a8b947 tempest-TestServerVolumeAttachmentScenario-787785620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:57:45 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-a13b5194-377b-4a60-a92c-b26960a8b947 tempest-TestServerVolumeAttachmentScenario-787785620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:57:45 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-a13b5194-377b-4a60-a92c-b26960a8b947 tempest-TestServerVolumeAttachmentScenario-787785620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:57:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a13b5194-377b-4a60-a92c-b26960a8b947 tempest-TestServerVolumeAttachmentScenario-787785620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:57:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a13b5194-377b-4a60-a92c-b26960a8b947 tempest-TestServerVolumeAttachmentScenario-787785620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:57:45 devstack sudo[104923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:57:45 devstack sudo[104923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:57:46 devstack sudo[104923]: pam_unix(sudo:session): session closed for user root
Jul 10 12:57:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a13b5194-377b-4a60-a92c-b26960a8b947 tempest-TestServerVolumeAttachmentScenario-787785620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.686s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:57:46 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-a13b5194-377b-4a60-a92c-b26960a8b947 tempest-TestServerVolumeAttachmentScenario-787785620 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:57:46 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-a13b5194-377b-4a60-a92c-b26960a8b947 tempest-TestServerVolumeAttachmentScenario-787785620 None] Deleted volume successfully.
Jul 10 12:57:46 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-a13b5194-377b-4a60-a92c-b26960a8b947 tempest-TestServerVolumeAttachmentScenario-787785620 None] Lock "cinder-86e07abd-1b6d-4851-8ac6-31c989f36305-delete_volume" released by "delete_volume" :: held 2.373s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:57:49 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:57:49 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] Flow 'volume_create_manager' (267c3a64-107a-4b1e-84e9-fcc3e37a7b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:57:49 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2ab8e99-27f1-4ef5-8230-e334287a7dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:57:49 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2ab8e99-27f1-4ef5-8230-e334287a7dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:57:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-162372603',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc1abd85-c46a-4120-bfc0-5764943a3c18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb44f66040cc4aff909da7cf68180024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:57:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c58de987-32f5-457b-b7c8-032acb66b318,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:57:50Z,use_quota=True,user_id='d7fd951f03ef4508ab8bcf591b1757f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:57:49 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a07fef86-2d90-47ee-83b3-80b16c84c826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:57:49 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a07fef86-2d90-47ee-83b3-80b16c84c826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:57:49 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a797226-43d7-4ca6-9d34-be00ee5e8c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:57:49 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a797226-43d7-4ca6-9d34-be00ee5e8c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dc1abd85-c46a-4120-bfc0-5764943a3c18', 'volume_name': 'volume-dc1abd85-c46a-4120-bfc0-5764943a3c18', 'volume_size': 1, 'snapshot_id': 'c58de987-32f5-457b-b7c8-032acb66b318'}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:57:49 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2ee16ad-533c-47ce-904d-290becf49019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:57:49 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2ee16ad-533c-47ce-904d-290becf49019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:57:49 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a4dc1bf-f4c1-49b0-a417-40d0f0b105aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:57:49 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] Volume dc1abd85-c46a-4120-bfc0-5764943a3c18: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dc1abd85-c46a-4120-bfc0-5764943a3c18', 'volume_size': 1, 'snapshot_id': 'c58de987-32f5-457b-b7c8-032acb66b318'}
Jul 10 12:57:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:57:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:57:49 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] Acquiring lock "cinder-quobyte-c58de987-32f5-457b-b7c8-032acb66b318-dc1abd85-c46a-4120-bfc0-5764943a3c18" by "_create_volume_from_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:57:49 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] Lock "cinder-quobyte-c58de987-32f5-457b-b7c8-032acb66b318-dc1abd85-c46a-4120-bfc0-5764943a3c18" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:57:49 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] Creating volume dc1abd85-c46a-4120-bfc0-5764943a3c18 from snapshot c58de987-32f5-457b-b7c8-032acb66b318 {{(pid=87378) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 10 12:57:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:57:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:57:49 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:57:49 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:57:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:57:49 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:57:49 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] Acquiring lock "cinder-quobyte-dc1abd85-c46a-4120-bfc0-5764943a3c18" by "_copy_volume_from_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:57:49 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] Lock "cinder-quobyte-dc1abd85-c46a-4120-bfc0-5764943a3c18" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:57:49 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] snapshot: c58de987-32f5-457b-b7c8-032acb66b318, volume: dc1abd85-c46a-4120-bfc0-5764943a3c18,  {{(pid=87378) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 10 12:57:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:57:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:57:49 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:57:49 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:57:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:57:49 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83f5012-e5c9-42cd-8407-ef4bb3d27973]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:57:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d.c58de987-32f5-457b-b7c8-032acb66b318 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:57:50 devstack sudo[104929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d.c58de987-32f5-457b-b7c8-032acb66b318
Jul 10 12:57:50 devstack sudo[104929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:57:50 devstack sudo[104929]: pam_unix(sudo:session): session closed for user root
Jul 10 12:57:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d.c58de987-32f5-457b-b7c8-032acb66b318" returned: 0 in 0.893s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:57:50 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:57:50 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] will copy from snapshot at /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d {{(pid=87378) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 10 12:57:50 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] Creating direct copy from snapshot {{(pid=87378) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 10 12:57:50 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3665099-2864-495a-bc75-8a27276c9c81]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:57:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:57:50 devstack sudo[104937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d
Jul 10 12:57:50 devstack sudo[104937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:57:51 devstack sudo[104937]: pam_unix(sudo:session): session closed for user root
Jul 10 12:57:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d" returned: 0 in 0.850s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:57:51 devstack cinder-volume[87378]: DEBUG cinder.utils [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] Path /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-dc1abd85-c46a-4120-bfc0-5764943a3c18 not found in is_blk_device check {{(pid=87378) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 10 12:57:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-dc1abd85-c46a-4120-bfc0-5764943a3c18 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:57:51 devstack sudo[104943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-dc1abd85-c46a-4120-bfc0-5764943a3c18
Jul 10 12:57:51 devstack sudo[104943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:57:58 devstack sudo[104943]: pam_unix(sudo:session): session closed for user root
Jul 10 12:57:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-dc1abd85-c46a-4120-bfc0-5764943a3c18" returned: 0 in 6.362s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:57:58 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6560d141-fcf6-488d-9f7b-d9e8d986ded5]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:57:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:57:58 devstack sudo[104958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d
Jul 10 12:57:58 devstack sudo[104958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:57:59 devstack sudo[104958]: pam_unix(sudo:session): session closed for user root
Jul 10 12:57:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d" returned: 0 in 1.170s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:57:59 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] Image conversion details: src /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d, size 1024.00 MB, duration 6.36 sec, destination /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-dc1abd85-c46a-4120-bfc0-5764943a3c18 {{(pid=87378) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 10 12:57:59 devstack cinder-volume[87378]: INFO cinder.image.image_utils [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] Converted 1024.00 MB image at 160.93 MB/s
Jul 10 12:57:59 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-dc1abd85-c46a-4120-bfc0-5764943a3c18 is being set with open permissions: ugo+rw
Jul 10 12:57:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-dc1abd85-c46a-4120-bfc0-5764943a3c18 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:57:59 devstack sudo[104965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-dc1abd85-c46a-4120-bfc0-5764943a3c18
Jul 10 12:57:59 devstack sudo[104965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:57:59 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:SELECT=36,cinder:UPDATE=23,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:57:59 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:SELECT=34,cinder:UPDATE=22,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:58:00 devstack sudo[104965]: pam_unix(sudo:session): session closed for user root
Jul 10 12:58:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-dc1abd85-c46a-4120-bfc0-5764943a3c18" returned: 0 in 0.805s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:58:00 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] Lock "cinder-quobyte-dc1abd85-c46a-4120-bfc0-5764943a3c18" released by "_copy_volume_from_snapshot" :: held 10.205s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:58:00 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] Lock "cinder-quobyte-c58de987-32f5-457b-b7c8-032acb66b318-dc1abd85-c46a-4120-bfc0-5764943a3c18" released by "_create_volume_from_snapshot" :: held 10.246s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:58:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.269s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:58:00 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a4dc1bf-f4c1-49b0-a417-40d0f0b105aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc1abd85-c46a-4120-bfc0-5764943a3c18', 'volume_size': 1, 'snapshot_id': 'c58de987-32f5-457b-b7c8-032acb66b318'}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:58:00 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a09c9365-2cb4-4d48-a2ae-dead05f6b396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:58:00 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] Volume volume-dc1abd85-c46a-4120-bfc0-5764943a3c18 (dc1abd85-c46a-4120-bfc0-5764943a3c18): created successfully
Jul 10 12:58:00 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a09c9365-2cb4-4d48-a2ae-dead05f6b396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:58:00 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] Flow 'volume_create_manager' (267c3a64-107a-4b1e-84e9-fcc3e37a7b89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:58:00 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-23017753-8d3f-4c57-af71-5581e8fa9e82 tempest-TestStampPattern-290201722 None] Created volume successfully.
Jul 10 12:58:10 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:58:10 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:UPDATE=1,cinder:DELETE=1 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:58:12 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:58:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:58:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:58:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:58:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:58:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:58:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:58:13 devstack sudo[105040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:58:13 devstack sudo[105040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:58:13 devstack sudo[105040]: pam_unix(sudo:session): session closed for user root
Jul 10 12:58:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.682s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:58:13 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:58:13 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager._thread_info {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:58:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread count: 28 {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 10 12:58:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread info: [<_MainThread(MainThread, started 128233544536192)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128233445424704)>, <Thread(Thread-3 (stat_writer), started daemon 128233435118528)>, <Thread(Rabbit-heartbeat, started daemon 128233435718016)>, <Thread(Thread-5 (_runner), started daemon 128233432624448)>, <Thread(Thread-7 (_runner), started daemon 128233432674688)>, <Thread(fd_logger, started daemon 128233428569472)>, <Thread(privsep_reader, started daemon 128233429417088)>, <Thread(tpool_thread_0, started daemon 128233421182656)>, <Thread(tpool_thread_1, started daemon 128233412789952)>, <Thread(tpool_thread_2, started daemon 128233404397248)>, <Thread(tpool_thread_3, started daemon 128233396004544)>, <Thread(tpool_thread_4, started daemon 128233387611840)>, <Thread(tpool_thread_5, started daemon 128233379219136)>, <Thread(tpool_thread_6, started daemon 128233370826432)>, <Thread(tpool_thread_7, started daemon 128233362433728)>, <Thread(tpool_thread_8, started daemon 128233354041024)>, <Thread(tpool_thread_9, started daemon 128233345631936)>, <Thread(tpool_thread_10, started daemon 128233337222848)>, <Thread(tpool_thread_11, started daemon 128233328813760)>, <Thread(tpool_thread_12, started daemon 128233320404672)>, <Thread(tpool_thread_13, started daemon 128233311995584)>, <Thread(tpool_thread_14, started daemon 128233303586496)>, <Thread(tpool_thread_15, started daemon 128233295177408)>, <Thread(tpool_thread_16, started daemon 128233286768320)>, <Thread(tpool_thread_17, started daemon 128233278359232)>, <Thread(tpool_thread_18, started daemon 128233269950144)>, <Thread(tpool_thread_19, started daemon 128233261541056)>] {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 10 12:58:30 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:SELECT=1 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:58:30 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:UPDATE=1 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:58:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-2da124ae-2f4e-4619-97a9-f904625f7567 req-2fe48a2d-3b71-4c06-9765-af5f826dc0ec tempest-TestStampPattern-290201722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:58:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-2da124ae-2f4e-4619-97a9-f904625f7567 req-2fe48a2d-3b71-4c06-9765-af5f826dc0ec tempest-TestStampPattern-290201722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:58:48 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a999b4-e174-4099-a1a6-f9987e2c9cc0]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:58:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-2da124ae-2f4e-4619-97a9-f904625f7567 req-2fe48a2d-3b71-4c06-9765-af5f826dc0ec tempest-TestStampPattern-290201722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-dc1abd85-c46a-4120-bfc0-5764943a3c18 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:58:48 devstack sudo[105132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-dc1abd85-c46a-4120-bfc0-5764943a3c18
Jul 10 12:58:48 devstack sudo[105132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:58:49 devstack sudo[105132]: pam_unix(sudo:session): session closed for user root
Jul 10 12:58:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [req-2da124ae-2f4e-4619-97a9-f904625f7567 req-2fe48a2d-3b71-4c06-9765-af5f826dc0ec tempest-TestStampPattern-290201722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-dc1abd85-c46a-4120-bfc0-5764943a3c18" returned: 0 in 0.761s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:58:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [req-2da124ae-2f4e-4619-97a9-f904625f7567 req-2fe48a2d-3b71-4c06-9765-af5f826dc0ec tempest-TestStampPattern-290201722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.778s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:58:49 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-2da124ae-2f4e-4619-97a9-f904625f7567 req-2fe48a2d-3b71-4c06-9765-af5f826dc0ec tempest-TestStampPattern-290201722 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be', 'name': 'volume-dc1abd85-c46a-4120-bfc0-5764943a3c18', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '750e1634-8cc9-426d-a10d-d36aff83b41f', 'enforce_multipath': True} {{(pid=87378) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 10 12:58:49 devstack cinder-volume[87378]: INFO cinder.volume.manager [req-2da124ae-2f4e-4619-97a9-f904625f7567 req-2fe48a2d-3b71-4c06-9765-af5f826dc0ec tempest-TestStampPattern-290201722 None] attachment_update completed successfully.
Jul 10 12:58:55 devstack cinder-volume[87378]: INFO cinder.volume.manager [req-4618a815-96e5-4047-91ef-63e415b9ef69 req-6facdda8-351a-4397-8ecf-4c448bba566c tempest-TestStampPattern-290201722 None] Terminate volume connection completed successfully.
Jul 10 12:58:55 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [req-4618a815-96e5-4047-91ef-63e415b9ef69 req-6facdda8-351a-4397-8ecf-4c448bba566c tempest-TestStampPattern-290201722 None] Deleting attachment 750e1634-8cc9-426d-a10d-d36aff83b41f. {{(pid=87378) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 10 12:59:05 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-7a93fee6-947c-414b-92db-b7540563478b tempest-TestStampPattern-290201722 None] Acquiring lock "cinder-dc1abd85-c46a-4120-bfc0-5764943a3c18-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:59:05 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-7a93fee6-947c-414b-92db-b7540563478b tempest-TestStampPattern-290201722 None] Lock "cinder-dc1abd85-c46a-4120-bfc0-5764943a3c18-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:59:05 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-7a93fee6-947c-414b-92db-b7540563478b tempest-TestStampPattern-290201722 None] Acquiring lock "cinder-quobyte-dc1abd85-c46a-4120-bfc0-5764943a3c18" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:59:05 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-7a93fee6-947c-414b-92db-b7540563478b tempest-TestStampPattern-290201722 None] Lock "cinder-quobyte-dc1abd85-c46a-4120-bfc0-5764943a3c18" acquired by "delete_volume" :: waited 0.019s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:59:05 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7fddf5-0b25-4d62-a4b2-78a2a3f2db69]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:59:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7a93fee6-947c-414b-92db-b7540563478b tempest-TestStampPattern-290201722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-dc1abd85-c46a-4120-bfc0-5764943a3c18 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:59:05 devstack sudo[105596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-dc1abd85-c46a-4120-bfc0-5764943a3c18
Jul 10 12:59:05 devstack sudo[105596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:59:06 devstack sudo[105596]: pam_unix(sudo:session): session closed for user root
Jul 10 12:59:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7a93fee6-947c-414b-92db-b7540563478b tempest-TestStampPattern-290201722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-dc1abd85-c46a-4120-bfc0-5764943a3c18" returned: 0 in 0.752s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:59:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7a93fee6-947c-414b-92db-b7540563478b tempest-TestStampPattern-290201722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-dc1abd85-c46a-4120-bfc0-5764943a3c18 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:59:06 devstack sudo[105601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-dc1abd85-c46a-4120-bfc0-5764943a3c18
Jul 10 12:59:06 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:59:07 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root
Jul 10 12:59:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7a93fee6-947c-414b-92db-b7540563478b tempest-TestStampPattern-290201722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-dc1abd85-c46a-4120-bfc0-5764943a3c18" returned: 0 in 0.629s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:59:07 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-7a93fee6-947c-414b-92db-b7540563478b tempest-TestStampPattern-290201722 None] Lock "cinder-quobyte-dc1abd85-c46a-4120-bfc0-5764943a3c18" released by "delete_volume" :: held 1.421s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:59:07 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-7a93fee6-947c-414b-92db-b7540563478b tempest-TestStampPattern-290201722 None] Created reservations ['f2d9525d-90a3-454f-936c-51eddf8f6caa', '1495fc1b-db7f-4edd-83ae-8b7a03204687', '962acdc2-1158-4a9d-81f0-b3daa82923c5', '44f49e33-1ba6-4b0b-885e-505ebcc57d0e'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:59:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-7a93fee6-947c-414b-92db-b7540563478b tempest-TestStampPattern-290201722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:59:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-7a93fee6-947c-414b-92db-b7540563478b tempest-TestStampPattern-290201722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:59:07 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-7a93fee6-947c-414b-92db-b7540563478b tempest-TestStampPattern-290201722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:59:07 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-7a93fee6-947c-414b-92db-b7540563478b tempest-TestStampPattern-290201722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:59:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-7a93fee6-947c-414b-92db-b7540563478b tempest-TestStampPattern-290201722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:59:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7a93fee6-947c-414b-92db-b7540563478b tempest-TestStampPattern-290201722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:59:07 devstack sudo[105604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:59:07 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:59:07 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root
Jul 10 12:59:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7a93fee6-947c-414b-92db-b7540563478b tempest-TestStampPattern-290201722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.658s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:59:07 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-7a93fee6-947c-414b-92db-b7540563478b tempest-TestStampPattern-290201722 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:59:07 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-7a93fee6-947c-414b-92db-b7540563478b tempest-TestStampPattern-290201722 None] Deleted volume successfully.
Jul 10 12:59:07 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-7a93fee6-947c-414b-92db-b7540563478b tempest-TestStampPattern-290201722 None] Lock "cinder-dc1abd85-c46a-4120-bfc0-5764943a3c18-delete_volume" released by "delete_volume" :: held 2.266s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:59:08 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-2fdf6d13-013e-4179-8448-98579eb9f549 tempest-TestStampPattern-290201722 None] Acquiring lock "cinder-c58de987-32f5-457b-b7c8-032acb66b318-delete_snapshot" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:59:08 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-2fdf6d13-013e-4179-8448-98579eb9f549 tempest-TestStampPattern-290201722 None] Lock "cinder-c58de987-32f5-457b-b7c8-032acb66b318-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:59:08 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-2fdf6d13-013e-4179-8448-98579eb9f549 tempest-TestStampPattern-290201722 None] Acquiring lock "cinder-quobyte-87b6f1ae-2c78-4afe-a4a1-25675f03f58d" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:59:08 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-2fdf6d13-013e-4179-8448-98579eb9f549 tempest-TestStampPattern-290201722 None] Lock "cinder-quobyte-87b6f1ae-2c78-4afe-a4a1-25675f03f58d" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:59:08 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-2fdf6d13-013e-4179-8448-98579eb9f549 tempest-TestStampPattern-290201722 None] Acquiring lock "cinder-quobyte-c58de987-32f5-457b-b7c8-032acb66b318" by "_delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:59:08 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-2fdf6d13-013e-4179-8448-98579eb9f549 tempest-TestStampPattern-290201722 None] Lock "cinder-quobyte-c58de987-32f5-457b-b7c8-032acb66b318" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:59:08 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-2fdf6d13-013e-4179-8448-98579eb9f549 tempest-TestStampPattern-290201722 None] Deleting offline snapshot c58de987-32f5-457b-b7c8-032acb66b318 of volume 87b6f1ae-2c78-4afe-a4a1-25675f03f58d {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 10 12:59:08 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-2fdf6d13-013e-4179-8448-98579eb9f549 tempest-TestStampPattern-290201722 None] snapshot_file for this snap is: volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d.c58de987-32f5-457b-b7c8-032acb66b318 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 10 12:59:08 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b73c4d6-498d-49d2-ba6e-bd73ba3a911d]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:59:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2fdf6d13-013e-4179-8448-98579eb9f549 tempest-TestStampPattern-290201722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d.c58de987-32f5-457b-b7c8-032acb66b318 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:59:08 devstack sudo[105607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d.c58de987-32f5-457b-b7c8-032acb66b318
Jul 10 12:59:08 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:59:08 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root
Jul 10 12:59:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2fdf6d13-013e-4179-8448-98579eb9f549 tempest-TestStampPattern-290201722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d.c58de987-32f5-457b-b7c8-032acb66b318" returned: 0 in 0.739s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:59:08 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-2fdf6d13-013e-4179-8448-98579eb9f549 tempest-TestStampPattern-290201722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:59:08 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d3d89f-eb36-46e3-b576-6a37f87ab0fb]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:59:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2fdf6d13-013e-4179-8448-98579eb9f549 tempest-TestStampPattern-290201722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:59:09 devstack sudo[105612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d
Jul 10 12:59:09 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:59:09 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root
Jul 10 12:59:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2fdf6d13-013e-4179-8448-98579eb9f549 tempest-TestStampPattern-290201722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d" returned: 0 in 0.749s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:59:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2fdf6d13-013e-4179-8448-98579eb9f549 tempest-TestStampPattern-290201722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d.c58de987-32f5-457b-b7c8-032acb66b318 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:59:09 devstack sudo[105618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d.c58de987-32f5-457b-b7c8-032acb66b318
Jul 10 12:59:09 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:59:10 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root
Jul 10 12:59:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2fdf6d13-013e-4179-8448-98579eb9f549 tempest-TestStampPattern-290201722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d.c58de987-32f5-457b-b7c8-032acb66b318" returned: 0 in 0.718s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:59:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2fdf6d13-013e-4179-8448-98579eb9f549 tempest-TestStampPattern-290201722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d.c58de987-32f5-457b-b7c8-032acb66b318 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:59:10 devstack sudo[105623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d.c58de987-32f5-457b-b7c8-032acb66b318
Jul 10 12:59:10 devstack sudo[105623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:59:11 devstack sudo[105623]: pam_unix(sudo:session): session closed for user root
Jul 10 12:59:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2fdf6d13-013e-4179-8448-98579eb9f549 tempest-TestStampPattern-290201722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d.c58de987-32f5-457b-b7c8-032acb66b318" returned: 0 in 0.638s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:59:11 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-2fdf6d13-013e-4179-8448-98579eb9f549 tempest-TestStampPattern-290201722 None] Lock "cinder-quobyte-c58de987-32f5-457b-b7c8-032acb66b318" released by "_delete_snapshot" :: held 2.942s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:59:11 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-2fdf6d13-013e-4179-8448-98579eb9f549 tempest-TestStampPattern-290201722 None] Lock "cinder-quobyte-87b6f1ae-2c78-4afe-a4a1-25675f03f58d" released by "delete_snapshot" :: held 2.964s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:59:11 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-2fdf6d13-013e-4179-8448-98579eb9f549 tempest-TestStampPattern-290201722 None] Created reservations ['706eba03-7fcb-4e9e-8584-381d7b07865e', 'fb959eb6-0c0c-4ed1-adf8-54c0aee793fa', '2677eac3-3d1f-4698-9eb2-5131ffac919c', 'ba47a9c0-ce24-4651-9940-65ad173a5fe0'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:59:11 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-2fdf6d13-013e-4179-8448-98579eb9f549 tempest-TestStampPattern-290201722 None] Delete snapshot completed successfully.
Jul 10 12:59:11 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-2fdf6d13-013e-4179-8448-98579eb9f549 tempest-TestStampPattern-290201722 None] Lock "cinder-c58de987-32f5-457b-b7c8-032acb66b318-delete_snapshot" released by "delete_snapshot" :: held 3.093s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:59:12 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:59:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:59:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:59:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:59:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:59:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:59:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:59:13 devstack sudo[105629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:59:13 devstack sudo[105629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:59:13 devstack sudo[105629]: pam_unix(sudo:session): session closed for user root
Jul 10 12:59:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.650s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:59:13 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:59:13 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager._thread_info {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 12:59:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread count: 28 {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 10 12:59:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread info: [<_MainThread(MainThread, started 128233544536192)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128233445424704)>, <Thread(Thread-3 (stat_writer), started daemon 128233435118528)>, <Thread(Rabbit-heartbeat, started daemon 128233435718016)>, <Thread(Thread-5 (_runner), started daemon 128233432624448)>, <Thread(Thread-7 (_runner), started daemon 128233432674688)>, <Thread(fd_logger, started daemon 128233428569472)>, <Thread(privsep_reader, started daemon 128233429417088)>, <Thread(tpool_thread_0, started daemon 128233421182656)>, <Thread(tpool_thread_1, started daemon 128233412789952)>, <Thread(tpool_thread_2, started daemon 128233404397248)>, <Thread(tpool_thread_3, started daemon 128233396004544)>, <Thread(tpool_thread_4, started daemon 128233387611840)>, <Thread(tpool_thread_5, started daemon 128233379219136)>, <Thread(tpool_thread_6, started daemon 128233370826432)>, <Thread(tpool_thread_7, started daemon 128233362433728)>, <Thread(tpool_thread_8, started daemon 128233354041024)>, <Thread(tpool_thread_9, started daemon 128233345631936)>, <Thread(tpool_thread_10, started daemon 128233337222848)>, <Thread(tpool_thread_11, started daemon 128233328813760)>, <Thread(tpool_thread_12, started daemon 128233320404672)>, <Thread(tpool_thread_13, started daemon 128233311995584)>, <Thread(tpool_thread_14, started daemon 128233303586496)>, <Thread(tpool_thread_15, started daemon 128233295177408)>, <Thread(tpool_thread_16, started daemon 128233286768320)>, <Thread(tpool_thread_17, started daemon 128233278359232)>, <Thread(tpool_thread_18, started daemon 128233269950144)>, <Thread(tpool_thread_19, started daemon 128233261541056)>] {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 10 12:59:19 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-17b15131-dcf9-4c74-88d3-9888612b32de tempest-TestStampPattern-290201722 None] Acquiring lock "cinder-87b6f1ae-2c78-4afe-a4a1-25675f03f58d-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:59:19 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-17b15131-dcf9-4c74-88d3-9888612b32de tempest-TestStampPattern-290201722 None] Lock "cinder-87b6f1ae-2c78-4afe-a4a1-25675f03f58d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:59:19 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-17b15131-dcf9-4c74-88d3-9888612b32de tempest-TestStampPattern-290201722 None] Acquiring lock "cinder-quobyte-87b6f1ae-2c78-4afe-a4a1-25675f03f58d" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:59:19 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-17b15131-dcf9-4c74-88d3-9888612b32de tempest-TestStampPattern-290201722 None] Lock "cinder-quobyte-87b6f1ae-2c78-4afe-a4a1-25675f03f58d" acquired by "delete_volume" :: waited 0.016s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:59:19 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6a5c39-d341-42d2-a1f5-8a13742a0b42]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:59:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-17b15131-dcf9-4c74-88d3-9888612b32de tempest-TestStampPattern-290201722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:59:19 devstack sudo[105658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d
Jul 10 12:59:19 devstack sudo[105658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:59:20 devstack sudo[105658]: pam_unix(sudo:session): session closed for user root
Jul 10 12:59:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-17b15131-dcf9-4c74-88d3-9888612b32de tempest-TestStampPattern-290201722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d" returned: 0 in 0.748s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:59:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-17b15131-dcf9-4c74-88d3-9888612b32de tempest-TestStampPattern-290201722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:59:20 devstack sudo[105663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d
Jul 10 12:59:20 devstack sudo[105663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:59:20 devstack sudo[105663]: pam_unix(sudo:session): session closed for user root
Jul 10 12:59:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-17b15131-dcf9-4c74-88d3-9888612b32de tempest-TestStampPattern-290201722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-87b6f1ae-2c78-4afe-a4a1-25675f03f58d" returned: 0 in 0.616s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:59:20 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-17b15131-dcf9-4c74-88d3-9888612b32de tempest-TestStampPattern-290201722 None] Lock "cinder-quobyte-87b6f1ae-2c78-4afe-a4a1-25675f03f58d" released by "delete_volume" :: held 1.421s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:59:20 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-17b15131-dcf9-4c74-88d3-9888612b32de tempest-TestStampPattern-290201722 None] Created reservations ['92755e6a-9990-4f28-910f-9d3f6f85c855', 'bb496745-0ab8-4ed7-bfcd-717d890cdb8a', '2a7cc22b-4cbe-4fa8-b2e7-0908f0596e79', 'd37e6c41-903b-456e-af3a-b664e8f40a12'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:59:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-17b15131-dcf9-4c74-88d3-9888612b32de tempest-TestStampPattern-290201722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:59:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-17b15131-dcf9-4c74-88d3-9888612b32de tempest-TestStampPattern-290201722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:59:20 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-17b15131-dcf9-4c74-88d3-9888612b32de tempest-TestStampPattern-290201722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:59:20 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-17b15131-dcf9-4c74-88d3-9888612b32de tempest-TestStampPattern-290201722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:59:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-17b15131-dcf9-4c74-88d3-9888612b32de tempest-TestStampPattern-290201722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:59:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-17b15131-dcf9-4c74-88d3-9888612b32de tempest-TestStampPattern-290201722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:59:21 devstack sudo[105666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:59:21 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:59:21 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root
Jul 10 12:59:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-17b15131-dcf9-4c74-88d3-9888612b32de tempest-TestStampPattern-290201722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.647s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:59:21 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-17b15131-dcf9-4c74-88d3-9888612b32de tempest-TestStampPattern-290201722 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:59:21 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-17b15131-dcf9-4c74-88d3-9888612b32de tempest-TestStampPattern-290201722 None] Deleted volume successfully.
Jul 10 12:59:21 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-17b15131-dcf9-4c74-88d3-9888612b32de tempest-TestStampPattern-290201722 None] Lock "cinder-87b6f1ae-2c78-4afe-a4a1-25675f03f58d-delete_volume" released by "delete_volume" :: held 2.259s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:59:30 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:SELECT=24,cinder:UPDATE=25,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:59:31 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5a723f0-2695-444c-9eeb-883578dde5a0 tempest-VolumeDependencyTests-2125363277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:59:31 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a5a723f0-2695-444c-9eeb-883578dde5a0 tempest-VolumeDependencyTests-2125363277 None] Flow 'volume_create_manager' (6138d13a-f57f-449d-bab2-9c1f0359e166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:59:31 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a5a723f0-2695-444c-9eeb-883578dde5a0 tempest-VolumeDependencyTests-2125363277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f08f61d3-9966-4567-80b3-f29ec0d381d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:59:31 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a5a723f0-2695-444c-9eeb-883578dde5a0 tempest-VolumeDependencyTests-2125363277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f08f61d3-9966-4567-80b3-f29ec0d381d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:59:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1524027530',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0793660e-fb55-486f-93eb-f2551f745171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86025c9ae8cf40a2a2cf83eb4b4acdf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:59:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:59:31Z,use_quota=True,user_id='9d495030b65244a0b633b7ff15d20e28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:59:31 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a5a723f0-2695-444c-9eeb-883578dde5a0 tempest-VolumeDependencyTests-2125363277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (105fa91a-925d-4d11-8a7c-04fdba062c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:59:31 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a5a723f0-2695-444c-9eeb-883578dde5a0 tempest-VolumeDependencyTests-2125363277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (105fa91a-925d-4d11-8a7c-04fdba062c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:59:31 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a5a723f0-2695-444c-9eeb-883578dde5a0 tempest-VolumeDependencyTests-2125363277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d786e985-3c4c-4ee4-8b1e-b2ec8387aa3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:59:31 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a5a723f0-2695-444c-9eeb-883578dde5a0 tempest-VolumeDependencyTests-2125363277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d786e985-3c4c-4ee4-8b1e-b2ec8387aa3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0793660e-fb55-486f-93eb-f2551f745171', 'volume_name': 'volume-0793660e-fb55-486f-93eb-f2551f745171', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:59:31 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a5a723f0-2695-444c-9eeb-883578dde5a0 tempest-VolumeDependencyTests-2125363277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00e48489-47c3-4632-b323-cece5f091555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:59:31 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a5a723f0-2695-444c-9eeb-883578dde5a0 tempest-VolumeDependencyTests-2125363277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00e48489-47c3-4632-b323-cece5f091555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:59:31 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a5a723f0-2695-444c-9eeb-883578dde5a0 tempest-VolumeDependencyTests-2125363277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b445d785-a0d3-4aa6-abfd-3ac6839e7af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:59:31 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-a5a723f0-2695-444c-9eeb-883578dde5a0 tempest-VolumeDependencyTests-2125363277 None] Volume 0793660e-fb55-486f-93eb-f2551f745171: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0793660e-fb55-486f-93eb-f2551f745171', 'volume_size': 1}
Jul 10 12:59:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a5a723f0-2695-444c-9eeb-883578dde5a0 tempest-VolumeDependencyTests-2125363277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:59:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a5a723f0-2695-444c-9eeb-883578dde5a0 tempest-VolumeDependencyTests-2125363277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:59:31 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-a5a723f0-2695-444c-9eeb-883578dde5a0 tempest-VolumeDependencyTests-2125363277 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:59:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1524027530',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0793660e-fb55-486f-93eb-f2551f745171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86025c9ae8cf40a2a2cf83eb4b4acdf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:59:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:59:31Z,use_quota=True,user_id='9d495030b65244a0b633b7ff15d20e28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 12:59:31 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-a5a723f0-2695-444c-9eeb-883578dde5a0 tempest-VolumeDependencyTests-2125363277 None] Creating volume 0793660e-fb55-486f-93eb-f2551f745171 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 12:59:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a5a723f0-2695-444c-9eeb-883578dde5a0 tempest-VolumeDependencyTests-2125363277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:59:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a5a723f0-2695-444c-9eeb-883578dde5a0 tempest-VolumeDependencyTests-2125363277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:59:31 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-a5a723f0-2695-444c-9eeb-883578dde5a0 tempest-VolumeDependencyTests-2125363277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:59:31 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-a5a723f0-2695-444c-9eeb-883578dde5a0 tempest-VolumeDependencyTests-2125363277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:59:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a5a723f0-2695-444c-9eeb-883578dde5a0 tempest-VolumeDependencyTests-2125363277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:59:31 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-a5a723f0-2695-444c-9eeb-883578dde5a0 tempest-VolumeDependencyTests-2125363277 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:59:31 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-a5a723f0-2695-444c-9eeb-883578dde5a0 tempest-VolumeDependencyTests-2125363277 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 12:59:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a5a723f0-2695-444c-9eeb-883578dde5a0 tempest-VolumeDependencyTests-2125363277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:59:31 devstack sudo[105710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171 1073741824
Jul 10 12:59:31 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:59:32 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root
Jul 10 12:59:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a5a723f0-2695-444c-9eeb-883578dde5a0 tempest-VolumeDependencyTests-2125363277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171 1073741824" returned: 0 in 0.800s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:59:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a5a723f0-2695-444c-9eeb-883578dde5a0 tempest-VolumeDependencyTests-2125363277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:59:32 devstack sudo[105716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171
Jul 10 12:59:32 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:59:33 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root
Jul 10 12:59:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a5a723f0-2695-444c-9eeb-883578dde5a0 tempest-VolumeDependencyTests-2125363277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171" returned: 0 in 0.646s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:59:33 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-a5a723f0-2695-444c-9eeb-883578dde5a0 tempest-VolumeDependencyTests-2125363277 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 12:59:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a5a723f0-2695-444c-9eeb-883578dde5a0 tempest-VolumeDependencyTests-2125363277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:59:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a5a723f0-2695-444c-9eeb-883578dde5a0 tempest-VolumeDependencyTests-2125363277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b445d785-a0d3-4aa6-abfd-3ac6839e7af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0793660e-fb55-486f-93eb-f2551f745171', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:59:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a5a723f0-2695-444c-9eeb-883578dde5a0 tempest-VolumeDependencyTests-2125363277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f0f346f-e738-4aa6-8525-c43bb1e1a406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:59:33 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-a5a723f0-2695-444c-9eeb-883578dde5a0 tempest-VolumeDependencyTests-2125363277 None] Volume volume-0793660e-fb55-486f-93eb-f2551f745171 (0793660e-fb55-486f-93eb-f2551f745171): created successfully
Jul 10 12:59:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a5a723f0-2695-444c-9eeb-883578dde5a0 tempest-VolumeDependencyTests-2125363277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f0f346f-e738-4aa6-8525-c43bb1e1a406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:59:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a5a723f0-2695-444c-9eeb-883578dde5a0 tempest-VolumeDependencyTests-2125363277 None] Flow 'volume_create_manager' (6138d13a-f57f-449d-bab2-9c1f0359e166) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:59:33 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-a5a723f0-2695-444c-9eeb-883578dde5a0 tempest-VolumeDependencyTests-2125363277 None] Created volume successfully.
Jul 10 12:59:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3630f0b0-bd88-4eed-869e-47f1693b69d8 tempest-VolumeDependencyTests-2125363277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:59:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3630f0b0-bd88-4eed-869e-47f1693b69d8 tempest-VolumeDependencyTests-2125363277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:59:33 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-3630f0b0-bd88-4eed-869e-47f1693b69d8 tempest-VolumeDependencyTests-2125363277 None] Creating offline snapshot b1b724a8-5f05-479e-9790-31f37532130b of volume 0793660e-fb55-486f-93eb-f2551f745171 {{(pid=87378) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 10 12:59:33 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed56d07-7aa2-430f-8c47-a4a789dd8f7e]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:59:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3630f0b0-bd88-4eed-869e-47f1693b69d8 tempest-VolumeDependencyTests-2125363277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:59:33 devstack sudo[105719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171
Jul 10 12:59:33 devstack sudo[105719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:59:34 devstack sudo[105719]: pam_unix(sudo:session): session closed for user root
Jul 10 12:59:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3630f0b0-bd88-4eed-869e-47f1693b69d8 tempest-VolumeDependencyTests-2125363277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171" returned: 0 in 0.784s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:59:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3630f0b0-bd88-4eed-869e-47f1693b69d8 tempest-VolumeDependencyTests-2125363277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171.b1b724a8-5f05-479e-9790-31f37532130b 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:59:34 devstack sudo[105724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171.b1b724a8-5f05-479e-9790-31f37532130b 1G
Jul 10 12:59:34 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:59:35 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root
Jul 10 12:59:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3630f0b0-bd88-4eed-869e-47f1693b69d8 tempest-VolumeDependencyTests-2125363277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171.b1b724a8-5f05-479e-9790-31f37532130b 1G" returned: 0 in 0.804s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:59:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3630f0b0-bd88-4eed-869e-47f1693b69d8 tempest-VolumeDependencyTests-2125363277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0793660e-fb55-486f-93eb-f2551f745171 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171.b1b724a8-5f05-479e-9790-31f37532130b {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:59:35 devstack sudo[105732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0793660e-fb55-486f-93eb-f2551f745171 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171.b1b724a8-5f05-479e-9790-31f37532130b
Jul 10 12:59:35 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:59:36 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root
Jul 10 12:59:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3630f0b0-bd88-4eed-869e-47f1693b69d8 tempest-VolumeDependencyTests-2125363277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0793660e-fb55-486f-93eb-f2551f745171 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171.b1b724a8-5f05-479e-9790-31f37532130b" returned: 0 in 0.697s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:59:36 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-3630f0b0-bd88-4eed-869e-47f1693b69d8 tempest-VolumeDependencyTests-2125363277 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171.b1b724a8-5f05-479e-9790-31f37532130b is being set with open permissions: ugo+rw
Jul 10 12:59:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3630f0b0-bd88-4eed-869e-47f1693b69d8 tempest-VolumeDependencyTests-2125363277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171.b1b724a8-5f05-479e-9790-31f37532130b {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:59:36 devstack sudo[105743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171.b1b724a8-5f05-479e-9790-31f37532130b
Jul 10 12:59:36 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:59:36 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root
Jul 10 12:59:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3630f0b0-bd88-4eed-869e-47f1693b69d8 tempest-VolumeDependencyTests-2125363277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171.b1b724a8-5f05-479e-9790-31f37532130b" returned: 0 in 0.639s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:59:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3630f0b0-bd88-4eed-869e-47f1693b69d8 tempest-VolumeDependencyTests-2125363277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:59:36 devstack sudo[105746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171.info
Jul 10 12:59:36 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:59:37 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root
Jul 10 12:59:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3630f0b0-bd88-4eed-869e-47f1693b69d8 tempest-VolumeDependencyTests-2125363277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171.info" returned: 0 in 0.647s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:59:37 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-3630f0b0-bd88-4eed-869e-47f1693b69d8 tempest-VolumeDependencyTests-2125363277 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171.info is being set with open permissions: ugo+rw
Jul 10 12:59:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3630f0b0-bd88-4eed-869e-47f1693b69d8 tempest-VolumeDependencyTests-2125363277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:59:37 devstack sudo[105749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171.info
Jul 10 12:59:37 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:59:38 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root
Jul 10 12:59:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3630f0b0-bd88-4eed-869e-47f1693b69d8 tempest-VolumeDependencyTests-2125363277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171.info" returned: 0 in 0.632s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:59:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3630f0b0-bd88-4eed-869e-47f1693b69d8 tempest-VolumeDependencyTests-2125363277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.284s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:59:38 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-3630f0b0-bd88-4eed-869e-47f1693b69d8 tempest-VolumeDependencyTests-2125363277 None] Create snapshot completed successfully
Jul 10 12:59:39 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 12:59:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] Flow 'volume_create_manager' (911cb124-f805-44f5-b275-391aa9f51503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:59:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd4a6017-25a4-4ca9-9dbf-34f93067f324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:59:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd4a6017-25a4-4ca9-9dbf-34f93067f324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T10:59:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1108910755',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa761a7c-78e4-4464-bb0d-d9ad1fa2c93e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86025c9ae8cf40a2a2cf83eb4b4acdf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T10:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b1b724a8-5f05-479e-9790-31f37532130b,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T10:59:39Z,use_quota=True,user_id='9d495030b65244a0b633b7ff15d20e28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:59:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ce3b75a-cd8c-4085-b104-8a5cbfdce99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:59:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ce3b75a-cd8c-4085-b104-8a5cbfdce99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:59:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c0511ac-2626-41ab-9b93-7e190a46a28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:59:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c0511ac-2626-41ab-9b93-7e190a46a28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'aa761a7c-78e4-4464-bb0d-d9ad1fa2c93e', 'volume_name': 'volume-aa761a7c-78e4-4464-bb0d-d9ad1fa2c93e', 'volume_size': 1, 'snapshot_id': 'b1b724a8-5f05-479e-9790-31f37532130b'}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:59:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59d83505-bc7d-4fea-bacd-56010b0210ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:59:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59d83505-bc7d-4fea-bacd-56010b0210ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:59:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (354d97c4-f096-4cf8-a77a-540ac1d25950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:59:39 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] Volume aa761a7c-78e4-4464-bb0d-d9ad1fa2c93e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-aa761a7c-78e4-4464-bb0d-d9ad1fa2c93e', 'volume_size': 1, 'snapshot_id': 'b1b724a8-5f05-479e-9790-31f37532130b'}
Jul 10 12:59:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:59:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:59:39 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] Acquiring lock "cinder-quobyte-b1b724a8-5f05-479e-9790-31f37532130b-aa761a7c-78e4-4464-bb0d-d9ad1fa2c93e" by "_create_volume_from_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:59:39 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] Lock "cinder-quobyte-b1b724a8-5f05-479e-9790-31f37532130b-aa761a7c-78e4-4464-bb0d-d9ad1fa2c93e" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:59:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] Creating volume aa761a7c-78e4-4464-bb0d-d9ad1fa2c93e from snapshot b1b724a8-5f05-479e-9790-31f37532130b {{(pid=87378) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 10 12:59:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:59:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:59:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:59:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:59:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:59:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 12:59:39 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] Acquiring lock "cinder-quobyte-aa761a7c-78e4-4464-bb0d-d9ad1fa2c93e" by "_copy_volume_from_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:59:39 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] Lock "cinder-quobyte-aa761a7c-78e4-4464-bb0d-d9ad1fa2c93e" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:59:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] snapshot: b1b724a8-5f05-479e-9790-31f37532130b, volume: aa761a7c-78e4-4464-bb0d-d9ad1fa2c93e,  {{(pid=87378) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 10 12:59:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:59:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:59:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:59:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:59:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:59:39 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c615b4ca-180d-470e-97c2-a279cd2e3a66]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:59:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171.b1b724a8-5f05-479e-9790-31f37532130b {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:59:39 devstack sudo[105753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171.b1b724a8-5f05-479e-9790-31f37532130b
Jul 10 12:59:39 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:59:40 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root
Jul 10 12:59:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171.b1b724a8-5f05-479e-9790-31f37532130b" returned: 0 in 0.734s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:59:40 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0793660e-fb55-486f-93eb-f2551f745171(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:59:40 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] will copy from snapshot at /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171 {{(pid=87378) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 10 12:59:40 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] Creating direct copy from snapshot {{(pid=87378) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 10 12:59:40 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3338b4-698d-409a-b9d4-197bccfe3e7f]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:59:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:59:40 devstack sudo[105758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171
Jul 10 12:59:40 devstack sudo[105758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:59:41 devstack sudo[105758]: pam_unix(sudo:session): session closed for user root
Jul 10 12:59:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171" returned: 0 in 0.746s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:59:41 devstack cinder-volume[87378]: DEBUG cinder.utils [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] Path /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-aa761a7c-78e4-4464-bb0d-d9ad1fa2c93e not found in is_blk_device check {{(pid=87378) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 10 12:59:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-aa761a7c-78e4-4464-bb0d-d9ad1fa2c93e {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:59:41 devstack sudo[105763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-aa761a7c-78e4-4464-bb0d-d9ad1fa2c93e
Jul 10 12:59:41 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:59:45 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root
Jul 10 12:59:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-aa761a7c-78e4-4464-bb0d-d9ad1fa2c93e" returned: 0 in 4.459s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:59:45 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13a477f-a76b-4420-a670-2a8360b0b5cc]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:59:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:59:45 devstack sudo[105776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171
Jul 10 12:59:45 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:59:46 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root
Jul 10 12:59:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171" returned: 0 in 0.940s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:59:46 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] Image conversion details: src /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171, size 1024.00 MB, duration 4.46 sec, destination /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-aa761a7c-78e4-4464-bb0d-d9ad1fa2c93e {{(pid=87378) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 10 12:59:46 devstack cinder-volume[87378]: INFO cinder.image.image_utils [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] Converted 1024.00 MB image at 229.56 MB/s
Jul 10 12:59:46 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-aa761a7c-78e4-4464-bb0d-d9ad1fa2c93e is being set with open permissions: ugo+rw
Jul 10 12:59:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-aa761a7c-78e4-4464-bb0d-d9ad1fa2c93e {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:59:46 devstack sudo[105781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-aa761a7c-78e4-4464-bb0d-d9ad1fa2c93e
Jul 10 12:59:46 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:59:47 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root
Jul 10 12:59:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-aa761a7c-78e4-4464-bb0d-d9ad1fa2c93e" returned: 0 in 0.637s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:59:47 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] Lock "cinder-quobyte-aa761a7c-78e4-4464-bb0d-d9ad1fa2c93e" released by "_copy_volume_from_snapshot" :: held 7.606s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:59:47 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] Lock "cinder-quobyte-b1b724a8-5f05-479e-9790-31f37532130b-aa761a7c-78e4-4464-bb0d-d9ad1fa2c93e" released by "_create_volume_from_snapshot" :: held 7.633s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:59:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.647s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:59:47 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:SELECT=28,cinder:UPDATE=27,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 12:59:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (354d97c4-f096-4cf8-a77a-540ac1d25950) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa761a7c-78e4-4464-bb0d-d9ad1fa2c93e', 'volume_size': 1, 'snapshot_id': 'b1b724a8-5f05-479e-9790-31f37532130b'}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:59:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a2a5015-9bcc-4a6b-ae15-7c614572eeee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 12:59:47 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] Volume volume-aa761a7c-78e4-4464-bb0d-d9ad1fa2c93e (aa761a7c-78e4-4464-bb0d-d9ad1fa2c93e): created successfully
Jul 10 12:59:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a2a5015-9bcc-4a6b-ae15-7c614572eeee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 12:59:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] Flow 'volume_create_manager' (911cb124-f805-44f5-b275-391aa9f51503) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 12:59:47 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-fc7222e0-f1d4-45aa-a6b7-f0423b1d4232 tempest-VolumeDependencyTests-2125363277 None] Created volume successfully.
Jul 10 12:59:47 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-258a91d5-79c2-4c2f-b96c-14c98a930bbf tempest-VolumeDependencyTests-2125363277 None] Acquiring lock "cinder-b1b724a8-5f05-479e-9790-31f37532130b-delete_snapshot" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:59:48 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-258a91d5-79c2-4c2f-b96c-14c98a930bbf tempest-VolumeDependencyTests-2125363277 None] Lock "cinder-b1b724a8-5f05-479e-9790-31f37532130b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:59:48 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-258a91d5-79c2-4c2f-b96c-14c98a930bbf tempest-VolumeDependencyTests-2125363277 None] Acquiring lock "cinder-quobyte-0793660e-fb55-486f-93eb-f2551f745171" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:59:48 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-258a91d5-79c2-4c2f-b96c-14c98a930bbf tempest-VolumeDependencyTests-2125363277 None] Lock "cinder-quobyte-0793660e-fb55-486f-93eb-f2551f745171" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:59:48 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-258a91d5-79c2-4c2f-b96c-14c98a930bbf tempest-VolumeDependencyTests-2125363277 None] Acquiring lock "cinder-quobyte-b1b724a8-5f05-479e-9790-31f37532130b" by "_delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:59:48 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-258a91d5-79c2-4c2f-b96c-14c98a930bbf tempest-VolumeDependencyTests-2125363277 None] Lock "cinder-quobyte-b1b724a8-5f05-479e-9790-31f37532130b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:59:48 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-258a91d5-79c2-4c2f-b96c-14c98a930bbf tempest-VolumeDependencyTests-2125363277 None] Deleting offline snapshot b1b724a8-5f05-479e-9790-31f37532130b of volume 0793660e-fb55-486f-93eb-f2551f745171 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 10 12:59:48 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-258a91d5-79c2-4c2f-b96c-14c98a930bbf tempest-VolumeDependencyTests-2125363277 None] snapshot_file for this snap is: volume-0793660e-fb55-486f-93eb-f2551f745171.b1b724a8-5f05-479e-9790-31f37532130b {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 10 12:59:48 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3591472-647c-41cb-a91c-7f743d5d111c]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:59:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-258a91d5-79c2-4c2f-b96c-14c98a930bbf tempest-VolumeDependencyTests-2125363277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171.b1b724a8-5f05-479e-9790-31f37532130b {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:59:48 devstack sudo[105784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171.b1b724a8-5f05-479e-9790-31f37532130b
Jul 10 12:59:48 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:59:48 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root
Jul 10 12:59:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-258a91d5-79c2-4c2f-b96c-14c98a930bbf tempest-VolumeDependencyTests-2125363277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171.b1b724a8-5f05-479e-9790-31f37532130b" returned: 0 in 0.737s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:59:48 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-258a91d5-79c2-4c2f-b96c-14c98a930bbf tempest-VolumeDependencyTests-2125363277 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0793660e-fb55-486f-93eb-f2551f745171(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 12:59:48 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a2e851-894f-4b2c-9251-be830205e828]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:59:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-258a91d5-79c2-4c2f-b96c-14c98a930bbf tempest-VolumeDependencyTests-2125363277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:59:48 devstack sudo[105789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171
Jul 10 12:59:48 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:59:49 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root
Jul 10 12:59:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-258a91d5-79c2-4c2f-b96c-14c98a930bbf tempest-VolumeDependencyTests-2125363277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171" returned: 0 in 0.730s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:59:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-258a91d5-79c2-4c2f-b96c-14c98a930bbf tempest-VolumeDependencyTests-2125363277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171.b1b724a8-5f05-479e-9790-31f37532130b {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:59:49 devstack sudo[105795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171.b1b724a8-5f05-479e-9790-31f37532130b
Jul 10 12:59:49 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:59:50 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root
Jul 10 12:59:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-258a91d5-79c2-4c2f-b96c-14c98a930bbf tempest-VolumeDependencyTests-2125363277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171.b1b724a8-5f05-479e-9790-31f37532130b" returned: 0 in 0.728s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:59:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-258a91d5-79c2-4c2f-b96c-14c98a930bbf tempest-VolumeDependencyTests-2125363277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171.b1b724a8-5f05-479e-9790-31f37532130b {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:59:50 devstack sudo[105800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171.b1b724a8-5f05-479e-9790-31f37532130b
Jul 10 12:59:50 devstack sudo[105800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:59:50 devstack sudo[105800]: pam_unix(sudo:session): session closed for user root
Jul 10 12:59:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-258a91d5-79c2-4c2f-b96c-14c98a930bbf tempest-VolumeDependencyTests-2125363277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171.b1b724a8-5f05-479e-9790-31f37532130b" returned: 0 in 0.641s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:59:50 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-258a91d5-79c2-4c2f-b96c-14c98a930bbf tempest-VolumeDependencyTests-2125363277 None] Lock "cinder-quobyte-b1b724a8-5f05-479e-9790-31f37532130b" released by "_delete_snapshot" :: held 2.930s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:59:50 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-258a91d5-79c2-4c2f-b96c-14c98a930bbf tempest-VolumeDependencyTests-2125363277 None] Lock "cinder-quobyte-0793660e-fb55-486f-93eb-f2551f745171" released by "delete_snapshot" :: held 2.954s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:59:51 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-258a91d5-79c2-4c2f-b96c-14c98a930bbf tempest-VolumeDependencyTests-2125363277 None] Created reservations ['d73369d4-d293-4ef6-b9de-dfe5158edf47', 'e8362e35-aa65-4fb7-ad4d-ee925e3f7aa8', '484c496c-ac59-4425-92d5-27df1e171502', 'f6baee87-882c-4e39-b146-41cc14a146fc'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:59:51 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-258a91d5-79c2-4c2f-b96c-14c98a930bbf tempest-VolumeDependencyTests-2125363277 None] Delete snapshot completed successfully.
Jul 10 12:59:51 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-258a91d5-79c2-4c2f-b96c-14c98a930bbf tempest-VolumeDependencyTests-2125363277 None] Lock "cinder-b1b724a8-5f05-479e-9790-31f37532130b-delete_snapshot" released by "delete_snapshot" :: held 3.080s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:59:51 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f907f8b1-a45d-4f64-812b-40d1b49280f1 tempest-VolumeDependencyTests-2125363277 None] Acquiring lock "cinder-0793660e-fb55-486f-93eb-f2551f745171-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:59:51 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f907f8b1-a45d-4f64-812b-40d1b49280f1 tempest-VolumeDependencyTests-2125363277 None] Lock "cinder-0793660e-fb55-486f-93eb-f2551f745171-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:59:51 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f907f8b1-a45d-4f64-812b-40d1b49280f1 tempest-VolumeDependencyTests-2125363277 None] Acquiring lock "cinder-quobyte-0793660e-fb55-486f-93eb-f2551f745171" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:59:51 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f907f8b1-a45d-4f64-812b-40d1b49280f1 tempest-VolumeDependencyTests-2125363277 None] Lock "cinder-quobyte-0793660e-fb55-486f-93eb-f2551f745171" acquired by "delete_volume" :: waited 0.017s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:59:51 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d77a30-7feb-426d-8e69-1b4549ab6d02]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:59:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f907f8b1-a45d-4f64-812b-40d1b49280f1 tempest-VolumeDependencyTests-2125363277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:59:51 devstack sudo[105803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171
Jul 10 12:59:51 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:59:52 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root
Jul 10 12:59:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f907f8b1-a45d-4f64-812b-40d1b49280f1 tempest-VolumeDependencyTests-2125363277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171" returned: 0 in 0.738s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:59:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f907f8b1-a45d-4f64-812b-40d1b49280f1 tempest-VolumeDependencyTests-2125363277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:59:52 devstack sudo[105808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171
Jul 10 12:59:52 devstack sudo[105808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:59:52 devstack sudo[105808]: pam_unix(sudo:session): session closed for user root
Jul 10 12:59:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f907f8b1-a45d-4f64-812b-40d1b49280f1 tempest-VolumeDependencyTests-2125363277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0793660e-fb55-486f-93eb-f2551f745171" returned: 0 in 0.657s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:59:52 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f907f8b1-a45d-4f64-812b-40d1b49280f1 tempest-VolumeDependencyTests-2125363277 None] Lock "cinder-quobyte-0793660e-fb55-486f-93eb-f2551f745171" released by "delete_volume" :: held 1.452s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:59:52 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-f907f8b1-a45d-4f64-812b-40d1b49280f1 tempest-VolumeDependencyTests-2125363277 None] Created reservations ['144c7bee-0318-4cda-b02c-1eaddae3d3c8', '8cf27066-adf6-4461-b533-81084f019a5b', 'a63b8f96-c8e9-4cab-8f98-a3aad06b3cc3', '7a4b44d8-5585-4953-aa0c-e1b876b4f278'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:59:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f907f8b1-a45d-4f64-812b-40d1b49280f1 tempest-VolumeDependencyTests-2125363277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:59:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f907f8b1-a45d-4f64-812b-40d1b49280f1 tempest-VolumeDependencyTests-2125363277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:59:52 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-f907f8b1-a45d-4f64-812b-40d1b49280f1 tempest-VolumeDependencyTests-2125363277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:59:52 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-f907f8b1-a45d-4f64-812b-40d1b49280f1 tempest-VolumeDependencyTests-2125363277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:59:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f907f8b1-a45d-4f64-812b-40d1b49280f1 tempest-VolumeDependencyTests-2125363277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:59:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f907f8b1-a45d-4f64-812b-40d1b49280f1 tempest-VolumeDependencyTests-2125363277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:59:52 devstack sudo[105811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:59:52 devstack sudo[105811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:59:53 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-6d9c712f-203b-4e42-8c48-ff212af44044 tempest-VolumeDependencyTests-2125363277 None] Acquiring lock "cinder-aa761a7c-78e4-4464-bb0d-d9ad1fa2c93e-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:59:53 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-6d9c712f-203b-4e42-8c48-ff212af44044 tempest-VolumeDependencyTests-2125363277 None] Lock "cinder-aa761a7c-78e4-4464-bb0d-d9ad1fa2c93e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:59:53 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-6d9c712f-203b-4e42-8c48-ff212af44044 tempest-VolumeDependencyTests-2125363277 None] Acquiring lock "cinder-quobyte-aa761a7c-78e4-4464-bb0d-d9ad1fa2c93e" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 12:59:53 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-6d9c712f-203b-4e42-8c48-ff212af44044 tempest-VolumeDependencyTests-2125363277 None] Lock "cinder-quobyte-aa761a7c-78e4-4464-bb0d-d9ad1fa2c93e" acquired by "delete_volume" :: waited 0.017s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 12:59:53 devstack sudo[105811]: pam_unix(sudo:session): session closed for user root
Jul 10 12:59:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f907f8b1-a45d-4f64-812b-40d1b49280f1 tempest-VolumeDependencyTests-2125363277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.674s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:59:53 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-f907f8b1-a45d-4f64-812b-40d1b49280f1 tempest-VolumeDependencyTests-2125363277 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:59:53 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-f907f8b1-a45d-4f64-812b-40d1b49280f1 tempest-VolumeDependencyTests-2125363277 None] Deleted volume successfully.
Jul 10 12:59:53 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af27ca6-57c1-4087-a8ae-fb45b4f61955]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 12:59:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6d9c712f-203b-4e42-8c48-ff212af44044 tempest-VolumeDependencyTests-2125363277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-aa761a7c-78e4-4464-bb0d-d9ad1fa2c93e {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:59:53 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f907f8b1-a45d-4f64-812b-40d1b49280f1 tempest-VolumeDependencyTests-2125363277 None] Lock "cinder-0793660e-fb55-486f-93eb-f2551f745171-delete_volume" released by "delete_volume" :: held 2.330s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:59:53 devstack sudo[105814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-aa761a7c-78e4-4464-bb0d-d9ad1fa2c93e
Jul 10 12:59:53 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:59:54 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root
Jul 10 12:59:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6d9c712f-203b-4e42-8c48-ff212af44044 tempest-VolumeDependencyTests-2125363277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-aa761a7c-78e4-4464-bb0d-d9ad1fa2c93e" returned: 0 in 0.759s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:59:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6d9c712f-203b-4e42-8c48-ff212af44044 tempest-VolumeDependencyTests-2125363277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-aa761a7c-78e4-4464-bb0d-d9ad1fa2c93e {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:59:54 devstack sudo[105819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-aa761a7c-78e4-4464-bb0d-d9ad1fa2c93e
Jul 10 12:59:54 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:59:54 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root
Jul 10 12:59:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6d9c712f-203b-4e42-8c48-ff212af44044 tempest-VolumeDependencyTests-2125363277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-aa761a7c-78e4-4464-bb0d-d9ad1fa2c93e" returned: 0 in 0.635s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:59:54 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-6d9c712f-203b-4e42-8c48-ff212af44044 tempest-VolumeDependencyTests-2125363277 None] Lock "cinder-quobyte-aa761a7c-78e4-4464-bb0d-d9ad1fa2c93e" released by "delete_volume" :: held 1.440s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 12:59:54 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-6d9c712f-203b-4e42-8c48-ff212af44044 tempest-VolumeDependencyTests-2125363277 None] Created reservations ['aa583b3b-9dcd-4842-bced-46a3092c3db9', '6e4c48f3-1823-418d-828a-897f89a3c382', '35ac7aea-4a53-4cf3-9075-7948c0b5cbcf', '25b35b2c-0d01-42ea-8861-fb763dc31522'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 12:59:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-6d9c712f-203b-4e42-8c48-ff212af44044 tempest-VolumeDependencyTests-2125363277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 12:59:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-6d9c712f-203b-4e42-8c48-ff212af44044 tempest-VolumeDependencyTests-2125363277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 12:59:54 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-6d9c712f-203b-4e42-8c48-ff212af44044 tempest-VolumeDependencyTests-2125363277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 12:59:55 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-6d9c712f-203b-4e42-8c48-ff212af44044 tempest-VolumeDependencyTests-2125363277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 12:59:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-6d9c712f-203b-4e42-8c48-ff212af44044 tempest-VolumeDependencyTests-2125363277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 12:59:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6d9c712f-203b-4e42-8c48-ff212af44044 tempest-VolumeDependencyTests-2125363277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 12:59:55 devstack sudo[105822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 12:59:55 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 12:59:55 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root
Jul 10 12:59:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6d9c712f-203b-4e42-8c48-ff212af44044 tempest-VolumeDependencyTests-2125363277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.638s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 12:59:55 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-6d9c712f-203b-4e42-8c48-ff212af44044 tempest-VolumeDependencyTests-2125363277 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 12:59:55 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-6d9c712f-203b-4e42-8c48-ff212af44044 tempest-VolumeDependencyTests-2125363277 None] Deleted volume successfully.
Jul 10 12:59:55 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-6d9c712f-203b-4e42-8c48-ff212af44044 tempest-VolumeDependencyTests-2125363277 None] Lock "cinder-aa761a7c-78e4-4464-bb0d-d9ad1fa2c93e-delete_volume" released by "delete_volume" :: held 2.265s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:00:03 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-337560d8-02ce-420d-9b2d-6f69f0fd6959 tempest-ProjectReaderTests-1729950342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 13:00:03 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-337560d8-02ce-420d-9b2d-6f69f0fd6959 tempest-ProjectReaderTests-1729950342 None] Flow 'volume_create_manager' (f9745c62-fff4-4402-91b7-a704e9754683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:00:03 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-337560d8-02ce-420d-9b2d-6f69f0fd6959 tempest-ProjectReaderTests-1729950342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef2c0dc3-bd01-4f62-a386-c708c81c7831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:03 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-337560d8-02ce-420d-9b2d-6f69f0fd6959 tempest-ProjectReaderTests-1729950342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef2c0dc3-bd01-4f62-a386-c708c81c7831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:00:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-592699342',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e975fd93-19ce-4531-bd75-342334d2543f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='433060a5b9da4bd1bd986a164c5f249d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:00:03Z,use_quota=True,user_id='1acc9c98454d4e95823723f6f578eb7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:03 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-337560d8-02ce-420d-9b2d-6f69f0fd6959 tempest-ProjectReaderTests-1729950342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaece4d8-449d-4953-bed5-80570e5fc16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:03 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-337560d8-02ce-420d-9b2d-6f69f0fd6959 tempest-ProjectReaderTests-1729950342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaece4d8-449d-4953-bed5-80570e5fc16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:03 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-337560d8-02ce-420d-9b2d-6f69f0fd6959 tempest-ProjectReaderTests-1729950342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53a75b5f-4241-4ea5-9b99-2bd880c29457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:03 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-337560d8-02ce-420d-9b2d-6f69f0fd6959 tempest-ProjectReaderTests-1729950342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53a75b5f-4241-4ea5-9b99-2bd880c29457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e975fd93-19ce-4531-bd75-342334d2543f', 'volume_name': 'volume-e975fd93-19ce-4531-bd75-342334d2543f', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:03 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-337560d8-02ce-420d-9b2d-6f69f0fd6959 tempest-ProjectReaderTests-1729950342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (165d3e37-9ffb-47ad-afd8-2776adbdca8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:03 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-337560d8-02ce-420d-9b2d-6f69f0fd6959 tempest-ProjectReaderTests-1729950342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (165d3e37-9ffb-47ad-afd8-2776adbdca8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:03 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-337560d8-02ce-420d-9b2d-6f69f0fd6959 tempest-ProjectReaderTests-1729950342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3186b1d6-8495-4932-ae2c-ac8437aae75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:03 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-337560d8-02ce-420d-9b2d-6f69f0fd6959 tempest-ProjectReaderTests-1729950342 None] Volume e975fd93-19ce-4531-bd75-342334d2543f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e975fd93-19ce-4531-bd75-342334d2543f', 'volume_size': 1}
Jul 10 13:00:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-337560d8-02ce-420d-9b2d-6f69f0fd6959 tempest-ProjectReaderTests-1729950342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:00:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-337560d8-02ce-420d-9b2d-6f69f0fd6959 tempest-ProjectReaderTests-1729950342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:00:03 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-337560d8-02ce-420d-9b2d-6f69f0fd6959 tempest-ProjectReaderTests-1729950342 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:00:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-592699342',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e975fd93-19ce-4531-bd75-342334d2543f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='433060a5b9da4bd1bd986a164c5f249d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:00:03Z,use_quota=True,user_id='1acc9c98454d4e95823723f6f578eb7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 13:00:03 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-337560d8-02ce-420d-9b2d-6f69f0fd6959 tempest-ProjectReaderTests-1729950342 None] Creating volume e975fd93-19ce-4531-bd75-342334d2543f {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 13:00:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-337560d8-02ce-420d-9b2d-6f69f0fd6959 tempest-ProjectReaderTests-1729950342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:00:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-337560d8-02ce-420d-9b2d-6f69f0fd6959 tempest-ProjectReaderTests-1729950342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:00:03 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-337560d8-02ce-420d-9b2d-6f69f0fd6959 tempest-ProjectReaderTests-1729950342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:00:03 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-337560d8-02ce-420d-9b2d-6f69f0fd6959 tempest-ProjectReaderTests-1729950342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:00:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-337560d8-02ce-420d-9b2d-6f69f0fd6959 tempest-ProjectReaderTests-1729950342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:00:03 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-337560d8-02ce-420d-9b2d-6f69f0fd6959 tempest-ProjectReaderTests-1729950342 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 13:00:03 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-337560d8-02ce-420d-9b2d-6f69f0fd6959 tempest-ProjectReaderTests-1729950342 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 13:00:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-337560d8-02ce-420d-9b2d-6f69f0fd6959 tempest-ProjectReaderTests-1729950342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e975fd93-19ce-4531-bd75-342334d2543f 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:03 devstack sudo[105833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e975fd93-19ce-4531-bd75-342334d2543f 1073741824
Jul 10 13:00:03 devstack sudo[105833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:03 devstack sudo[105833]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-337560d8-02ce-420d-9b2d-6f69f0fd6959 tempest-ProjectReaderTests-1729950342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e975fd93-19ce-4531-bd75-342334d2543f 1073741824" returned: 0 in 0.802s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-337560d8-02ce-420d-9b2d-6f69f0fd6959 tempest-ProjectReaderTests-1729950342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e975fd93-19ce-4531-bd75-342334d2543f {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:04 devstack sudo[105842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e975fd93-19ce-4531-bd75-342334d2543f
Jul 10 13:00:04 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:04 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-337560d8-02ce-420d-9b2d-6f69f0fd6959 tempest-ProjectReaderTests-1729950342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e975fd93-19ce-4531-bd75-342334d2543f" returned: 0 in 0.621s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:04 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-337560d8-02ce-420d-9b2d-6f69f0fd6959 tempest-ProjectReaderTests-1729950342 None] <== create_volume: return (1468ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 13:00:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-337560d8-02ce-420d-9b2d-6f69f0fd6959 tempest-ProjectReaderTests-1729950342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.471s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:00:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-337560d8-02ce-420d-9b2d-6f69f0fd6959 tempest-ProjectReaderTests-1729950342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3186b1d6-8495-4932-ae2c-ac8437aae75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e975fd93-19ce-4531-bd75-342334d2543f', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-337560d8-02ce-420d-9b2d-6f69f0fd6959 tempest-ProjectReaderTests-1729950342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7107316-80d5-4885-b8e4-b4bf4deb0c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:04 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-337560d8-02ce-420d-9b2d-6f69f0fd6959 tempest-ProjectReaderTests-1729950342 None] Volume volume-e975fd93-19ce-4531-bd75-342334d2543f (e975fd93-19ce-4531-bd75-342334d2543f): created successfully
Jul 10 13:00:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-337560d8-02ce-420d-9b2d-6f69f0fd6959 tempest-ProjectReaderTests-1729950342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7107316-80d5-4885-b8e4-b4bf4deb0c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-337560d8-02ce-420d-9b2d-6f69f0fd6959 tempest-ProjectReaderTests-1729950342 None] Flow 'volume_create_manager' (f9745c62-fff4-4402-91b7-a704e9754683) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:00:04 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-337560d8-02ce-420d-9b2d-6f69f0fd6959 tempest-ProjectReaderTests-1729950342 None] Created volume successfully.
Jul 10 13:00:05 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-05336595-794a-4ee1-91ea-b53601257fa3 tempest-ProjectReaderTests-1729950342 None] Acquiring lock "cinder-e975fd93-19ce-4531-bd75-342334d2543f-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:00:05 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-05336595-794a-4ee1-91ea-b53601257fa3 tempest-ProjectReaderTests-1729950342 None] Lock "cinder-e975fd93-19ce-4531-bd75-342334d2543f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:00:05 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-05336595-794a-4ee1-91ea-b53601257fa3 tempest-ProjectReaderTests-1729950342 None] Acquiring lock "cinder-quobyte-e975fd93-19ce-4531-bd75-342334d2543f" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:00:05 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-05336595-794a-4ee1-91ea-b53601257fa3 tempest-ProjectReaderTests-1729950342 None] Lock "cinder-quobyte-e975fd93-19ce-4531-bd75-342334d2543f" acquired by "delete_volume" :: waited 0.014s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:00:05 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ebe34c9-72ba-475a-86d6-ca7b8afae6bf]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:00:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-05336595-794a-4ee1-91ea-b53601257fa3 tempest-ProjectReaderTests-1729950342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e975fd93-19ce-4531-bd75-342334d2543f {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:05 devstack sudo[105845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e975fd93-19ce-4531-bd75-342334d2543f
Jul 10 13:00:05 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:06 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-05336595-794a-4ee1-91ea-b53601257fa3 tempest-ProjectReaderTests-1729950342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e975fd93-19ce-4531-bd75-342334d2543f" returned: 0 in 0.763s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-05336595-794a-4ee1-91ea-b53601257fa3 tempest-ProjectReaderTests-1729950342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e975fd93-19ce-4531-bd75-342334d2543f {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:06 devstack sudo[105850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e975fd93-19ce-4531-bd75-342334d2543f
Jul 10 13:00:06 devstack sudo[105850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:06 devstack sudo[105850]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-05336595-794a-4ee1-91ea-b53601257fa3 tempest-ProjectReaderTests-1729950342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e975fd93-19ce-4531-bd75-342334d2543f" returned: 0 in 0.640s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:06 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-05336595-794a-4ee1-91ea-b53601257fa3 tempest-ProjectReaderTests-1729950342 None] Lock "cinder-quobyte-e975fd93-19ce-4531-bd75-342334d2543f" released by "delete_volume" :: held 1.440s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:00:06 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-05336595-794a-4ee1-91ea-b53601257fa3 tempest-ProjectReaderTests-1729950342 None] Created reservations ['ca64ff57-1e7a-413b-9bf1-530a6c7731d7', 'bfd16b41-dd72-4da2-b278-bbd9bf024b80', '47272a1a-ef0b-43f0-a4df-b0cf5226fe86', '310b8ab7-0230-4c53-bb39-c532e1864b49'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:00:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-05336595-794a-4ee1-91ea-b53601257fa3 tempest-ProjectReaderTests-1729950342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:00:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-05336595-794a-4ee1-91ea-b53601257fa3 tempest-ProjectReaderTests-1729950342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:00:06 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-05336595-794a-4ee1-91ea-b53601257fa3 tempest-ProjectReaderTests-1729950342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:00:06 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-05336595-794a-4ee1-91ea-b53601257fa3 tempest-ProjectReaderTests-1729950342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:00:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-05336595-794a-4ee1-91ea-b53601257fa3 tempest-ProjectReaderTests-1729950342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:00:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-05336595-794a-4ee1-91ea-b53601257fa3 tempest-ProjectReaderTests-1729950342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:06 devstack sudo[105853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:00:06 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:07 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-05336595-794a-4ee1-91ea-b53601257fa3 tempest-ProjectReaderTests-1729950342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.644s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:07 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-05336595-794a-4ee1-91ea-b53601257fa3 tempest-ProjectReaderTests-1729950342 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:00:07 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-05336595-794a-4ee1-91ea-b53601257fa3 tempest-ProjectReaderTests-1729950342 None] Deleted volume successfully.
Jul 10 13:00:07 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-05336595-794a-4ee1-91ea-b53601257fa3 tempest-ProjectReaderTests-1729950342 None] Lock "cinder-e975fd93-19ce-4531-bd75-342334d2543f-delete_volume" released by "delete_volume" :: held 2.277s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:00:07 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-1df7b520-5b25-4f41-8ec0-063dff02288d tempest-ProjectReaderTests-1729950342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 13:00:07 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1df7b520-5b25-4f41-8ec0-063dff02288d tempest-ProjectReaderTests-1729950342 None] Flow 'volume_create_manager' (bab178d0-83a4-4770-b989-082d351eaf23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:00:07 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1df7b520-5b25-4f41-8ec0-063dff02288d tempest-ProjectReaderTests-1729950342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d60852b-01f9-4ca5-b052-3d905813c147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:07 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1df7b520-5b25-4f41-8ec0-063dff02288d tempest-ProjectReaderTests-1729950342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d60852b-01f9-4ca5-b052-3d905813c147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:00:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-93899482',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23f5f59c-6e0a-44aa-94b9-357f65962f3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='433060a5b9da4bd1bd986a164c5f249d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:00:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:00:08Z,use_quota=True,user_id='1acc9c98454d4e95823723f6f578eb7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:07 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1df7b520-5b25-4f41-8ec0-063dff02288d tempest-ProjectReaderTests-1729950342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5186de37-ac0d-4476-b643-1135809a54ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:07 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1df7b520-5b25-4f41-8ec0-063dff02288d tempest-ProjectReaderTests-1729950342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5186de37-ac0d-4476-b643-1135809a54ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:07 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1df7b520-5b25-4f41-8ec0-063dff02288d tempest-ProjectReaderTests-1729950342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51b5790f-4f42-4f92-bc20-811c48680276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:08 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1df7b520-5b25-4f41-8ec0-063dff02288d tempest-ProjectReaderTests-1729950342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51b5790f-4f42-4f92-bc20-811c48680276) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23f5f59c-6e0a-44aa-94b9-357f65962f3f', 'volume_name': 'volume-23f5f59c-6e0a-44aa-94b9-357f65962f3f', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:08 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1df7b520-5b25-4f41-8ec0-063dff02288d tempest-ProjectReaderTests-1729950342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d07a926b-d94a-4d10-a8f4-3619bf3d9a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:08 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1df7b520-5b25-4f41-8ec0-063dff02288d tempest-ProjectReaderTests-1729950342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d07a926b-d94a-4d10-a8f4-3619bf3d9a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:08 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1df7b520-5b25-4f41-8ec0-063dff02288d tempest-ProjectReaderTests-1729950342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec1a637c-ceae-4ea4-8887-b0ac0890f7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:08 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-1df7b520-5b25-4f41-8ec0-063dff02288d tempest-ProjectReaderTests-1729950342 None] Volume 23f5f59c-6e0a-44aa-94b9-357f65962f3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23f5f59c-6e0a-44aa-94b9-357f65962f3f', 'volume_size': 1}
Jul 10 13:00:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1df7b520-5b25-4f41-8ec0-063dff02288d tempest-ProjectReaderTests-1729950342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:00:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1df7b520-5b25-4f41-8ec0-063dff02288d tempest-ProjectReaderTests-1729950342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:00:08 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-1df7b520-5b25-4f41-8ec0-063dff02288d tempest-ProjectReaderTests-1729950342 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:00:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-93899482',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23f5f59c-6e0a-44aa-94b9-357f65962f3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='433060a5b9da4bd1bd986a164c5f249d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:00:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:00:08Z,use_quota=True,user_id='1acc9c98454d4e95823723f6f578eb7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 13:00:08 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-1df7b520-5b25-4f41-8ec0-063dff02288d tempest-ProjectReaderTests-1729950342 None] Creating volume 23f5f59c-6e0a-44aa-94b9-357f65962f3f {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 13:00:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1df7b520-5b25-4f41-8ec0-063dff02288d tempest-ProjectReaderTests-1729950342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:00:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1df7b520-5b25-4f41-8ec0-063dff02288d tempest-ProjectReaderTests-1729950342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:00:08 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-1df7b520-5b25-4f41-8ec0-063dff02288d tempest-ProjectReaderTests-1729950342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:00:08 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-1df7b520-5b25-4f41-8ec0-063dff02288d tempest-ProjectReaderTests-1729950342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:00:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1df7b520-5b25-4f41-8ec0-063dff02288d tempest-ProjectReaderTests-1729950342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:00:08 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-1df7b520-5b25-4f41-8ec0-063dff02288d tempest-ProjectReaderTests-1729950342 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 13:00:08 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-1df7b520-5b25-4f41-8ec0-063dff02288d tempest-ProjectReaderTests-1729950342 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 13:00:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1df7b520-5b25-4f41-8ec0-063dff02288d tempest-ProjectReaderTests-1729950342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-23f5f59c-6e0a-44aa-94b9-357f65962f3f 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:08 devstack sudo[105856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-23f5f59c-6e0a-44aa-94b9-357f65962f3f 1073741824
Jul 10 13:00:08 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:08 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1df7b520-5b25-4f41-8ec0-063dff02288d tempest-ProjectReaderTests-1729950342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-23f5f59c-6e0a-44aa-94b9-357f65962f3f 1073741824" returned: 0 in 0.787s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1df7b520-5b25-4f41-8ec0-063dff02288d tempest-ProjectReaderTests-1729950342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-23f5f59c-6e0a-44aa-94b9-357f65962f3f {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:08 devstack sudo[105861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-23f5f59c-6e0a-44aa-94b9-357f65962f3f
Jul 10 13:00:08 devstack sudo[105861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:09 devstack sudo[105861]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1df7b520-5b25-4f41-8ec0-063dff02288d tempest-ProjectReaderTests-1729950342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-23f5f59c-6e0a-44aa-94b9-357f65962f3f" returned: 0 in 0.623s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:09 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-1df7b520-5b25-4f41-8ec0-063dff02288d tempest-ProjectReaderTests-1729950342 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 13:00:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1df7b520-5b25-4f41-8ec0-063dff02288d tempest-ProjectReaderTests-1729950342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.454s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:00:09 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1df7b520-5b25-4f41-8ec0-063dff02288d tempest-ProjectReaderTests-1729950342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec1a637c-ceae-4ea4-8887-b0ac0890f7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23f5f59c-6e0a-44aa-94b9-357f65962f3f', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:09 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1df7b520-5b25-4f41-8ec0-063dff02288d tempest-ProjectReaderTests-1729950342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (076aaff4-2df9-45a2-9571-63f033f5eaf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:09 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-1df7b520-5b25-4f41-8ec0-063dff02288d tempest-ProjectReaderTests-1729950342 None] Volume volume-23f5f59c-6e0a-44aa-94b9-357f65962f3f (23f5f59c-6e0a-44aa-94b9-357f65962f3f): created successfully
Jul 10 13:00:09 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1df7b520-5b25-4f41-8ec0-063dff02288d tempest-ProjectReaderTests-1729950342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (076aaff4-2df9-45a2-9571-63f033f5eaf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:09 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-1df7b520-5b25-4f41-8ec0-063dff02288d tempest-ProjectReaderTests-1729950342 None] Flow 'volume_create_manager' (bab178d0-83a4-4770-b989-082d351eaf23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:00:09 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-1df7b520-5b25-4f41-8ec0-063dff02288d tempest-ProjectReaderTests-1729950342 None] Created volume successfully.
Jul 10 13:00:10 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1c7c22c6-dd8c-4fc3-b8c0-18feefde4828 tempest-ProjectReaderTests-1729950342 None] Acquiring lock "cinder-23f5f59c-6e0a-44aa-94b9-357f65962f3f-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:00:10 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1c7c22c6-dd8c-4fc3-b8c0-18feefde4828 tempest-ProjectReaderTests-1729950342 None] Lock "cinder-23f5f59c-6e0a-44aa-94b9-357f65962f3f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:00:10 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1c7c22c6-dd8c-4fc3-b8c0-18feefde4828 tempest-ProjectReaderTests-1729950342 None] Acquiring lock "cinder-quobyte-23f5f59c-6e0a-44aa-94b9-357f65962f3f" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:00:10 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1c7c22c6-dd8c-4fc3-b8c0-18feefde4828 tempest-ProjectReaderTests-1729950342 None] Lock "cinder-quobyte-23f5f59c-6e0a-44aa-94b9-357f65962f3f" acquired by "delete_volume" :: waited 0.020s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:00:10 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdcf8cfd-eec5-48dd-9115-d6d4de26f015]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:00:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1c7c22c6-dd8c-4fc3-b8c0-18feefde4828 tempest-ProjectReaderTests-1729950342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-23f5f59c-6e0a-44aa-94b9-357f65962f3f {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:10 devstack sudo[105865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-23f5f59c-6e0a-44aa-94b9-357f65962f3f
Jul 10 13:00:10 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:10 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1c7c22c6-dd8c-4fc3-b8c0-18feefde4828 tempest-ProjectReaderTests-1729950342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-23f5f59c-6e0a-44aa-94b9-357f65962f3f" returned: 0 in 0.746s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1c7c22c6-dd8c-4fc3-b8c0-18feefde4828 tempest-ProjectReaderTests-1729950342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-23f5f59c-6e0a-44aa-94b9-357f65962f3f {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:10 devstack sudo[105870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-23f5f59c-6e0a-44aa-94b9-357f65962f3f
Jul 10 13:00:10 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:11 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1c7c22c6-dd8c-4fc3-b8c0-18feefde4828 tempest-ProjectReaderTests-1729950342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-23f5f59c-6e0a-44aa-94b9-357f65962f3f" returned: 0 in 0.642s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:11 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1c7c22c6-dd8c-4fc3-b8c0-18feefde4828 tempest-ProjectReaderTests-1729950342 None] Lock "cinder-quobyte-23f5f59c-6e0a-44aa-94b9-357f65962f3f" released by "delete_volume" :: held 1.424s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:00:11 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-1c7c22c6-dd8c-4fc3-b8c0-18feefde4828 tempest-ProjectReaderTests-1729950342 None] Created reservations ['82d07533-712a-4cc7-9618-04db1c499a42', '889746d6-3d9a-43d5-a127-7361509192b5', '26b98812-e296-4e22-be89-1b834a87bb17', 'bf41ce39-00e7-4d9c-9b96-15e407de68ef'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:00:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1c7c22c6-dd8c-4fc3-b8c0-18feefde4828 tempest-ProjectReaderTests-1729950342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:00:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1c7c22c6-dd8c-4fc3-b8c0-18feefde4828 tempest-ProjectReaderTests-1729950342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:00:11 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-1c7c22c6-dd8c-4fc3-b8c0-18feefde4828 tempest-ProjectReaderTests-1729950342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:00:11 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-1c7c22c6-dd8c-4fc3-b8c0-18feefde4828 tempest-ProjectReaderTests-1729950342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:00:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1c7c22c6-dd8c-4fc3-b8c0-18feefde4828 tempest-ProjectReaderTests-1729950342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:00:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1c7c22c6-dd8c-4fc3-b8c0-18feefde4828 tempest-ProjectReaderTests-1729950342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:11 devstack sudo[105874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:00:11 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:12 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1c7c22c6-dd8c-4fc3-b8c0-18feefde4828 tempest-ProjectReaderTests-1729950342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.640s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:12 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-1c7c22c6-dd8c-4fc3-b8c0-18feefde4828 tempest-ProjectReaderTests-1729950342 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:00:12 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-1c7c22c6-dd8c-4fc3-b8c0-18feefde4828 tempest-ProjectReaderTests-1729950342 None] Deleted volume successfully.
Jul 10 13:00:12 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1c7c22c6-dd8c-4fc3-b8c0-18feefde4828 tempest-ProjectReaderTests-1729950342 None] Lock "cinder-23f5f59c-6e0a-44aa-94b9-357f65962f3f-delete_volume" released by "delete_volume" :: held 2.252s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:00:12 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-785609ae-3254-422c-adf8-222c5631f5d2 tempest-ProjectReaderTests-1729950342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 13:00:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-785609ae-3254-422c-adf8-222c5631f5d2 tempest-ProjectReaderTests-1729950342 None] Flow 'volume_create_manager' (ed452b15-a573-486d-836c-b8c4e29ed788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:00:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-785609ae-3254-422c-adf8-222c5631f5d2 tempest-ProjectReaderTests-1729950342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c17ef703-7aeb-4e4a-9b70-5f6d36210fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-785609ae-3254-422c-adf8-222c5631f5d2 tempest-ProjectReaderTests-1729950342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c17ef703-7aeb-4e4a-9b70-5f6d36210fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1709638966',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04adc925-2a2d-4037-aef9-0a7154b96dc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='433060a5b9da4bd1bd986a164c5f249d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:00:13Z,use_quota=True,user_id='1acc9c98454d4e95823723f6f578eb7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-785609ae-3254-422c-adf8-222c5631f5d2 tempest-ProjectReaderTests-1729950342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a640caf5-ff71-41c1-baf3-51d7ade9f695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-785609ae-3254-422c-adf8-222c5631f5d2 tempest-ProjectReaderTests-1729950342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a640caf5-ff71-41c1-baf3-51d7ade9f695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-785609ae-3254-422c-adf8-222c5631f5d2 tempest-ProjectReaderTests-1729950342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06556bab-b59e-4b5a-a728-c79c1d549fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-785609ae-3254-422c-adf8-222c5631f5d2 tempest-ProjectReaderTests-1729950342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06556bab-b59e-4b5a-a728-c79c1d549fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04adc925-2a2d-4037-aef9-0a7154b96dc7', 'volume_name': 'volume-04adc925-2a2d-4037-aef9-0a7154b96dc7', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-785609ae-3254-422c-adf8-222c5631f5d2 tempest-ProjectReaderTests-1729950342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1274127-1a81-4011-83d8-ecc528a27819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-785609ae-3254-422c-adf8-222c5631f5d2 tempest-ProjectReaderTests-1729950342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1274127-1a81-4011-83d8-ecc528a27819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-785609ae-3254-422c-adf8-222c5631f5d2 tempest-ProjectReaderTests-1729950342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96c5b1bf-7abb-4403-899b-227a1fa1de03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:12 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-785609ae-3254-422c-adf8-222c5631f5d2 tempest-ProjectReaderTests-1729950342 None] Volume 04adc925-2a2d-4037-aef9-0a7154b96dc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04adc925-2a2d-4037-aef9-0a7154b96dc7', 'volume_size': 1}
Jul 10 13:00:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-785609ae-3254-422c-adf8-222c5631f5d2 tempest-ProjectReaderTests-1729950342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:00:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-785609ae-3254-422c-adf8-222c5631f5d2 tempest-ProjectReaderTests-1729950342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:00:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-785609ae-3254-422c-adf8-222c5631f5d2 tempest-ProjectReaderTests-1729950342 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1709638966',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04adc925-2a2d-4037-aef9-0a7154b96dc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='433060a5b9da4bd1bd986a164c5f249d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:00:13Z,use_quota=True,user_id='1acc9c98454d4e95823723f6f578eb7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 13:00:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-785609ae-3254-422c-adf8-222c5631f5d2 tempest-ProjectReaderTests-1729950342 None] Creating volume 04adc925-2a2d-4037-aef9-0a7154b96dc7 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 13:00:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-785609ae-3254-422c-adf8-222c5631f5d2 tempest-ProjectReaderTests-1729950342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:00:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-785609ae-3254-422c-adf8-222c5631f5d2 tempest-ProjectReaderTests-1729950342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:00:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-785609ae-3254-422c-adf8-222c5631f5d2 tempest-ProjectReaderTests-1729950342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:00:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-785609ae-3254-422c-adf8-222c5631f5d2 tempest-ProjectReaderTests-1729950342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:00:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-785609ae-3254-422c-adf8-222c5631f5d2 tempest-ProjectReaderTests-1729950342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:00:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-785609ae-3254-422c-adf8-222c5631f5d2 tempest-ProjectReaderTests-1729950342 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 13:00:12 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-785609ae-3254-422c-adf8-222c5631f5d2 tempest-ProjectReaderTests-1729950342 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 13:00:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-785609ae-3254-422c-adf8-222c5631f5d2 tempest-ProjectReaderTests-1729950342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-04adc925-2a2d-4037-aef9-0a7154b96dc7 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:12 devstack sudo[105877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-04adc925-2a2d-4037-aef9-0a7154b96dc7 1073741824
Jul 10 13:00:12 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:12 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 13:00:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:00:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:00:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:00:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:00:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:00:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:13 devstack sudo[105879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:00:13 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:13 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-785609ae-3254-422c-adf8-222c5631f5d2 tempest-ProjectReaderTests-1729950342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-04adc925-2a2d-4037-aef9-0a7154b96dc7 1073741824" returned: 0 in 0.819s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:13 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.628s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:13 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:00:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-785609ae-3254-422c-adf8-222c5631f5d2 tempest-ProjectReaderTests-1729950342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-04adc925-2a2d-4037-aef9-0a7154b96dc7 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:13 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager._thread_info {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 13:00:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread count: 28 {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 10 13:00:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread info: [<_MainThread(MainThread, started 128233544536192)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128233445424704)>, <Thread(Thread-3 (stat_writer), started daemon 128233435118528)>, <Thread(Rabbit-heartbeat, started daemon 128233435718016)>, <Thread(Thread-5 (_runner), started daemon 128233432624448)>, <Thread(Thread-7 (_runner), started daemon 128233432674688)>, <Thread(fd_logger, started daemon 128233428569472)>, <Thread(privsep_reader, started daemon 128233429417088)>, <Thread(tpool_thread_0, started daemon 128233421182656)>, <Thread(tpool_thread_1, started daemon 128233412789952)>, <Thread(tpool_thread_2, started daemon 128233404397248)>, <Thread(tpool_thread_3, started daemon 128233396004544)>, <Thread(tpool_thread_4, started daemon 128233387611840)>, <Thread(tpool_thread_5, started daemon 128233379219136)>, <Thread(tpool_thread_6, started daemon 128233370826432)>, <Thread(tpool_thread_7, started daemon 128233362433728)>, <Thread(tpool_thread_8, started daemon 128233354041024)>, <Thread(tpool_thread_9, started daemon 128233345631936)>, <Thread(tpool_thread_10, started daemon 128233337222848)>, <Thread(tpool_thread_11, started daemon 128233328813760)>, <Thread(tpool_thread_12, started daemon 128233320404672)>, <Thread(tpool_thread_13, started daemon 128233311995584)>, <Thread(tpool_thread_14, started daemon 128233303586496)>, <Thread(tpool_thread_15, started daemon 128233295177408)>, <Thread(tpool_thread_16, started daemon 128233286768320)>, <Thread(tpool_thread_17, started daemon 128233278359232)>, <Thread(tpool_thread_18, started daemon 128233269950144)>, <Thread(tpool_thread_19, started daemon 128233261541056)>] {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 10 13:00:13 devstack sudo[105885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-04adc925-2a2d-4037-aef9-0a7154b96dc7
Jul 10 13:00:13 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:14 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-785609ae-3254-422c-adf8-222c5631f5d2 tempest-ProjectReaderTests-1729950342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-04adc925-2a2d-4037-aef9-0a7154b96dc7" returned: 0 in 0.634s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:14 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-785609ae-3254-422c-adf8-222c5631f5d2 tempest-ProjectReaderTests-1729950342 None] <== create_volume: return (1501ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 13:00:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-785609ae-3254-422c-adf8-222c5631f5d2 tempest-ProjectReaderTests-1729950342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.503s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:00:14 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-785609ae-3254-422c-adf8-222c5631f5d2 tempest-ProjectReaderTests-1729950342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96c5b1bf-7abb-4403-899b-227a1fa1de03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04adc925-2a2d-4037-aef9-0a7154b96dc7', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:14 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-785609ae-3254-422c-adf8-222c5631f5d2 tempest-ProjectReaderTests-1729950342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82e65dfa-d4bb-436f-9bb3-052a6d7fc8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:14 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-785609ae-3254-422c-adf8-222c5631f5d2 tempest-ProjectReaderTests-1729950342 None] Volume volume-04adc925-2a2d-4037-aef9-0a7154b96dc7 (04adc925-2a2d-4037-aef9-0a7154b96dc7): created successfully
Jul 10 13:00:14 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-785609ae-3254-422c-adf8-222c5631f5d2 tempest-ProjectReaderTests-1729950342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82e65dfa-d4bb-436f-9bb3-052a6d7fc8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:14 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-785609ae-3254-422c-adf8-222c5631f5d2 tempest-ProjectReaderTests-1729950342 None] Flow 'volume_create_manager' (ed452b15-a573-486d-836c-b8c4e29ed788) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:00:14 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-785609ae-3254-422c-adf8-222c5631f5d2 tempest-ProjectReaderTests-1729950342 None] Created volume successfully.
Jul 10 13:00:14 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-febdc34c-d0ce-46ee-8f63-f16d7b0d2e89 tempest-ProjectReaderTests-1729950342 None] Acquiring lock "cinder-04adc925-2a2d-4037-aef9-0a7154b96dc7-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:00:14 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-febdc34c-d0ce-46ee-8f63-f16d7b0d2e89 tempest-ProjectReaderTests-1729950342 None] Lock "cinder-04adc925-2a2d-4037-aef9-0a7154b96dc7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:00:14 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-febdc34c-d0ce-46ee-8f63-f16d7b0d2e89 tempest-ProjectReaderTests-1729950342 None] Acquiring lock "cinder-quobyte-04adc925-2a2d-4037-aef9-0a7154b96dc7" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:00:14 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-febdc34c-d0ce-46ee-8f63-f16d7b0d2e89 tempest-ProjectReaderTests-1729950342 None] Lock "cinder-quobyte-04adc925-2a2d-4037-aef9-0a7154b96dc7" acquired by "delete_volume" :: waited 0.017s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:00:14 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[59aa77ee-d16c-40bc-b6f0-4575d5edd044]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:00:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-febdc34c-d0ce-46ee-8f63-f16d7b0d2e89 tempest-ProjectReaderTests-1729950342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-04adc925-2a2d-4037-aef9-0a7154b96dc7 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:15 devstack sudo[105888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-04adc925-2a2d-4037-aef9-0a7154b96dc7
Jul 10 13:00:15 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:15 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-febdc34c-d0ce-46ee-8f63-f16d7b0d2e89 tempest-ProjectReaderTests-1729950342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-04adc925-2a2d-4037-aef9-0a7154b96dc7" returned: 0 in 0.748s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-febdc34c-d0ce-46ee-8f63-f16d7b0d2e89 tempest-ProjectReaderTests-1729950342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-04adc925-2a2d-4037-aef9-0a7154b96dc7 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:15 devstack sudo[105893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-04adc925-2a2d-4037-aef9-0a7154b96dc7
Jul 10 13:00:15 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:16 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-febdc34c-d0ce-46ee-8f63-f16d7b0d2e89 tempest-ProjectReaderTests-1729950342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-04adc925-2a2d-4037-aef9-0a7154b96dc7" returned: 0 in 0.670s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:16 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-febdc34c-d0ce-46ee-8f63-f16d7b0d2e89 tempest-ProjectReaderTests-1729950342 None] Lock "cinder-quobyte-04adc925-2a2d-4037-aef9-0a7154b96dc7" released by "delete_volume" :: held 1.457s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:00:16 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-febdc34c-d0ce-46ee-8f63-f16d7b0d2e89 tempest-ProjectReaderTests-1729950342 None] Created reservations ['6b9df2bf-411c-4a6b-a853-d509d8e6d45f', '6830ee66-7321-416d-a186-933bd369528c', 'efebb5d3-dda6-4a1b-abb6-10cfb615c095', '67b68d0c-665a-40c7-bebd-c7f94da6e2fa'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:00:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-febdc34c-d0ce-46ee-8f63-f16d7b0d2e89 tempest-ProjectReaderTests-1729950342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:00:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-febdc34c-d0ce-46ee-8f63-f16d7b0d2e89 tempest-ProjectReaderTests-1729950342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:00:16 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-febdc34c-d0ce-46ee-8f63-f16d7b0d2e89 tempest-ProjectReaderTests-1729950342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:00:16 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-febdc34c-d0ce-46ee-8f63-f16d7b0d2e89 tempest-ProjectReaderTests-1729950342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:00:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-febdc34c-d0ce-46ee-8f63-f16d7b0d2e89 tempest-ProjectReaderTests-1729950342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:00:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-febdc34c-d0ce-46ee-8f63-f16d7b0d2e89 tempest-ProjectReaderTests-1729950342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:16 devstack sudo[105896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:00:16 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:17 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-febdc34c-d0ce-46ee-8f63-f16d7b0d2e89 tempest-ProjectReaderTests-1729950342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.647s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:17 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-febdc34c-d0ce-46ee-8f63-f16d7b0d2e89 tempest-ProjectReaderTests-1729950342 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:00:17 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-febdc34c-d0ce-46ee-8f63-f16d7b0d2e89 tempest-ProjectReaderTests-1729950342 None] Deleted volume successfully.
Jul 10 13:00:17 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-febdc34c-d0ce-46ee-8f63-f16d7b0d2e89 tempest-ProjectReaderTests-1729950342 None] Lock "cinder-04adc925-2a2d-4037-aef9-0a7154b96dc7-delete_volume" released by "delete_volume" :: held 2.308s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:00:17 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ab51fc8-2a8c-4018-b951-1e3b15cd5b20 tempest-ProjectReaderTests-1729950342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 13:00:17 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-8ab51fc8-2a8c-4018-b951-1e3b15cd5b20 tempest-ProjectReaderTests-1729950342 None] Flow 'volume_create_manager' (4490f634-fe88-48dd-bfc2-bc6915d416da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:00:17 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-8ab51fc8-2a8c-4018-b951-1e3b15cd5b20 tempest-ProjectReaderTests-1729950342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba218271-4765-42fa-9939-0a6aabb1f8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:17 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-8ab51fc8-2a8c-4018-b951-1e3b15cd5b20 tempest-ProjectReaderTests-1729950342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba218271-4765-42fa-9939-0a6aabb1f8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1641005140',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e188260e-1915-43bc-8449-2db72f768b6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='433060a5b9da4bd1bd986a164c5f249d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:00:17Z,use_quota=True,user_id='1acc9c98454d4e95823723f6f578eb7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:17 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-8ab51fc8-2a8c-4018-b951-1e3b15cd5b20 tempest-ProjectReaderTests-1729950342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eb48a13-bc94-4954-8cc9-8ecaa09c8f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:17 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-8ab51fc8-2a8c-4018-b951-1e3b15cd5b20 tempest-ProjectReaderTests-1729950342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eb48a13-bc94-4954-8cc9-8ecaa09c8f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:17 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-8ab51fc8-2a8c-4018-b951-1e3b15cd5b20 tempest-ProjectReaderTests-1729950342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9058d116-adf3-410a-acad-7781fd029ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:17 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-8ab51fc8-2a8c-4018-b951-1e3b15cd5b20 tempest-ProjectReaderTests-1729950342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9058d116-adf3-410a-acad-7781fd029ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e188260e-1915-43bc-8449-2db72f768b6f', 'volume_name': 'volume-e188260e-1915-43bc-8449-2db72f768b6f', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:17 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-8ab51fc8-2a8c-4018-b951-1e3b15cd5b20 tempest-ProjectReaderTests-1729950342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (565ea048-d042-48eb-9246-c0830956842a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:17 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-8ab51fc8-2a8c-4018-b951-1e3b15cd5b20 tempest-ProjectReaderTests-1729950342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (565ea048-d042-48eb-9246-c0830956842a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:17 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-8ab51fc8-2a8c-4018-b951-1e3b15cd5b20 tempest-ProjectReaderTests-1729950342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b04b6ed-1934-45cf-89de-63444e88bcd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:17 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-8ab51fc8-2a8c-4018-b951-1e3b15cd5b20 tempest-ProjectReaderTests-1729950342 None] Volume e188260e-1915-43bc-8449-2db72f768b6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e188260e-1915-43bc-8449-2db72f768b6f', 'volume_size': 1}
Jul 10 13:00:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-8ab51fc8-2a8c-4018-b951-1e3b15cd5b20 tempest-ProjectReaderTests-1729950342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:00:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-8ab51fc8-2a8c-4018-b951-1e3b15cd5b20 tempest-ProjectReaderTests-1729950342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:00:17 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-8ab51fc8-2a8c-4018-b951-1e3b15cd5b20 tempest-ProjectReaderTests-1729950342 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1641005140',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e188260e-1915-43bc-8449-2db72f768b6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='433060a5b9da4bd1bd986a164c5f249d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:00:17Z,use_quota=True,user_id='1acc9c98454d4e95823723f6f578eb7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 13:00:17 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-8ab51fc8-2a8c-4018-b951-1e3b15cd5b20 tempest-ProjectReaderTests-1729950342 None] Creating volume e188260e-1915-43bc-8449-2db72f768b6f {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 13:00:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-8ab51fc8-2a8c-4018-b951-1e3b15cd5b20 tempest-ProjectReaderTests-1729950342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:00:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-8ab51fc8-2a8c-4018-b951-1e3b15cd5b20 tempest-ProjectReaderTests-1729950342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:00:17 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-8ab51fc8-2a8c-4018-b951-1e3b15cd5b20 tempest-ProjectReaderTests-1729950342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:00:17 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-8ab51fc8-2a8c-4018-b951-1e3b15cd5b20 tempest-ProjectReaderTests-1729950342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:00:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-8ab51fc8-2a8c-4018-b951-1e3b15cd5b20 tempest-ProjectReaderTests-1729950342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:00:17 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-8ab51fc8-2a8c-4018-b951-1e3b15cd5b20 tempest-ProjectReaderTests-1729950342 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 13:00:17 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-8ab51fc8-2a8c-4018-b951-1e3b15cd5b20 tempest-ProjectReaderTests-1729950342 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 13:00:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8ab51fc8-2a8c-4018-b951-1e3b15cd5b20 tempest-ProjectReaderTests-1729950342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e188260e-1915-43bc-8449-2db72f768b6f 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:17 devstack sudo[105899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e188260e-1915-43bc-8449-2db72f768b6f 1073741824
Jul 10 13:00:17 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:18 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8ab51fc8-2a8c-4018-b951-1e3b15cd5b20 tempest-ProjectReaderTests-1729950342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e188260e-1915-43bc-8449-2db72f768b6f 1073741824" returned: 0 in 0.791s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8ab51fc8-2a8c-4018-b951-1e3b15cd5b20 tempest-ProjectReaderTests-1729950342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e188260e-1915-43bc-8449-2db72f768b6f {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:18 devstack sudo[105904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e188260e-1915-43bc-8449-2db72f768b6f
Jul 10 13:00:18 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:18 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8ab51fc8-2a8c-4018-b951-1e3b15cd5b20 tempest-ProjectReaderTests-1729950342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e188260e-1915-43bc-8449-2db72f768b6f" returned: 0 in 0.635s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:18 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-8ab51fc8-2a8c-4018-b951-1e3b15cd5b20 tempest-ProjectReaderTests-1729950342 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 13:00:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-8ab51fc8-2a8c-4018-b951-1e3b15cd5b20 tempest-ProjectReaderTests-1729950342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:00:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-8ab51fc8-2a8c-4018-b951-1e3b15cd5b20 tempest-ProjectReaderTests-1729950342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b04b6ed-1934-45cf-89de-63444e88bcd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e188260e-1915-43bc-8449-2db72f768b6f', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-8ab51fc8-2a8c-4018-b951-1e3b15cd5b20 tempest-ProjectReaderTests-1729950342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b5635e8-c6ae-450a-a739-01f1fa50643c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:19 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-8ab51fc8-2a8c-4018-b951-1e3b15cd5b20 tempest-ProjectReaderTests-1729950342 None] Volume volume-e188260e-1915-43bc-8449-2db72f768b6f (e188260e-1915-43bc-8449-2db72f768b6f): created successfully
Jul 10 13:00:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-8ab51fc8-2a8c-4018-b951-1e3b15cd5b20 tempest-ProjectReaderTests-1729950342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b5635e8-c6ae-450a-a739-01f1fa50643c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-8ab51fc8-2a8c-4018-b951-1e3b15cd5b20 tempest-ProjectReaderTests-1729950342 None] Flow 'volume_create_manager' (4490f634-fe88-48dd-bfc2-bc6915d416da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:00:19 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-8ab51fc8-2a8c-4018-b951-1e3b15cd5b20 tempest-ProjectReaderTests-1729950342 None] Created volume successfully.
Jul 10 13:00:19 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-69d88c5c-052f-45f8-bc46-2a720785b211 tempest-ProjectReaderTests-1729950342 None] Acquiring lock "cinder-e188260e-1915-43bc-8449-2db72f768b6f-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:00:19 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-69d88c5c-052f-45f8-bc46-2a720785b211 tempest-ProjectReaderTests-1729950342 None] Lock "cinder-e188260e-1915-43bc-8449-2db72f768b6f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:00:19 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-69d88c5c-052f-45f8-bc46-2a720785b211 tempest-ProjectReaderTests-1729950342 None] Acquiring lock "cinder-quobyte-e188260e-1915-43bc-8449-2db72f768b6f" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:00:19 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-69d88c5c-052f-45f8-bc46-2a720785b211 tempest-ProjectReaderTests-1729950342 None] Lock "cinder-quobyte-e188260e-1915-43bc-8449-2db72f768b6f" acquired by "delete_volume" :: waited 0.019s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:00:19 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3daac11-1671-43cf-8e7f-1851a5c123b1]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:00:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-69d88c5c-052f-45f8-bc46-2a720785b211 tempest-ProjectReaderTests-1729950342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e188260e-1915-43bc-8449-2db72f768b6f {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:19 devstack sudo[105908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e188260e-1915-43bc-8449-2db72f768b6f
Jul 10 13:00:19 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:20 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-69d88c5c-052f-45f8-bc46-2a720785b211 tempest-ProjectReaderTests-1729950342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e188260e-1915-43bc-8449-2db72f768b6f" returned: 0 in 0.753s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-69d88c5c-052f-45f8-bc46-2a720785b211 tempest-ProjectReaderTests-1729950342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e188260e-1915-43bc-8449-2db72f768b6f {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:20 devstack sudo[105913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e188260e-1915-43bc-8449-2db72f768b6f
Jul 10 13:00:20 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:21 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-69d88c5c-052f-45f8-bc46-2a720785b211 tempest-ProjectReaderTests-1729950342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e188260e-1915-43bc-8449-2db72f768b6f" returned: 0 in 0.623s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:21 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-69d88c5c-052f-45f8-bc46-2a720785b211 tempest-ProjectReaderTests-1729950342 None] Lock "cinder-quobyte-e188260e-1915-43bc-8449-2db72f768b6f" released by "delete_volume" :: held 1.416s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:00:21 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-69d88c5c-052f-45f8-bc46-2a720785b211 tempest-ProjectReaderTests-1729950342 None] Created reservations ['b0c2a016-97b3-4b88-9b34-43fff8d53dad', 'd7f852c1-ce6c-4664-b804-a7e4ee9f7cd1', '6cb2ec0b-b70c-4b36-8de5-98c65c867b03', '76c948cb-e0b7-41b2-a3c1-4cc035d52ea0'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:00:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-69d88c5c-052f-45f8-bc46-2a720785b211 tempest-ProjectReaderTests-1729950342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:00:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-69d88c5c-052f-45f8-bc46-2a720785b211 tempest-ProjectReaderTests-1729950342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:00:21 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-69d88c5c-052f-45f8-bc46-2a720785b211 tempest-ProjectReaderTests-1729950342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:00:21 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-69d88c5c-052f-45f8-bc46-2a720785b211 tempest-ProjectReaderTests-1729950342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:00:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-69d88c5c-052f-45f8-bc46-2a720785b211 tempest-ProjectReaderTests-1729950342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:00:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-69d88c5c-052f-45f8-bc46-2a720785b211 tempest-ProjectReaderTests-1729950342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:21 devstack sudo[105916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:00:21 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:21 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-69d88c5c-052f-45f8-bc46-2a720785b211 tempest-ProjectReaderTests-1729950342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.657s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:21 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-69d88c5c-052f-45f8-bc46-2a720785b211 tempest-ProjectReaderTests-1729950342 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:00:21 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-69d88c5c-052f-45f8-bc46-2a720785b211 tempest-ProjectReaderTests-1729950342 None] Deleted volume successfully.
Jul 10 13:00:21 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-69d88c5c-052f-45f8-bc46-2a720785b211 tempest-ProjectReaderTests-1729950342 None] Lock "cinder-e188260e-1915-43bc-8449-2db72f768b6f-delete_volume" released by "delete_volume" :: held 2.266s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:00:31 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:SELECT=49,cinder:UPDATE=77,cinder:INSERT=16,cinder:DELETE=6 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 13:00:31 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:SELECT=47,cinder:INSERT=17,cinder:UPDATE=62,cinder:DELETE=6 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 13:00:33 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-983decd5-b732-4a3e-99b1-e909cf89907a tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 13:00:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-983decd5-b732-4a3e-99b1-e909cf89907a tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Flow 'volume_create_manager' (49da3925-dd8e-4196-9d86-9f9f42cac8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:00:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-983decd5-b732-4a3e-99b1-e909cf89907a tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0a20311-38c4-431b-a157-e8d29f47389d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-983decd5-b732-4a3e-99b1-e909cf89907a tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0a20311-38c4-431b-a157-e8d29f47389d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1226558406',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7a302de-50af-4c70-a17c-e67466b7a364,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84e579c70c144614bc09f57470b7adb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:00:33Z,use_quota=True,user_id='c068905698ca495e8e18b2b59f3d1563',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-983decd5-b732-4a3e-99b1-e909cf89907a tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb871547-46cc-4fba-8303-88ce341d0632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-983decd5-b732-4a3e-99b1-e909cf89907a tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb871547-46cc-4fba-8303-88ce341d0632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-983decd5-b732-4a3e-99b1-e909cf89907a tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f751d3a-f4f4-4718-ae3b-ad5419b17441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-983decd5-b732-4a3e-99b1-e909cf89907a tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f751d3a-f4f4-4718-ae3b-ad5419b17441) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7a302de-50af-4c70-a17c-e67466b7a364', 'volume_name': 'volume-b7a302de-50af-4c70-a17c-e67466b7a364', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-983decd5-b732-4a3e-99b1-e909cf89907a tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f055836-af3b-4354-abb1-d0ad017fb7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-983decd5-b732-4a3e-99b1-e909cf89907a tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f055836-af3b-4354-abb1-d0ad017fb7a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-983decd5-b732-4a3e-99b1-e909cf89907a tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad86d762-bc00-476a-8563-1249816b52fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:33 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-983decd5-b732-4a3e-99b1-e909cf89907a tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Volume b7a302de-50af-4c70-a17c-e67466b7a364: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7a302de-50af-4c70-a17c-e67466b7a364', 'volume_size': 1}
Jul 10 13:00:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-983decd5-b732-4a3e-99b1-e909cf89907a tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:00:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-983decd5-b732-4a3e-99b1-e909cf89907a tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:00:33 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-983decd5-b732-4a3e-99b1-e909cf89907a tempest-CreateVolumesFromSourceVolumeTest-957425387 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1226558406',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7a302de-50af-4c70-a17c-e67466b7a364,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84e579c70c144614bc09f57470b7adb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:00:33Z,use_quota=True,user_id='c068905698ca495e8e18b2b59f3d1563',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 13:00:33 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-983decd5-b732-4a3e-99b1-e909cf89907a tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Creating volume b7a302de-50af-4c70-a17c-e67466b7a364 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 13:00:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-983decd5-b732-4a3e-99b1-e909cf89907a tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:00:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-983decd5-b732-4a3e-99b1-e909cf89907a tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:00:33 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-983decd5-b732-4a3e-99b1-e909cf89907a tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:00:33 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-983decd5-b732-4a3e-99b1-e909cf89907a tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:00:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-983decd5-b732-4a3e-99b1-e909cf89907a tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:00:33 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-983decd5-b732-4a3e-99b1-e909cf89907a tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 13:00:33 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-983decd5-b732-4a3e-99b1-e909cf89907a tempest-CreateVolumesFromSourceVolumeTest-957425387 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 13:00:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-983decd5-b732-4a3e-99b1-e909cf89907a tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b7a302de-50af-4c70-a17c-e67466b7a364 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:33 devstack sudo[105992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b7a302de-50af-4c70-a17c-e67466b7a364 1073741824
Jul 10 13:00:33 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:33 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8620f4d-9fde-4cc3-ac60-1281c695e0f4 tempest-CreateVolumesFromImageTest-1102869783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 13:00:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a8620f4d-9fde-4cc3-ac60-1281c695e0f4 tempest-CreateVolumesFromImageTest-1102869783 None] Flow 'volume_create_manager' (77c9211a-01c1-4f8a-ba23-f794188ff602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:00:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a8620f4d-9fde-4cc3-ac60-1281c695e0f4 tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b15e8ee-d518-442e-a6c2-808f9d0587d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a8620f4d-9fde-4cc3-ac60-1281c695e0f4 tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b15e8ee-d518-442e-a6c2-808f9d0587d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1106629616',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06bc4536-277b-4417-bc99-0f41dc843d6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dc89b2f617d4bbb941ef0040937ee68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:00:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:00:34Z,use_quota=True,user_id='15445870d3de43569566675dd2a5eade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a8620f4d-9fde-4cc3-ac60-1281c695e0f4 tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ea5d401-fedd-46e1-ad95-bc69b40090aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a8620f4d-9fde-4cc3-ac60-1281c695e0f4 tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ea5d401-fedd-46e1-ad95-bc69b40090aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a8620f4d-9fde-4cc3-ac60-1281c695e0f4 tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89ce38fb-a291-4d1b-9fb6-9e6f46580a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a8620f4d-9fde-4cc3-ac60-1281c695e0f4 tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89ce38fb-a291-4d1b-9fb6-9e6f46580a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06bc4536-277b-4417-bc99-0f41dc843d6f', 'volume_name': 'volume-06bc4536-277b-4417-bc99-0f41dc843d6f', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a8620f4d-9fde-4cc3-ac60-1281c695e0f4 tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1874b987-b282-472b-af12-5f5fb3da1498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a8620f4d-9fde-4cc3-ac60-1281c695e0f4 tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1874b987-b282-472b-af12-5f5fb3da1498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a8620f4d-9fde-4cc3-ac60-1281c695e0f4 tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52650885-2155-4447-b42f-3421575c9751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:33 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-a8620f4d-9fde-4cc3-ac60-1281c695e0f4 tempest-CreateVolumesFromImageTest-1102869783 None] Volume 06bc4536-277b-4417-bc99-0f41dc843d6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06bc4536-277b-4417-bc99-0f41dc843d6f', 'volume_size': 1}
Jul 10 13:00:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a8620f4d-9fde-4cc3-ac60-1281c695e0f4 tempest-CreateVolumesFromImageTest-1102869783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:00:34 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d387266-6149-449e-a367-3d5cd56c7950 tempest-CreateVolumesFromImageTest-1102869783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 13:00:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0d387266-6149-449e-a367-3d5cd56c7950 tempest-CreateVolumesFromImageTest-1102869783 None] Flow 'volume_create_manager' (6102feaa-670a-4fd8-9afe-ed0f4d01e748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:00:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0d387266-6149-449e-a367-3d5cd56c7950 tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1613980-9647-4c88-81ae-f1a46e3ebec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0d387266-6149-449e-a367-3d5cd56c7950 tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1613980-9647-4c88-81ae-f1a46e3ebec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1940772238',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e95fdf8e-507a-4603-966c-a4a26daa7b76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dc89b2f617d4bbb941ef0040937ee68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:00:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:00:34Z,use_quota=True,user_id='15445870d3de43569566675dd2a5eade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0d387266-6149-449e-a367-3d5cd56c7950 tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08e571d4-c682-4a5a-89d4-f67e6e4827e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0d387266-6149-449e-a367-3d5cd56c7950 tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08e571d4-c682-4a5a-89d4-f67e6e4827e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0d387266-6149-449e-a367-3d5cd56c7950 tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02f4742a-9e62-41d4-b84f-1a9ffef78c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0d387266-6149-449e-a367-3d5cd56c7950 tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02f4742a-9e62-41d4-b84f-1a9ffef78c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e95fdf8e-507a-4603-966c-a4a26daa7b76', 'volume_name': 'volume-e95fdf8e-507a-4603-966c-a4a26daa7b76', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0d387266-6149-449e-a367-3d5cd56c7950 tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (277b43ea-6b19-40f7-8ebb-f4d0511ecb1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0d387266-6149-449e-a367-3d5cd56c7950 tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (277b43ea-6b19-40f7-8ebb-f4d0511ecb1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0d387266-6149-449e-a367-3d5cd56c7950 tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd02a097-d590-4eb4-bef1-9abf8e105854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:34 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-0d387266-6149-449e-a367-3d5cd56c7950 tempest-CreateVolumesFromImageTest-1102869783 None] Volume e95fdf8e-507a-4603-966c-a4a26daa7b76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e95fdf8e-507a-4603-966c-a4a26daa7b76', 'volume_size': 1}
Jul 10 13:00:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0d387266-6149-449e-a367-3d5cd56c7950 tempest-CreateVolumesFromImageTest-1102869783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:00:34 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-732449c9-2607-4e64-97ad-720ab317210d tempest-VolumeDependencyTests-267861649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 13:00:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-732449c9-2607-4e64-97ad-720ab317210d tempest-VolumeDependencyTests-267861649 None] Flow 'volume_create_manager' (94421bde-5197-45a9-9ea9-36f9f0f6e38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:00:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-732449c9-2607-4e64-97ad-720ab317210d tempest-VolumeDependencyTests-267861649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cdf23a8-8119-448b-93a2-4e019d02bdc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-732449c9-2607-4e64-97ad-720ab317210d tempest-VolumeDependencyTests-267861649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cdf23a8-8119-448b-93a2-4e019d02bdc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-142327491',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bc213eb-0dd0-47cc-b32e-58cf28aee65b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b55db6bd5a3477787e6310297009360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:00:35Z,use_quota=True,user_id='78db252798a14ecc8262d4785a8e4d9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-732449c9-2607-4e64-97ad-720ab317210d tempest-VolumeDependencyTests-267861649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c69a1b5a-4c4c-4f3d-a316-b6efd45dbd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-732449c9-2607-4e64-97ad-720ab317210d tempest-VolumeDependencyTests-267861649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c69a1b5a-4c4c-4f3d-a316-b6efd45dbd44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-732449c9-2607-4e64-97ad-720ab317210d tempest-VolumeDependencyTests-267861649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5da95bd9-bd99-4406-8076-3a36df03bdc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-732449c9-2607-4e64-97ad-720ab317210d tempest-VolumeDependencyTests-267861649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5da95bd9-bd99-4406-8076-3a36df03bdc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bc213eb-0dd0-47cc-b32e-58cf28aee65b', 'volume_name': 'volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-732449c9-2607-4e64-97ad-720ab317210d tempest-VolumeDependencyTests-267861649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8666e25a-5c93-4590-af7c-e8b052fb3645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-732449c9-2607-4e64-97ad-720ab317210d tempest-VolumeDependencyTests-267861649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8666e25a-5c93-4590-af7c-e8b052fb3645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-732449c9-2607-4e64-97ad-720ab317210d tempest-VolumeDependencyTests-267861649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7182a9d-f9b0-4435-90f1-42e0a348bff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:34 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-732449c9-2607-4e64-97ad-720ab317210d tempest-VolumeDependencyTests-267861649 None] Volume 0bc213eb-0dd0-47cc-b32e-58cf28aee65b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b', 'volume_size': 1}
Jul 10 13:00:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-732449c9-2607-4e64-97ad-720ab317210d tempest-VolumeDependencyTests-267861649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:00:34 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-983decd5-b732-4a3e-99b1-e909cf89907a tempest-CreateVolumesFromSourceVolumeTest-957425387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b7a302de-50af-4c70-a17c-e67466b7a364 1073741824" returned: 0 in 1.211s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:34 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-8efd7080-2ab8-4bac-b0d1-3cfed44f9427 tempest-CreateVolumesFromImageTest-1102869783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 13:00:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-8efd7080-2ab8-4bac-b0d1-3cfed44f9427 tempest-CreateVolumesFromImageTest-1102869783 None] Flow 'volume_create_manager' (421aa549-1f4e-4f4e-a4b4-972183f8ca8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:00:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-8efd7080-2ab8-4bac-b0d1-3cfed44f9427 tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (404a1685-3abe-4dc7-a07d-33132f34ee76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-8efd7080-2ab8-4bac-b0d1-3cfed44f9427 tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (404a1685-3abe-4dc7-a07d-33132f34ee76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1749589197',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aedaec1-d7db-4cdc-9414-79e26e97d5cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dc89b2f617d4bbb941ef0040937ee68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:00:35Z,use_quota=True,user_id='15445870d3de43569566675dd2a5eade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-8efd7080-2ab8-4bac-b0d1-3cfed44f9427 tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8e3e604-b024-4e69-9a81-290e1309f2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-8efd7080-2ab8-4bac-b0d1-3cfed44f9427 tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8e3e604-b024-4e69-9a81-290e1309f2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-8efd7080-2ab8-4bac-b0d1-3cfed44f9427 tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35b02bc1-521c-44ec-8795-fbabf5d1c974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-8efd7080-2ab8-4bac-b0d1-3cfed44f9427 tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35b02bc1-521c-44ec-8795-fbabf5d1c974) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0aedaec1-d7db-4cdc-9414-79e26e97d5cf', 'volume_name': 'volume-0aedaec1-d7db-4cdc-9414-79e26e97d5cf', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-8efd7080-2ab8-4bac-b0d1-3cfed44f9427 tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f63b4cb6-6707-4577-acb2-599e6dbb17ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-8efd7080-2ab8-4bac-b0d1-3cfed44f9427 tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f63b4cb6-6707-4577-acb2-599e6dbb17ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-8efd7080-2ab8-4bac-b0d1-3cfed44f9427 tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9fb24f7-b189-4800-b13d-f3613519012a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:34 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-8efd7080-2ab8-4bac-b0d1-3cfed44f9427 tempest-CreateVolumesFromImageTest-1102869783 None] Volume 0aedaec1-d7db-4cdc-9414-79e26e97d5cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0aedaec1-d7db-4cdc-9414-79e26e97d5cf', 'volume_size': 1}
Jul 10 13:00:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-8efd7080-2ab8-4bac-b0d1-3cfed44f9427 tempest-CreateVolumesFromImageTest-1102869783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:00:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-983decd5-b732-4a3e-99b1-e909cf89907a tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b7a302de-50af-4c70-a17c-e67466b7a364 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:35 devstack sudo[105997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b7a302de-50af-4c70-a17c-e67466b7a364
Jul 10 13:00:35 devstack sudo[105997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:35 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c9a8b0f-6ca1-4027-9d4a-43b92ea7f3d5 tempest-CreateVolumesFromImageTest-1102869783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 13:00:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0c9a8b0f-6ca1-4027-9d4a-43b92ea7f3d5 tempest-CreateVolumesFromImageTest-1102869783 None] Flow 'volume_create_manager' (fe653a89-9900-47d8-aa75-40670bdb04d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:00:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0c9a8b0f-6ca1-4027-9d4a-43b92ea7f3d5 tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09e8ff1a-750c-4455-9559-06455233f5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0c9a8b0f-6ca1-4027-9d4a-43b92ea7f3d5 tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09e8ff1a-750c-4455-9559-06455233f5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:00:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-23356908',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cdc76c1-d41f-4bba-80f5-789dd31a8287,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dc89b2f617d4bbb941ef0040937ee68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:00:35Z,use_quota=True,user_id='15445870d3de43569566675dd2a5eade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0c9a8b0f-6ca1-4027-9d4a-43b92ea7f3d5 tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed828506-c0b4-41aa-99b4-b290ab7a7111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0c9a8b0f-6ca1-4027-9d4a-43b92ea7f3d5 tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed828506-c0b4-41aa-99b4-b290ab7a7111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0c9a8b0f-6ca1-4027-9d4a-43b92ea7f3d5 tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f208ac11-0dc6-4a8d-8ee1-a9c732070449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0c9a8b0f-6ca1-4027-9d4a-43b92ea7f3d5 tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f208ac11-0dc6-4a8d-8ee1-a9c732070449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cdc76c1-d41f-4bba-80f5-789dd31a8287', 'volume_name': 'volume-3cdc76c1-d41f-4bba-80f5-789dd31a8287', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0c9a8b0f-6ca1-4027-9d4a-43b92ea7f3d5 tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df48b62b-8639-4995-9b6e-d2b9233a6da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0c9a8b0f-6ca1-4027-9d4a-43b92ea7f3d5 tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df48b62b-8639-4995-9b6e-d2b9233a6da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0c9a8b0f-6ca1-4027-9d4a-43b92ea7f3d5 tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86eec300-01ed-42a0-b581-8958977e0e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:35 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-0c9a8b0f-6ca1-4027-9d4a-43b92ea7f3d5 tempest-CreateVolumesFromImageTest-1102869783 None] Volume 3cdc76c1-d41f-4bba-80f5-789dd31a8287: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cdc76c1-d41f-4bba-80f5-789dd31a8287', 'volume_size': 1}
Jul 10 13:00:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0c9a8b0f-6ca1-4027-9d4a-43b92ea7f3d5 tempest-CreateVolumesFromImageTest-1102869783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:00:35 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c06e307-59b1-4e29-b1f6-6e57c46c541a tempest-CreateVolumesFromImageTest-1102869783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 13:00:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5c06e307-59b1-4e29-b1f6-6e57c46c541a tempest-CreateVolumesFromImageTest-1102869783 None] Flow 'volume_create_manager' (faee8b08-5d55-434f-b4a1-26cf43051fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:00:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5c06e307-59b1-4e29-b1f6-6e57c46c541a tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (689d2f78-e7ac-4dbf-9b08-3e13904b326e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5c06e307-59b1-4e29-b1f6-6e57c46c541a tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (689d2f78-e7ac-4dbf-9b08-3e13904b326e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:00:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1966914481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e311877-2577-428a-ac10-bb21053582d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dc89b2f617d4bbb941ef0040937ee68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:00:36Z,use_quota=True,user_id='15445870d3de43569566675dd2a5eade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5c06e307-59b1-4e29-b1f6-6e57c46c541a tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b2164a6-59a8-466c-ab14-c371b3e27e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5c06e307-59b1-4e29-b1f6-6e57c46c541a tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b2164a6-59a8-466c-ab14-c371b3e27e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5c06e307-59b1-4e29-b1f6-6e57c46c541a tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c623b5d0-166c-4c89-960f-dff86cc13e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5c06e307-59b1-4e29-b1f6-6e57c46c541a tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c623b5d0-166c-4c89-960f-dff86cc13e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e311877-2577-428a-ac10-bb21053582d7', 'volume_name': 'volume-0e311877-2577-428a-ac10-bb21053582d7', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5c06e307-59b1-4e29-b1f6-6e57c46c541a tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6749fa88-6dc8-481b-9495-a0f6f607ec00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5c06e307-59b1-4e29-b1f6-6e57c46c541a tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6749fa88-6dc8-481b-9495-a0f6f607ec00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5c06e307-59b1-4e29-b1f6-6e57c46c541a tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae1717c2-5ed1-4e34-b0f0-e8ea998f3942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:35 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-5c06e307-59b1-4e29-b1f6-6e57c46c541a tempest-CreateVolumesFromImageTest-1102869783 None] Volume 0e311877-2577-428a-ac10-bb21053582d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e311877-2577-428a-ac10-bb21053582d7', 'volume_size': 1}
Jul 10 13:00:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5c06e307-59b1-4e29-b1f6-6e57c46c541a tempest-CreateVolumesFromImageTest-1102869783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:00:35 devstack sudo[105997]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-983decd5-b732-4a3e-99b1-e909cf89907a tempest-CreateVolumesFromSourceVolumeTest-957425387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b7a302de-50af-4c70-a17c-e67466b7a364" returned: 0 in 0.724s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:35 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-983decd5-b732-4a3e-99b1-e909cf89907a tempest-CreateVolumesFromSourceVolumeTest-957425387 None] <== create_volume: return (2049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 13:00:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-983decd5-b732-4a3e-99b1-e909cf89907a tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.051s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:00:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a8620f4d-9fde-4cc3-ac60-1281c695e0f4 tempest-CreateVolumesFromImageTest-1102869783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.829s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:00:35 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-a8620f4d-9fde-4cc3-ac60-1281c695e0f4 tempest-CreateVolumesFromImageTest-1102869783 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1106629616',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06bc4536-277b-4417-bc99-0f41dc843d6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dc89b2f617d4bbb941ef0040937ee68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:00:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:00:34Z,use_quota=True,user_id='15445870d3de43569566675dd2a5eade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 13:00:35 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-a8620f4d-9fde-4cc3-ac60-1281c695e0f4 tempest-CreateVolumesFromImageTest-1102869783 None] Creating volume 06bc4536-277b-4417-bc99-0f41dc843d6f {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 13:00:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a8620f4d-9fde-4cc3-ac60-1281c695e0f4 tempest-CreateVolumesFromImageTest-1102869783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:00:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a8620f4d-9fde-4cc3-ac60-1281c695e0f4 tempest-CreateVolumesFromImageTest-1102869783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:00:35 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-a8620f4d-9fde-4cc3-ac60-1281c695e0f4 tempest-CreateVolumesFromImageTest-1102869783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:00:35 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-a8620f4d-9fde-4cc3-ac60-1281c695e0f4 tempest-CreateVolumesFromImageTest-1102869783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:00:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a8620f4d-9fde-4cc3-ac60-1281c695e0f4 tempest-CreateVolumesFromImageTest-1102869783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:00:35 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-a8620f4d-9fde-4cc3-ac60-1281c695e0f4 tempest-CreateVolumesFromImageTest-1102869783 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 13:00:35 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-a8620f4d-9fde-4cc3-ac60-1281c695e0f4 tempest-CreateVolumesFromImageTest-1102869783 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 13:00:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a8620f4d-9fde-4cc3-ac60-1281c695e0f4 tempest-CreateVolumesFromImageTest-1102869783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-06bc4536-277b-4417-bc99-0f41dc843d6f 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-983decd5-b732-4a3e-99b1-e909cf89907a tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad86d762-bc00-476a-8563-1249816b52fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7a302de-50af-4c70-a17c-e67466b7a364', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-983decd5-b732-4a3e-99b1-e909cf89907a tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff44fd77-1e01-4f4b-9186-e097794582bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:35 devstack sudo[106006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-06bc4536-277b-4417-bc99-0f41dc843d6f 1073741824
Jul 10 13:00:35 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:35 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-983decd5-b732-4a3e-99b1-e909cf89907a tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Volume volume-b7a302de-50af-4c70-a17c-e67466b7a364 (b7a302de-50af-4c70-a17c-e67466b7a364): created successfully
Jul 10 13:00:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-983decd5-b732-4a3e-99b1-e909cf89907a tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff44fd77-1e01-4f4b-9186-e097794582bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-983decd5-b732-4a3e-99b1-e909cf89907a tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Flow 'volume_create_manager' (49da3925-dd8e-4196-9d86-9f9f42cac8e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:00:35 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-983decd5-b732-4a3e-99b1-e909cf89907a tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Created volume successfully.
Jul 10 13:00:36 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a8620f4d-9fde-4cc3-ac60-1281c695e0f4 tempest-CreateVolumesFromImageTest-1102869783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-06bc4536-277b-4417-bc99-0f41dc843d6f 1073741824" returned: 0 in 0.877s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a8620f4d-9fde-4cc3-ac60-1281c695e0f4 tempest-CreateVolumesFromImageTest-1102869783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-06bc4536-277b-4417-bc99-0f41dc843d6f {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:36 devstack sudo[106012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-06bc4536-277b-4417-bc99-0f41dc843d6f
Jul 10 13:00:36 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:37 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa072de4-0e39-4102-bb68-b5509905159b tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 13:00:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fa072de4-0e39-4102-bb68-b5509905159b tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Flow 'volume_create_manager' (94a78ac6-3877-432f-86e8-bec65819249f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:00:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fa072de4-0e39-4102-bb68-b5509905159b tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f73a268-3e3a-4857-9cb8-34d03a4524f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fa072de4-0e39-4102-bb68-b5509905159b tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f73a268-3e3a-4857-9cb8-34d03a4524f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:00:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2057521407',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50144674-4409-47e2-a4bb-58f345844e53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84e579c70c144614bc09f57470b7adb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:00:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:00:37Z,use_quota=True,user_id='c068905698ca495e8e18b2b59f3d1563',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fa072de4-0e39-4102-bb68-b5509905159b tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fca46d1-8e87-433d-be62-3efb67e1c2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fa072de4-0e39-4102-bb68-b5509905159b tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fca46d1-8e87-433d-be62-3efb67e1c2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fa072de4-0e39-4102-bb68-b5509905159b tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06bbc980-2f6b-417f-9a5c-8d410830ee2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fa072de4-0e39-4102-bb68-b5509905159b tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06bbc980-2f6b-417f-9a5c-8d410830ee2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50144674-4409-47e2-a4bb-58f345844e53', 'volume_name': 'volume-50144674-4409-47e2-a4bb-58f345844e53', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fa072de4-0e39-4102-bb68-b5509905159b tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e1cca45-2529-4bcb-bec9-03d2e5006751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fa072de4-0e39-4102-bb68-b5509905159b tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e1cca45-2529-4bcb-bec9-03d2e5006751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fa072de4-0e39-4102-bb68-b5509905159b tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f1e23bb-828c-4a18-a471-4b45e9a86923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:37 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-fa072de4-0e39-4102-bb68-b5509905159b tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Volume 50144674-4409-47e2-a4bb-58f345844e53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50144674-4409-47e2-a4bb-58f345844e53', 'volume_size': 1}
Jul 10 13:00:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-fa072de4-0e39-4102-bb68-b5509905159b tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:00:37 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a8620f4d-9fde-4cc3-ac60-1281c695e0f4 tempest-CreateVolumesFromImageTest-1102869783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-06bc4536-277b-4417-bc99-0f41dc843d6f" returned: 0 in 0.841s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:37 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-a8620f4d-9fde-4cc3-ac60-1281c695e0f4 tempest-CreateVolumesFromImageTest-1102869783 None] <== create_volume: return (1764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 13:00:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a8620f4d-9fde-4cc3-ac60-1281c695e0f4 tempest-CreateVolumesFromImageTest-1102869783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.766s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:00:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0d387266-6149-449e-a367-3d5cd56c7950 tempest-CreateVolumesFromImageTest-1102869783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.133s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:00:37 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-0d387266-6149-449e-a367-3d5cd56c7950 tempest-CreateVolumesFromImageTest-1102869783 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1940772238',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e95fdf8e-507a-4603-966c-a4a26daa7b76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dc89b2f617d4bbb941ef0040937ee68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:00:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:00:34Z,use_quota=True,user_id='15445870d3de43569566675dd2a5eade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 13:00:37 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-0d387266-6149-449e-a367-3d5cd56c7950 tempest-CreateVolumesFromImageTest-1102869783 None] Creating volume e95fdf8e-507a-4603-966c-a4a26daa7b76 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 13:00:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0d387266-6149-449e-a367-3d5cd56c7950 tempest-CreateVolumesFromImageTest-1102869783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:00:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0d387266-6149-449e-a367-3d5cd56c7950 tempest-CreateVolumesFromImageTest-1102869783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:00:37 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-0d387266-6149-449e-a367-3d5cd56c7950 tempest-CreateVolumesFromImageTest-1102869783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:00:37 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-0d387266-6149-449e-a367-3d5cd56c7950 tempest-CreateVolumesFromImageTest-1102869783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:00:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0d387266-6149-449e-a367-3d5cd56c7950 tempest-CreateVolumesFromImageTest-1102869783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:00:37 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-0d387266-6149-449e-a367-3d5cd56c7950 tempest-CreateVolumesFromImageTest-1102869783 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 13:00:37 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-0d387266-6149-449e-a367-3d5cd56c7950 tempest-CreateVolumesFromImageTest-1102869783 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 13:00:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0d387266-6149-449e-a367-3d5cd56c7950 tempest-CreateVolumesFromImageTest-1102869783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e95fdf8e-507a-4603-966c-a4a26daa7b76 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a8620f4d-9fde-4cc3-ac60-1281c695e0f4 tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52650885-2155-4447-b42f-3421575c9751) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06bc4536-277b-4417-bc99-0f41dc843d6f', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:37 devstack sudo[106016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e95fdf8e-507a-4603-966c-a4a26daa7b76 1073741824
Jul 10 13:00:37 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a8620f4d-9fde-4cc3-ac60-1281c695e0f4 tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38761bd2-0399-4ec8-a8c2-14cc6b78ddd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:37 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-a8620f4d-9fde-4cc3-ac60-1281c695e0f4 tempest-CreateVolumesFromImageTest-1102869783 None] Volume volume-06bc4536-277b-4417-bc99-0f41dc843d6f (06bc4536-277b-4417-bc99-0f41dc843d6f): created successfully
Jul 10 13:00:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a8620f4d-9fde-4cc3-ac60-1281c695e0f4 tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38761bd2-0399-4ec8-a8c2-14cc6b78ddd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a8620f4d-9fde-4cc3-ac60-1281c695e0f4 tempest-CreateVolumesFromImageTest-1102869783 None] Flow 'volume_create_manager' (77c9211a-01c1-4f8a-ba23-f794188ff602) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:00:37 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-a8620f4d-9fde-4cc3-ac60-1281c695e0f4 tempest-CreateVolumesFromImageTest-1102869783 None] Created volume successfully.
Jul 10 13:00:37 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d90ba1d-b4d5-4b4f-bd5c-01a3fbabaaac tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 13:00:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7d90ba1d-b4d5-4b4f-bd5c-01a3fbabaaac tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Flow 'volume_create_manager' (4ae8ef34-1c1c-4316-98a3-379715665d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:00:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7d90ba1d-b4d5-4b4f-bd5c-01a3fbabaaac tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0242e590-f6f5-4128-a748-ce8a10f498fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7d90ba1d-b4d5-4b4f-bd5c-01a3fbabaaac tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0242e590-f6f5-4128-a748-ce8a10f498fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:00:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1328203659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e24ed74a-05aa-43ba-a58d-6bcd810662f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84e579c70c144614bc09f57470b7adb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:00:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:00:38Z,use_quota=True,user_id='c068905698ca495e8e18b2b59f3d1563',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7d90ba1d-b4d5-4b4f-bd5c-01a3fbabaaac tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73316e5e-1ccd-413e-a0a3-2ba9d66470e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7d90ba1d-b4d5-4b4f-bd5c-01a3fbabaaac tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73316e5e-1ccd-413e-a0a3-2ba9d66470e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7d90ba1d-b4d5-4b4f-bd5c-01a3fbabaaac tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (596f51ff-f787-405a-a571-d4e2c20c9460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7d90ba1d-b4d5-4b4f-bd5c-01a3fbabaaac tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (596f51ff-f787-405a-a571-d4e2c20c9460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e24ed74a-05aa-43ba-a58d-6bcd810662f2', 'volume_name': 'volume-e24ed74a-05aa-43ba-a58d-6bcd810662f2', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7d90ba1d-b4d5-4b4f-bd5c-01a3fbabaaac tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8090d37-e07a-48e0-b10c-c1881e625590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7d90ba1d-b4d5-4b4f-bd5c-01a3fbabaaac tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8090d37-e07a-48e0-b10c-c1881e625590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7d90ba1d-b4d5-4b4f-bd5c-01a3fbabaaac tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0932e302-8d9d-48b7-ab3c-db6f62561afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:37 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-7d90ba1d-b4d5-4b4f-bd5c-01a3fbabaaac tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Volume e24ed74a-05aa-43ba-a58d-6bcd810662f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e24ed74a-05aa-43ba-a58d-6bcd810662f2', 'volume_size': 1}
Jul 10 13:00:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-7d90ba1d-b4d5-4b4f-bd5c-01a3fbabaaac tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:00:38 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-77ee1b72-2c46-478c-8d54-8196f2c32913 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 13:00:38 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-77ee1b72-2c46-478c-8d54-8196f2c32913 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Flow 'volume_create_manager' (9cfa2151-6bf2-4d05-b268-67e5212a8846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:00:38 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-77ee1b72-2c46-478c-8d54-8196f2c32913 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a61e7e8-60ab-4c01-a9f4-6afe2a57bf44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:38 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-77ee1b72-2c46-478c-8d54-8196f2c32913 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a61e7e8-60ab-4c01-a9f4-6afe2a57bf44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:00:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-559870466',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1979c563-bac5-4437-ad33-5252ca4ae11d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84e579c70c144614bc09f57470b7adb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:00:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:00:38Z,use_quota=True,user_id='c068905698ca495e8e18b2b59f3d1563',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:38 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-77ee1b72-2c46-478c-8d54-8196f2c32913 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a75ece7-0cc8-4aa2-9da9-8ef1f5c287de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:38 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-77ee1b72-2c46-478c-8d54-8196f2c32913 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a75ece7-0cc8-4aa2-9da9-8ef1f5c287de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:38 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-77ee1b72-2c46-478c-8d54-8196f2c32913 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef010f31-050b-42d3-8846-3d1ddc36bbfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:38 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-77ee1b72-2c46-478c-8d54-8196f2c32913 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef010f31-050b-42d3-8846-3d1ddc36bbfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1979c563-bac5-4437-ad33-5252ca4ae11d', 'volume_name': 'volume-1979c563-bac5-4437-ad33-5252ca4ae11d', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:38 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-77ee1b72-2c46-478c-8d54-8196f2c32913 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6736e598-d400-494e-ae75-e4b8bdcfd063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:38 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-77ee1b72-2c46-478c-8d54-8196f2c32913 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6736e598-d400-494e-ae75-e4b8bdcfd063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:38 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-77ee1b72-2c46-478c-8d54-8196f2c32913 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (985fd8e3-300a-4a64-8a62-7d55b6098e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:38 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-77ee1b72-2c46-478c-8d54-8196f2c32913 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Volume 1979c563-bac5-4437-ad33-5252ca4ae11d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1979c563-bac5-4437-ad33-5252ca4ae11d', 'volume_size': 1}
Jul 10 13:00:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-77ee1b72-2c46-478c-8d54-8196f2c32913 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:00:38 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 13:00:38 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:38 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Flow 'volume_create_manager' (c9c1fe04-676f-4d5a-8346-731ad6adceac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:00:38 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (780a0f70-a2d6-41fb-ab82-d14892313773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0d387266-6149-449e-a367-3d5cd56c7950 tempest-CreateVolumesFromImageTest-1102869783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e95fdf8e-507a-4603-966c-a4a26daa7b76 1073741824" returned: 0 in 1.050s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:38 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (780a0f70-a2d6-41fb-ab82-d14892313773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:00:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9642ab4-fac2-4adf-8f8f-e5f69d079bee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdc050b6427f4133a5b25c2bec71dbc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:00:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:00:38Z,use_quota=True,user_id='9178493fcf824166a27e9cd0bea2eb38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06e88013-0a26-4ca3-8d35-a2e0a1e71672),volume_type_id=06e88013-0a26-4ca3-8d35-a2e0a1e71672)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:38 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (328b36eb-1ae9-441f-8c9f-9e1599c74cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:38 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (328b36eb-1ae9-441f-8c9f-9e1599c74cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:38 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfdb05b1-dd08-4adf-adaa-cd14ea115d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:38 devstack cinder-volume[87378]: DEBUG cinder.image.glance [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Creating Keystone auth plugin from conf {{(pid=87378) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 10 13:00:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0d387266-6149-449e-a367-3d5cd56c7950 tempest-CreateVolumesFromImageTest-1102869783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e95fdf8e-507a-4603-966c-a4a26daa7b76 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:38 devstack sudo[106022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e95fdf8e-507a-4603-966c-a4a26daa7b76
Jul 10 13:00:38 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:38 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-67ee6efb-14fb-44a1-8767-e1f1edc9a977 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 13:00:38 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-67ee6efb-14fb-44a1-8767-e1f1edc9a977 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Flow 'volume_create_manager' (3a7cd5c3-292f-4252-93cb-6d2fabe9389b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:00:38 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-67ee6efb-14fb-44a1-8767-e1f1edc9a977 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca4b85ca-575f-4593-9764-48a645509533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:38 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-67ee6efb-14fb-44a1-8767-e1f1edc9a977 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca4b85ca-575f-4593-9764-48a645509533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:00:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1411033443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fdff3f6-2dde-4892-8af2-beb59cfd1313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84e579c70c144614bc09f57470b7adb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:00:39Z,use_quota=True,user_id='c068905698ca495e8e18b2b59f3d1563',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:38 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-67ee6efb-14fb-44a1-8767-e1f1edc9a977 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e02e089-60e4-4a9f-93a1-f2ab8ebd3d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:38 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-67ee6efb-14fb-44a1-8767-e1f1edc9a977 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e02e089-60e4-4a9f-93a1-f2ab8ebd3d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:38 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-67ee6efb-14fb-44a1-8767-e1f1edc9a977 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67596797-81bd-46c3-8709-9a263f5f6323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:38 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-67ee6efb-14fb-44a1-8767-e1f1edc9a977 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67596797-81bd-46c3-8709-9a263f5f6323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fdff3f6-2dde-4892-8af2-beb59cfd1313', 'volume_name': 'volume-4fdff3f6-2dde-4892-8af2-beb59cfd1313', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:38 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-67ee6efb-14fb-44a1-8767-e1f1edc9a977 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c0fd207-f3b1-436e-81b4-8cbb7e66b8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:38 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-67ee6efb-14fb-44a1-8767-e1f1edc9a977 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c0fd207-f3b1-436e-81b4-8cbb7e66b8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:38 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-67ee6efb-14fb-44a1-8767-e1f1edc9a977 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6471756c-b13c-4af6-8032-7637a0a2a7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:38 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-67ee6efb-14fb-44a1-8767-e1f1edc9a977 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Volume 4fdff3f6-2dde-4892-8af2-beb59cfd1313: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fdff3f6-2dde-4892-8af2-beb59cfd1313', 'volume_size': 1}
Jul 10 13:00:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-67ee6efb-14fb-44a1-8767-e1f1edc9a977 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:00:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfdb05b1-dd08-4adf-adaa-cd14ea115d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b9642ab4-fac2-4adf-8f8f-e5f69d079bee', 'volume_name': 'volume-b9642ab4-fac2-4adf-8f8f-e5f69d079bee', 'volume_size': 1, 'image_id': 'a799f54a-6443-455c-91db-db5a8815ec19', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a799f54a-6443-455c-91db-db5a8815ec19', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '859102d24c4c5c18d253a59dcdfacd84', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fdc050b6427f4133a5b25c2bec71dbc2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '546e338d6459ff7386c04674cab05688954cc1f335e297f05e92ec69b41d6e9ed3833aa9603d0728f49c89e95e6aff6632bc75b31d744ddaaca3343885f30574', 'id': 'a799f54a-6443-455c-91db-db5a8815ec19', 'created_at': datetime.datetime(2026, 7, 10, 11, 0, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 11, 0, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a799f54a-6443-455c-91db-db5a8815ec19/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74a0a1726fc0>}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e0b3ca6-b7ae-4ccb-9cbb-5ba6bbcc0362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e0b3ca6-b7ae-4ccb-9cbb-5ba6bbcc0362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8a04c47-158f-4c57-aebc-fe52be4fda84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:39 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Volume b9642ab4-fac2-4adf-8f8f-e5f69d079bee: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b9642ab4-fac2-4adf-8f8f-e5f69d079bee', 'volume_size': 1, 'image_id': 'a799f54a-6443-455c-91db-db5a8815ec19', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a799f54a-6443-455c-91db-db5a8815ec19', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '859102d24c4c5c18d253a59dcdfacd84', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fdc050b6427f4133a5b25c2bec71dbc2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '546e338d6459ff7386c04674cab05688954cc1f335e297f05e92ec69b41d6e9ed3833aa9603d0728f49c89e95e6aff6632bc75b31d744ddaaca3343885f30574', 'id': 'a799f54a-6443-455c-91db-db5a8815ec19', 'created_at': datetime.datetime(2026, 7, 10, 11, 0, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 11, 0, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a799f54a-6443-455c-91db-db5a8815ec19/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74a0a1726fc0>}
Jul 10 13:00:39 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Trying to clone b9642ab4-fac2-4adf-8f8f-e5f69d079bee from image a799f54a-6443-455c-91db-db5a8815ec19 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a799f54a-6443-455c-91db-db5a8815ec19', 'metadata': {}}]). {{(pid=87378) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 10 13:00:39 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fcca8e8-688f-44b6-9fef-6cb387f47bd8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 13:00:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6fcca8e8-688f-44b6-9fef-6cb387f47bd8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Flow 'volume_create_manager' (aa5ee31f-16ac-4dfb-9d2c-07cfb8a82570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:00:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6fcca8e8-688f-44b6-9fef-6cb387f47bd8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c70221f6-ffee-49ce-9ea9-c8df3741f482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6fcca8e8-688f-44b6-9fef-6cb387f47bd8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c70221f6-ffee-49ce-9ea9-c8df3741f482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1383875860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f51904bd-e872-4fa8-ba56-8c064a3898d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84e579c70c144614bc09f57470b7adb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:00:39Z,use_quota=True,user_id='c068905698ca495e8e18b2b59f3d1563',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6fcca8e8-688f-44b6-9fef-6cb387f47bd8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4abec878-5873-40fd-b7cf-646480ee90cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6fcca8e8-688f-44b6-9fef-6cb387f47bd8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4abec878-5873-40fd-b7cf-646480ee90cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6fcca8e8-688f-44b6-9fef-6cb387f47bd8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf5fb7d4-68e7-4c06-8e59-76bf27c20c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6fcca8e8-688f-44b6-9fef-6cb387f47bd8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf5fb7d4-68e7-4c06-8e59-76bf27c20c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f51904bd-e872-4fa8-ba56-8c064a3898d5', 'volume_name': 'volume-f51904bd-e872-4fa8-ba56-8c064a3898d5', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6fcca8e8-688f-44b6-9fef-6cb387f47bd8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46bd4b11-c8df-4207-8687-0756781e8a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6fcca8e8-688f-44b6-9fef-6cb387f47bd8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46bd4b11-c8df-4207-8687-0756781e8a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6fcca8e8-688f-44b6-9fef-6cb387f47bd8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05815068-b3c7-49e7-9841-90d2fd8ad09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:39 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-6fcca8e8-688f-44b6-9fef-6cb387f47bd8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Volume f51904bd-e872-4fa8-ba56-8c064a3898d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f51904bd-e872-4fa8-ba56-8c064a3898d5', 'volume_size': 1}
Jul 10 13:00:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-6fcca8e8-688f-44b6-9fef-6cb387f47bd8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:00:39 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a799f54a-6443-455c-91db-db5a8815ec19_eag83arrdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87378) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 10 13:00:39 devstack cinder-volume[87378]: INFO cinder.image.image_utils [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Image download 0.00 MB at 0.00 MB/s
Jul 10 13:00:39 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f261d1c0-3445-4faa-8268-d87ebab5accf]: (4, 'raw') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:00:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a799f54a-6443-455c-91db-db5a8815ec19_eag83arrdevstack@QuobyteHD {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:39 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0d387266-6149-449e-a367-3d5cd56c7950 tempest-CreateVolumesFromImageTest-1102869783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e95fdf8e-507a-4603-966c-a4a26daa7b76" returned: 0 in 0.856s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-0d387266-6149-449e-a367-3d5cd56c7950 tempest-CreateVolumesFromImageTest-1102869783 None] <== create_volume: return (1977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 13:00:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0d387266-6149-449e-a367-3d5cd56c7950 tempest-CreateVolumesFromImageTest-1102869783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.981s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:00:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-732449c9-2607-4e64-97ad-720ab317210d tempest-VolumeDependencyTests-267861649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.599s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:00:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-732449c9-2607-4e64-97ad-720ab317210d tempest-VolumeDependencyTests-267861649 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-142327491',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bc213eb-0dd0-47cc-b32e-58cf28aee65b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b55db6bd5a3477787e6310297009360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:00:35Z,use_quota=True,user_id='78db252798a14ecc8262d4785a8e4d9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 13:00:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-732449c9-2607-4e64-97ad-720ab317210d tempest-VolumeDependencyTests-267861649 None] Creating volume 0bc213eb-0dd0-47cc-b32e-58cf28aee65b {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 13:00:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-732449c9-2607-4e64-97ad-720ab317210d tempest-VolumeDependencyTests-267861649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:00:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-732449c9-2607-4e64-97ad-720ab317210d tempest-VolumeDependencyTests-267861649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:00:39 devstack sudo[106025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a799f54a-6443-455c-91db-db5a8815ec19_eag83arrdevstack@QuobyteHD
Jul 10 13:00:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-732449c9-2607-4e64-97ad-720ab317210d tempest-VolumeDependencyTests-267861649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:00:39 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-732449c9-2607-4e64-97ad-720ab317210d tempest-VolumeDependencyTests-267861649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:00:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-732449c9-2607-4e64-97ad-720ab317210d tempest-VolumeDependencyTests-267861649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:00:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-732449c9-2607-4e64-97ad-720ab317210d tempest-VolumeDependencyTests-267861649 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 13:00:39 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-732449c9-2607-4e64-97ad-720ab317210d tempest-VolumeDependencyTests-267861649 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 13:00:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-732449c9-2607-4e64-97ad-720ab317210d tempest-VolumeDependencyTests-267861649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0d387266-6149-449e-a367-3d5cd56c7950 tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd02a097-d590-4eb4-bef1-9abf8e105854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e95fdf8e-507a-4603-966c-a4a26daa7b76', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0d387266-6149-449e-a367-3d5cd56c7950 tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fd74e37-d155-4ff6-8e78-e6e1124bd5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:39 devstack sudo[106028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b 1073741824
Jul 10 13:00:39 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:39 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-0d387266-6149-449e-a367-3d5cd56c7950 tempest-CreateVolumesFromImageTest-1102869783 None] Volume volume-e95fdf8e-507a-4603-966c-a4a26daa7b76 (e95fdf8e-507a-4603-966c-a4a26daa7b76): created successfully
Jul 10 13:00:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0d387266-6149-449e-a367-3d5cd56c7950 tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fd74e37-d155-4ff6-8e78-e6e1124bd5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0d387266-6149-449e-a367-3d5cd56c7950 tempest-CreateVolumesFromImageTest-1102869783 None] Flow 'volume_create_manager' (6102feaa-670a-4fd8-9afe-ed0f4d01e748) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:00:39 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-0d387266-6149-449e-a367-3d5cd56c7950 tempest-CreateVolumesFromImageTest-1102869783 None] Created volume successfully.
Jul 10 13:00:40 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a799f54a-6443-455c-91db-db5a8815ec19_eag83arrdevstack@QuobyteHD" returned: 0 in 0.744s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a799f54a-6443-455c-91db-db5a8815ec19_eag83arrdevstack@QuobyteHD {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:40 devstack sudo[106036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a799f54a-6443-455c-91db-db5a8815ec19_eag83arrdevstack@QuobyteHD
Jul 10 13:00:40 devstack sudo[106036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:40 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-732449c9-2607-4e64-97ad-720ab317210d tempest-VolumeDependencyTests-267861649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b 1073741824" returned: 0 in 0.853s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-732449c9-2607-4e64-97ad-720ab317210d tempest-VolumeDependencyTests-267861649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:40 devstack sudo[106038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b
Jul 10 13:00:40 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:40 devstack sudo[106036]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a799f54a-6443-455c-91db-db5a8815ec19_eag83arrdevstack@QuobyteHD" returned: 1 in 0.710s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a799f54a-6443-455c-91db-db5a8815ec19_eag83arrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 10 13:00:40 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Temporary image a799f54a-6443-455c-91db-db5a8815ec19 is fetched for user 9178493fcf824166a27e9cd0bea2eb38. {{(pid=87378) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 10 13:00:40 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a01383-a9b4-41a1-aa99-7d9ec7327edd]: (4, 'raw') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:00:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a799f54a-6443-455c-91db-db5a8815ec19_eag83arrdevstack@QuobyteHD {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:41 devstack sudo[106043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a799f54a-6443-455c-91db-db5a8815ec19_eag83arrdevstack@QuobyteHD
Jul 10 13:00:41 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:41 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-732449c9-2607-4e64-97ad-720ab317210d tempest-VolumeDependencyTests-267861649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b" returned: 0 in 0.657s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:41 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-732449c9-2607-4e64-97ad-720ab317210d tempest-VolumeDependencyTests-267861649 None] <== create_volume: return (1555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 13:00:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-732449c9-2607-4e64-97ad-720ab317210d tempest-VolumeDependencyTests-267861649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:00:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-8efd7080-2ab8-4bac-b0d1-3cfed44f9427 tempest-CreateVolumesFromImageTest-1102869783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.049s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:00:41 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-8efd7080-2ab8-4bac-b0d1-3cfed44f9427 tempest-CreateVolumesFromImageTest-1102869783 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1749589197',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aedaec1-d7db-4cdc-9414-79e26e97d5cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dc89b2f617d4bbb941ef0040937ee68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:00:35Z,use_quota=True,user_id='15445870d3de43569566675dd2a5eade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 13:00:41 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-8efd7080-2ab8-4bac-b0d1-3cfed44f9427 tempest-CreateVolumesFromImageTest-1102869783 None] Creating volume 0aedaec1-d7db-4cdc-9414-79e26e97d5cf {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 13:00:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-8efd7080-2ab8-4bac-b0d1-3cfed44f9427 tempest-CreateVolumesFromImageTest-1102869783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:00:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-8efd7080-2ab8-4bac-b0d1-3cfed44f9427 tempest-CreateVolumesFromImageTest-1102869783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:00:41 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-8efd7080-2ab8-4bac-b0d1-3cfed44f9427 tempest-CreateVolumesFromImageTest-1102869783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:00:41 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-8efd7080-2ab8-4bac-b0d1-3cfed44f9427 tempest-CreateVolumesFromImageTest-1102869783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:00:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-8efd7080-2ab8-4bac-b0d1-3cfed44f9427 tempest-CreateVolumesFromImageTest-1102869783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:00:41 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-8efd7080-2ab8-4bac-b0d1-3cfed44f9427 tempest-CreateVolumesFromImageTest-1102869783 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 13:00:41 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-8efd7080-2ab8-4bac-b0d1-3cfed44f9427 tempest-CreateVolumesFromImageTest-1102869783 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 13:00:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8efd7080-2ab8-4bac-b0d1-3cfed44f9427 tempest-CreateVolumesFromImageTest-1102869783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0aedaec1-d7db-4cdc-9414-79e26e97d5cf 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-732449c9-2607-4e64-97ad-720ab317210d tempest-VolumeDependencyTests-267861649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7182a9d-f9b0-4435-90f1-42e0a348bff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:41 devstack sudo[106046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0aedaec1-d7db-4cdc-9414-79e26e97d5cf 1073741824
Jul 10 13:00:41 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-732449c9-2607-4e64-97ad-720ab317210d tempest-VolumeDependencyTests-267861649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5066e2d0-235b-4666-b652-dcc63fd126b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:41 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-732449c9-2607-4e64-97ad-720ab317210d tempest-VolumeDependencyTests-267861649 None] Volume volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b (0bc213eb-0dd0-47cc-b32e-58cf28aee65b): created successfully
Jul 10 13:00:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-732449c9-2607-4e64-97ad-720ab317210d tempest-VolumeDependencyTests-267861649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5066e2d0-235b-4666-b652-dcc63fd126b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-732449c9-2607-4e64-97ad-720ab317210d tempest-VolumeDependencyTests-267861649 None] Flow 'volume_create_manager' (94421bde-5197-45a9-9ea9-36f9f0f6e38a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:00:41 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-732449c9-2607-4e64-97ad-720ab317210d tempest-VolumeDependencyTests-267861649 None] Created volume successfully.
Jul 10 13:00:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1289d2e3-bc43-463c-8e0d-684447332e38 tempest-VolumeDependencyTests-267861649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:00:41 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a799f54a-6443-455c-91db-db5a8815ec19_eag83arrdevstack@QuobyteHD" returned: 0 in 0.788s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a799f54a-6443-455c-91db-db5a8815ec19_eag83arrdevstack@QuobyteHD {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:41 devstack sudo[106053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a799f54a-6443-455c-91db-db5a8815ec19_eag83arrdevstack@QuobyteHD
Jul 10 13:00:41 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:41 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8efd7080-2ab8-4bac-b0d1-3cfed44f9427 tempest-CreateVolumesFromImageTest-1102869783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0aedaec1-d7db-4cdc-9414-79e26e97d5cf 1073741824" returned: 0 in 0.839s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8efd7080-2ab8-4bac-b0d1-3cfed44f9427 tempest-CreateVolumesFromImageTest-1102869783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0aedaec1-d7db-4cdc-9414-79e26e97d5cf {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:41 devstack sudo[106055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0aedaec1-d7db-4cdc-9414-79e26e97d5cf
Jul 10 13:00:41 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:42 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a799f54a-6443-455c-91db-db5a8815ec19_eag83arrdevstack@QuobyteHD" returned: 1 in 0.749s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a799f54a-6443-455c-91db-db5a8815ec19_eag83arrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 10 13:00:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:00:42 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8efd7080-2ab8-4bac-b0d1-3cfed44f9427 tempest-CreateVolumesFromImageTest-1102869783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0aedaec1-d7db-4cdc-9414-79e26e97d5cf" returned: 0 in 0.676s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:42 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-8efd7080-2ab8-4bac-b0d1-3cfed44f9427 tempest-CreateVolumesFromImageTest-1102869783 None] <== create_volume: return (1556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 13:00:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-8efd7080-2ab8-4bac-b0d1-3cfed44f9427 tempest-CreateVolumesFromImageTest-1102869783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:00:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0c9a8b0f-6ca1-4027-9d4a-43b92ea7f3d5 tempest-CreateVolumesFromImageTest-1102869783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.400s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:00:42 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-0c9a8b0f-6ca1-4027-9d4a-43b92ea7f3d5 tempest-CreateVolumesFromImageTest-1102869783 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:00:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-23356908',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cdc76c1-d41f-4bba-80f5-789dd31a8287,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dc89b2f617d4bbb941ef0040937ee68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:00:35Z,use_quota=True,user_id='15445870d3de43569566675dd2a5eade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 13:00:42 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-0c9a8b0f-6ca1-4027-9d4a-43b92ea7f3d5 tempest-CreateVolumesFromImageTest-1102869783 None] Creating volume 3cdc76c1-d41f-4bba-80f5-789dd31a8287 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 13:00:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0c9a8b0f-6ca1-4027-9d4a-43b92ea7f3d5 tempest-CreateVolumesFromImageTest-1102869783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:00:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0c9a8b0f-6ca1-4027-9d4a-43b92ea7f3d5 tempest-CreateVolumesFromImageTest-1102869783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:00:42 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-0c9a8b0f-6ca1-4027-9d4a-43b92ea7f3d5 tempest-CreateVolumesFromImageTest-1102869783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:00:42 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-0c9a8b0f-6ca1-4027-9d4a-43b92ea7f3d5 tempest-CreateVolumesFromImageTest-1102869783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:00:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0c9a8b0f-6ca1-4027-9d4a-43b92ea7f3d5 tempest-CreateVolumesFromImageTest-1102869783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:00:42 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-0c9a8b0f-6ca1-4027-9d4a-43b92ea7f3d5 tempest-CreateVolumesFromImageTest-1102869783 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 13:00:42 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-0c9a8b0f-6ca1-4027-9d4a-43b92ea7f3d5 tempest-CreateVolumesFromImageTest-1102869783 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 13:00:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0c9a8b0f-6ca1-4027-9d4a-43b92ea7f3d5 tempest-CreateVolumesFromImageTest-1102869783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3cdc76c1-d41f-4bba-80f5-789dd31a8287 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:42 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-8efd7080-2ab8-4bac-b0d1-3cfed44f9427 tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9fb24f7-b189-4800-b13d-f3613519012a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0aedaec1-d7db-4cdc-9414-79e26e97d5cf', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:42 devstack sudo[106061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3cdc76c1-d41f-4bba-80f5-789dd31a8287 1073741824
Jul 10 13:00:42 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:42 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-8efd7080-2ab8-4bac-b0d1-3cfed44f9427 tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ddf7753-04c0-4edd-9f94-93b7789caaf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:42 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-8efd7080-2ab8-4bac-b0d1-3cfed44f9427 tempest-CreateVolumesFromImageTest-1102869783 None] Volume volume-0aedaec1-d7db-4cdc-9414-79e26e97d5cf (0aedaec1-d7db-4cdc-9414-79e26e97d5cf): created successfully
Jul 10 13:00:42 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-8efd7080-2ab8-4bac-b0d1-3cfed44f9427 tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ddf7753-04c0-4edd-9f94-93b7789caaf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:42 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-8efd7080-2ab8-4bac-b0d1-3cfed44f9427 tempest-CreateVolumesFromImageTest-1102869783 None] Flow 'volume_create_manager' (421aa549-1f4e-4f4e-a4b4-972183f8ca8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:00:42 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-8efd7080-2ab8-4bac-b0d1-3cfed44f9427 tempest-CreateVolumesFromImageTest-1102869783 None] Created volume successfully.
Jul 10 13:00:43 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0c9a8b0f-6ca1-4027-9d4a-43b92ea7f3d5 tempest-CreateVolumesFromImageTest-1102869783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3cdc76c1-d41f-4bba-80f5-789dd31a8287 1073741824" returned: 0 in 0.791s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0c9a8b0f-6ca1-4027-9d4a-43b92ea7f3d5 tempest-CreateVolumesFromImageTest-1102869783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3cdc76c1-d41f-4bba-80f5-789dd31a8287 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:43 devstack sudo[106067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3cdc76c1-d41f-4bba-80f5-789dd31a8287
Jul 10 13:00:43 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:44 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0c9a8b0f-6ca1-4027-9d4a-43b92ea7f3d5 tempest-CreateVolumesFromImageTest-1102869783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3cdc76c1-d41f-4bba-80f5-789dd31a8287" returned: 0 in 0.625s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:44 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-0c9a8b0f-6ca1-4027-9d4a-43b92ea7f3d5 tempest-CreateVolumesFromImageTest-1102869783 None] <== create_volume: return (1456ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 13:00:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0c9a8b0f-6ca1-4027-9d4a-43b92ea7f3d5 tempest-CreateVolumesFromImageTest-1102869783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.459s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:00:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5c06e307-59b1-4e29-b1f6-6e57c46c541a tempest-CreateVolumesFromImageTest-1102869783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.415s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:00:44 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5c06e307-59b1-4e29-b1f6-6e57c46c541a tempest-CreateVolumesFromImageTest-1102869783 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:00:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1966914481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e311877-2577-428a-ac10-bb21053582d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dc89b2f617d4bbb941ef0040937ee68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:00:36Z,use_quota=True,user_id='15445870d3de43569566675dd2a5eade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 13:00:44 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-5c06e307-59b1-4e29-b1f6-6e57c46c541a tempest-CreateVolumesFromImageTest-1102869783 None] Creating volume 0e311877-2577-428a-ac10-bb21053582d7 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 13:00:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5c06e307-59b1-4e29-b1f6-6e57c46c541a tempest-CreateVolumesFromImageTest-1102869783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:00:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5c06e307-59b1-4e29-b1f6-6e57c46c541a tempest-CreateVolumesFromImageTest-1102869783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:00:44 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5c06e307-59b1-4e29-b1f6-6e57c46c541a tempest-CreateVolumesFromImageTest-1102869783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:00:44 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5c06e307-59b1-4e29-b1f6-6e57c46c541a tempest-CreateVolumesFromImageTest-1102869783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:00:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5c06e307-59b1-4e29-b1f6-6e57c46c541a tempest-CreateVolumesFromImageTest-1102869783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:00:44 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5c06e307-59b1-4e29-b1f6-6e57c46c541a tempest-CreateVolumesFromImageTest-1102869783 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 13:00:44 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-5c06e307-59b1-4e29-b1f6-6e57c46c541a tempest-CreateVolumesFromImageTest-1102869783 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 13:00:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5c06e307-59b1-4e29-b1f6-6e57c46c541a tempest-CreateVolumesFromImageTest-1102869783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0e311877-2577-428a-ac10-bb21053582d7 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:44 devstack sudo[106070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0e311877-2577-428a-ac10-bb21053582d7 1073741824
Jul 10 13:00:44 devstack sudo[106070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0c9a8b0f-6ca1-4027-9d4a-43b92ea7f3d5 tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86eec300-01ed-42a0-b581-8958977e0e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cdc76c1-d41f-4bba-80f5-789dd31a8287', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0c9a8b0f-6ca1-4027-9d4a-43b92ea7f3d5 tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f7210e7-6368-4ee4-88b8-000238463af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:44 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-0c9a8b0f-6ca1-4027-9d4a-43b92ea7f3d5 tempest-CreateVolumesFromImageTest-1102869783 None] Volume volume-3cdc76c1-d41f-4bba-80f5-789dd31a8287 (3cdc76c1-d41f-4bba-80f5-789dd31a8287): created successfully
Jul 10 13:00:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0c9a8b0f-6ca1-4027-9d4a-43b92ea7f3d5 tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f7210e7-6368-4ee4-88b8-000238463af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0c9a8b0f-6ca1-4027-9d4a-43b92ea7f3d5 tempest-CreateVolumesFromImageTest-1102869783 None] Flow 'volume_create_manager' (fe653a89-9900-47d8-aa75-40670bdb04d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:00:44 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-0c9a8b0f-6ca1-4027-9d4a-43b92ea7f3d5 tempest-CreateVolumesFromImageTest-1102869783 None] Created volume successfully.
Jul 10 13:00:44 devstack sudo[106070]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5c06e307-59b1-4e29-b1f6-6e57c46c541a tempest-CreateVolumesFromImageTest-1102869783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0e311877-2577-428a-ac10-bb21053582d7 1073741824" returned: 0 in 0.792s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5c06e307-59b1-4e29-b1f6-6e57c46c541a tempest-CreateVolumesFromImageTest-1102869783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0e311877-2577-428a-ac10-bb21053582d7 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:44 devstack sudo[106075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0e311877-2577-428a-ac10-bb21053582d7
Jul 10 13:00:44 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:45 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5c06e307-59b1-4e29-b1f6-6e57c46c541a tempest-CreateVolumesFromImageTest-1102869783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0e311877-2577-428a-ac10-bb21053582d7" returned: 0 in 0.661s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:45 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5c06e307-59b1-4e29-b1f6-6e57c46c541a tempest-CreateVolumesFromImageTest-1102869783 None] <== create_volume: return (1491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 13:00:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5c06e307-59b1-4e29-b1f6-6e57c46c541a tempest-CreateVolumesFromImageTest-1102869783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:00:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-fa072de4-0e39-4102-bb68-b5509905159b tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.089s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:00:45 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-fa072de4-0e39-4102-bb68-b5509905159b tempest-CreateVolumesFromSourceVolumeTest-957425387 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:00:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2057521407',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50144674-4409-47e2-a4bb-58f345844e53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84e579c70c144614bc09f57470b7adb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:00:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:00:37Z,use_quota=True,user_id='c068905698ca495e8e18b2b59f3d1563',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 13:00:45 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-fa072de4-0e39-4102-bb68-b5509905159b tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Creating volume 50144674-4409-47e2-a4bb-58f345844e53 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 13:00:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-fa072de4-0e39-4102-bb68-b5509905159b tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:00:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-fa072de4-0e39-4102-bb68-b5509905159b tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:00:45 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-fa072de4-0e39-4102-bb68-b5509905159b tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:00:45 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-fa072de4-0e39-4102-bb68-b5509905159b tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:00:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-fa072de4-0e39-4102-bb68-b5509905159b tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:00:45 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-fa072de4-0e39-4102-bb68-b5509905159b tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 13:00:45 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-fa072de4-0e39-4102-bb68-b5509905159b tempest-CreateVolumesFromSourceVolumeTest-957425387 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 13:00:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fa072de4-0e39-4102-bb68-b5509905159b tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-50144674-4409-47e2-a4bb-58f345844e53 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:45 devstack sudo[106078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-50144674-4409-47e2-a4bb-58f345844e53 1073741824
Jul 10 13:00:45 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:45 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5c06e307-59b1-4e29-b1f6-6e57c46c541a tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae1717c2-5ed1-4e34-b0f0-e8ea998f3942) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e311877-2577-428a-ac10-bb21053582d7', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:45 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5c06e307-59b1-4e29-b1f6-6e57c46c541a tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8dbea10-cd08-4cd8-b9b9-eec8606b1d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:45 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-5c06e307-59b1-4e29-b1f6-6e57c46c541a tempest-CreateVolumesFromImageTest-1102869783 None] Volume volume-0e311877-2577-428a-ac10-bb21053582d7 (0e311877-2577-428a-ac10-bb21053582d7): created successfully
Jul 10 13:00:45 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5c06e307-59b1-4e29-b1f6-6e57c46c541a tempest-CreateVolumesFromImageTest-1102869783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8dbea10-cd08-4cd8-b9b9-eec8606b1d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:45 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5c06e307-59b1-4e29-b1f6-6e57c46c541a tempest-CreateVolumesFromImageTest-1102869783 None] Flow 'volume_create_manager' (faee8b08-5d55-434f-b4a1-26cf43051fba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:00:45 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-5c06e307-59b1-4e29-b1f6-6e57c46c541a tempest-CreateVolumesFromImageTest-1102869783 None] Created volume successfully.
Jul 10 13:00:46 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fa072de4-0e39-4102-bb68-b5509905159b tempest-CreateVolumesFromSourceVolumeTest-957425387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-50144674-4409-47e2-a4bb-58f345844e53 1073741824" returned: 0 in 0.813s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fa072de4-0e39-4102-bb68-b5509905159b tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-50144674-4409-47e2-a4bb-58f345844e53 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:46 devstack sudo[106083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-50144674-4409-47e2-a4bb-58f345844e53
Jul 10 13:00:46 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:46 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e164fcb9-ff5c-4b7b-a4ff-f84c697e05b5 tempest-CreateVolumesFromImageTest-1102869783 None] Acquiring lock "cinder-0e311877-2577-428a-ac10-bb21053582d7-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:00:46 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e164fcb9-ff5c-4b7b-a4ff-f84c697e05b5 tempest-CreateVolumesFromImageTest-1102869783 None] Lock "cinder-0e311877-2577-428a-ac10-bb21053582d7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:00:46 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e164fcb9-ff5c-4b7b-a4ff-f84c697e05b5 tempest-CreateVolumesFromImageTest-1102869783 None] Acquiring lock "cinder-quobyte-0e311877-2577-428a-ac10-bb21053582d7" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:00:46 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e164fcb9-ff5c-4b7b-a4ff-f84c697e05b5 tempest-CreateVolumesFromImageTest-1102869783 None] Lock "cinder-quobyte-0e311877-2577-428a-ac10-bb21053582d7" acquired by "delete_volume" :: waited 0.025s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:00:46 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb971e9-ba82-4881-b053-46143f30e5f9]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:00:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e164fcb9-ff5c-4b7b-a4ff-f84c697e05b5 tempest-CreateVolumesFromImageTest-1102869783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0e311877-2577-428a-ac10-bb21053582d7 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:46 devstack sudo[106085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0e311877-2577-428a-ac10-bb21053582d7
Jul 10 13:00:46 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:47 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fa072de4-0e39-4102-bb68-b5509905159b tempest-CreateVolumesFromSourceVolumeTest-957425387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-50144674-4409-47e2-a4bb-58f345844e53" returned: 0 in 0.652s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:47 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-fa072de4-0e39-4102-bb68-b5509905159b tempest-CreateVolumesFromSourceVolumeTest-957425387 None] <== create_volume: return (1533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 13:00:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-fa072de4-0e39-4102-bb68-b5509905159b tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.537s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:00:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-7d90ba1d-b4d5-4b4f-bd5c-01a3fbabaaac tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.252s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:00:47 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-7d90ba1d-b4d5-4b4f-bd5c-01a3fbabaaac tempest-CreateVolumesFromSourceVolumeTest-957425387 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:00:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1328203659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e24ed74a-05aa-43ba-a58d-6bcd810662f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84e579c70c144614bc09f57470b7adb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:00:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:00:38Z,use_quota=True,user_id='c068905698ca495e8e18b2b59f3d1563',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 13:00:47 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-7d90ba1d-b4d5-4b4f-bd5c-01a3fbabaaac tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Creating volume e24ed74a-05aa-43ba-a58d-6bcd810662f2 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 13:00:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-7d90ba1d-b4d5-4b4f-bd5c-01a3fbabaaac tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:00:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-7d90ba1d-b4d5-4b4f-bd5c-01a3fbabaaac tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:00:47 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-7d90ba1d-b4d5-4b4f-bd5c-01a3fbabaaac tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:00:47 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-7d90ba1d-b4d5-4b4f-bd5c-01a3fbabaaac tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:00:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-7d90ba1d-b4d5-4b4f-bd5c-01a3fbabaaac tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:00:47 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-7d90ba1d-b4d5-4b4f-bd5c-01a3fbabaaac tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 13:00:47 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-7d90ba1d-b4d5-4b4f-bd5c-01a3fbabaaac tempest-CreateVolumesFromSourceVolumeTest-957425387 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 13:00:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7d90ba1d-b4d5-4b4f-bd5c-01a3fbabaaac tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e24ed74a-05aa-43ba-a58d-6bcd810662f2 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:47 devstack sudo[106088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e24ed74a-05aa-43ba-a58d-6bcd810662f2 1073741824
Jul 10 13:00:47 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fa072de4-0e39-4102-bb68-b5509905159b tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f1e23bb-828c-4a18-a471-4b45e9a86923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50144674-4409-47e2-a4bb-58f345844e53', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fa072de4-0e39-4102-bb68-b5509905159b tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7ef4b2b-781e-4b98-b8d3-26b717a2847d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:47 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-fa072de4-0e39-4102-bb68-b5509905159b tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Volume volume-50144674-4409-47e2-a4bb-58f345844e53 (50144674-4409-47e2-a4bb-58f345844e53): created successfully
Jul 10 13:00:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fa072de4-0e39-4102-bb68-b5509905159b tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7ef4b2b-781e-4b98-b8d3-26b717a2847d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fa072de4-0e39-4102-bb68-b5509905159b tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Flow 'volume_create_manager' (94a78ac6-3877-432f-86e8-bec65819249f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:00:47 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-fa072de4-0e39-4102-bb68-b5509905159b tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Created volume successfully.
Jul 10 13:00:47 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e164fcb9-ff5c-4b7b-a4ff-f84c697e05b5 tempest-CreateVolumesFromImageTest-1102869783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0e311877-2577-428a-ac10-bb21053582d7" returned: 0 in 0.778s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e164fcb9-ff5c-4b7b-a4ff-f84c697e05b5 tempest-CreateVolumesFromImageTest-1102869783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0e311877-2577-428a-ac10-bb21053582d7 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:47 devstack sudo[106093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0e311877-2577-428a-ac10-bb21053582d7
Jul 10 13:00:47 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:47 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7d90ba1d-b4d5-4b4f-bd5c-01a3fbabaaac tempest-CreateVolumesFromSourceVolumeTest-957425387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e24ed74a-05aa-43ba-a58d-6bcd810662f2 1073741824" returned: 0 in 0.855s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7d90ba1d-b4d5-4b4f-bd5c-01a3fbabaaac tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e24ed74a-05aa-43ba-a58d-6bcd810662f2 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:48 devstack sudo[106099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e24ed74a-05aa-43ba-a58d-6bcd810662f2
Jul 10 13:00:48 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:48 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e164fcb9-ff5c-4b7b-a4ff-f84c697e05b5 tempest-CreateVolumesFromImageTest-1102869783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0e311877-2577-428a-ac10-bb21053582d7" returned: 0 in 0.703s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:48 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e164fcb9-ff5c-4b7b-a4ff-f84c697e05b5 tempest-CreateVolumesFromImageTest-1102869783 None] Lock "cinder-quobyte-0e311877-2577-428a-ac10-bb21053582d7" released by "delete_volume" :: held 1.530s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:00:48 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-e164fcb9-ff5c-4b7b-a4ff-f84c697e05b5 tempest-CreateVolumesFromImageTest-1102869783 None] Created reservations ['7e4ada40-c180-4c2a-b8dd-568776e8587f', 'be80d7f1-69dd-4f12-bec9-d1555649fe84', '999bb171-101b-411b-8fd3-e2d234d5dd3d', 'bcb545bf-93f1-457a-9bd1-410846645d6c'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:00:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e164fcb9-ff5c-4b7b-a4ff-f84c697e05b5 tempest-CreateVolumesFromImageTest-1102869783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:00:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e164fcb9-ff5c-4b7b-a4ff-f84c697e05b5 tempest-CreateVolumesFromImageTest-1102869783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:00:48 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-e164fcb9-ff5c-4b7b-a4ff-f84c697e05b5 tempest-CreateVolumesFromImageTest-1102869783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:00:48 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-e164fcb9-ff5c-4b7b-a4ff-f84c697e05b5 tempest-CreateVolumesFromImageTest-1102869783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:00:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e164fcb9-ff5c-4b7b-a4ff-f84c697e05b5 tempest-CreateVolumesFromImageTest-1102869783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:00:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e164fcb9-ff5c-4b7b-a4ff-f84c697e05b5 tempest-CreateVolumesFromImageTest-1102869783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:48 devstack sudo[106101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:00:48 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:48 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7d90ba1d-b4d5-4b4f-bd5c-01a3fbabaaac tempest-CreateVolumesFromSourceVolumeTest-957425387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e24ed74a-05aa-43ba-a58d-6bcd810662f2" returned: 0 in 0.678s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:48 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-7d90ba1d-b4d5-4b4f-bd5c-01a3fbabaaac tempest-CreateVolumesFromSourceVolumeTest-957425387 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 13:00:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-7d90ba1d-b4d5-4b4f-bd5c-01a3fbabaaac tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.579s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:00:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-77ee1b72-2c46-478c-8d54-8196f2c32913 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.205s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:00:48 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-77ee1b72-2c46-478c-8d54-8196f2c32913 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:00:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-559870466',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1979c563-bac5-4437-ad33-5252ca4ae11d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84e579c70c144614bc09f57470b7adb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:00:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:00:38Z,use_quota=True,user_id='c068905698ca495e8e18b2b59f3d1563',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 13:00:48 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-77ee1b72-2c46-478c-8d54-8196f2c32913 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Creating volume 1979c563-bac5-4437-ad33-5252ca4ae11d {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 13:00:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-77ee1b72-2c46-478c-8d54-8196f2c32913 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:00:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-77ee1b72-2c46-478c-8d54-8196f2c32913 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:00:48 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-77ee1b72-2c46-478c-8d54-8196f2c32913 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:00:48 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-77ee1b72-2c46-478c-8d54-8196f2c32913 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:00:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-77ee1b72-2c46-478c-8d54-8196f2c32913 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:00:48 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-77ee1b72-2c46-478c-8d54-8196f2c32913 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 13:00:48 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-77ee1b72-2c46-478c-8d54-8196f2c32913 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 13:00:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-77ee1b72-2c46-478c-8d54-8196f2c32913 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1979c563-bac5-4437-ad33-5252ca4ae11d 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:48 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7d90ba1d-b4d5-4b4f-bd5c-01a3fbabaaac tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0932e302-8d9d-48b7-ab3c-db6f62561afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e24ed74a-05aa-43ba-a58d-6bcd810662f2', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:48 devstack sudo[106104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1979c563-bac5-4437-ad33-5252ca4ae11d 1073741824
Jul 10 13:00:48 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7d90ba1d-b4d5-4b4f-bd5c-01a3fbabaaac tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d798ccdf-24b1-45b8-855e-443d2ba3439a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:48 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:48 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-7d90ba1d-b4d5-4b4f-bd5c-01a3fbabaaac tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Volume volume-e24ed74a-05aa-43ba-a58d-6bcd810662f2 (e24ed74a-05aa-43ba-a58d-6bcd810662f2): created successfully
Jul 10 13:00:48 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7d90ba1d-b4d5-4b4f-bd5c-01a3fbabaaac tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d798ccdf-24b1-45b8-855e-443d2ba3439a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:48 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7d90ba1d-b4d5-4b4f-bd5c-01a3fbabaaac tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Flow 'volume_create_manager' (4ae8ef34-1c1c-4316-98a3-379715665d24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:00:48 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-7d90ba1d-b4d5-4b4f-bd5c-01a3fbabaaac tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Created volume successfully.
Jul 10 13:00:48 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3cace817-eb93-4b0f-862e-7644844f195b tempest-CreateVolumesFromImageTest-1102869783 None] Acquiring lock "cinder-3cdc76c1-d41f-4bba-80f5-789dd31a8287-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:00:48 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3cace817-eb93-4b0f-862e-7644844f195b tempest-CreateVolumesFromImageTest-1102869783 None] Lock "cinder-3cdc76c1-d41f-4bba-80f5-789dd31a8287-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:00:48 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3cace817-eb93-4b0f-862e-7644844f195b tempest-CreateVolumesFromImageTest-1102869783 None] Acquiring lock "cinder-quobyte-3cdc76c1-d41f-4bba-80f5-789dd31a8287" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:00:48 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3cace817-eb93-4b0f-862e-7644844f195b tempest-CreateVolumesFromImageTest-1102869783 None] Lock "cinder-quobyte-3cdc76c1-d41f-4bba-80f5-789dd31a8287" acquired by "delete_volume" :: waited 0.020s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:00:48 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c43c3c0-0d01-4cba-8770-865b7d88a7a3]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:00:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3cace817-eb93-4b0f-862e-7644844f195b tempest-CreateVolumesFromImageTest-1102869783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3cdc76c1-d41f-4bba-80f5-789dd31a8287 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:49 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e164fcb9-ff5c-4b7b-a4ff-f84c697e05b5 tempest-CreateVolumesFromImageTest-1102869783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.704s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:49 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-e164fcb9-ff5c-4b7b-a4ff-f84c697e05b5 tempest-CreateVolumesFromImageTest-1102869783 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:00:49 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-e164fcb9-ff5c-4b7b-a4ff-f84c697e05b5 tempest-CreateVolumesFromImageTest-1102869783 None] Deleted volume successfully.
Jul 10 13:00:49 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e164fcb9-ff5c-4b7b-a4ff-f84c697e05b5 tempest-CreateVolumesFromImageTest-1102869783 None] Lock "cinder-0e311877-2577-428a-ac10-bb21053582d7-delete_volume" released by "delete_volume" :: held 2.511s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:00:49 devstack sudo[106107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3cdc76c1-d41f-4bba-80f5-789dd31a8287
Jul 10 13:00:49 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:49 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-77ee1b72-2c46-478c-8d54-8196f2c32913 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1979c563-bac5-4437-ad33-5252ca4ae11d 1073741824" returned: 0 in 0.885s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-77ee1b72-2c46-478c-8d54-8196f2c32913 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1979c563-bac5-4437-ad33-5252ca4ae11d {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:49 devstack sudo[106114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1979c563-bac5-4437-ad33-5252ca4ae11d
Jul 10 13:00:49 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:49 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3cace817-eb93-4b0f-862e-7644844f195b tempest-CreateVolumesFromImageTest-1102869783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3cdc76c1-d41f-4bba-80f5-789dd31a8287" returned: 0 in 0.835s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3cace817-eb93-4b0f-862e-7644844f195b tempest-CreateVolumesFromImageTest-1102869783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3cdc76c1-d41f-4bba-80f5-789dd31a8287 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:49 devstack sudo[106118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3cdc76c1-d41f-4bba-80f5-789dd31a8287
Jul 10 13:00:49 devstack sudo[106118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:50 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-77ee1b72-2c46-478c-8d54-8196f2c32913 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1979c563-bac5-4437-ad33-5252ca4ae11d" returned: 0 in 0.662s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:50 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-77ee1b72-2c46-478c-8d54-8196f2c32913 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] <== create_volume: return (1590ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 13:00:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-77ee1b72-2c46-478c-8d54-8196f2c32913 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.593s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:00:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-67ee6efb-14fb-44a1-8767-e1f1edc9a977 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.430s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:00:50 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-67ee6efb-14fb-44a1-8767-e1f1edc9a977 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:00:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1411033443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fdff3f6-2dde-4892-8af2-beb59cfd1313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84e579c70c144614bc09f57470b7adb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:00:39Z,use_quota=True,user_id='c068905698ca495e8e18b2b59f3d1563',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 13:00:50 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-67ee6efb-14fb-44a1-8767-e1f1edc9a977 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Creating volume 4fdff3f6-2dde-4892-8af2-beb59cfd1313 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 13:00:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-67ee6efb-14fb-44a1-8767-e1f1edc9a977 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:00:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-67ee6efb-14fb-44a1-8767-e1f1edc9a977 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:00:50 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-67ee6efb-14fb-44a1-8767-e1f1edc9a977 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:00:50 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-67ee6efb-14fb-44a1-8767-e1f1edc9a977 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:00:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-67ee6efb-14fb-44a1-8767-e1f1edc9a977 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:00:50 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-67ee6efb-14fb-44a1-8767-e1f1edc9a977 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 13:00:50 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-67ee6efb-14fb-44a1-8767-e1f1edc9a977 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 13:00:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-67ee6efb-14fb-44a1-8767-e1f1edc9a977 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4fdff3f6-2dde-4892-8af2-beb59cfd1313 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:50 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-77ee1b72-2c46-478c-8d54-8196f2c32913 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (985fd8e3-300a-4a64-8a62-7d55b6098e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1979c563-bac5-4437-ad33-5252ca4ae11d', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:50 devstack sudo[106121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4fdff3f6-2dde-4892-8af2-beb59cfd1313 1073741824
Jul 10 13:00:50 devstack sudo[106121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:50 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-77ee1b72-2c46-478c-8d54-8196f2c32913 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73aaf793-df4a-4f05-b652-72b2700ae8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:50 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-77ee1b72-2c46-478c-8d54-8196f2c32913 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Volume volume-1979c563-bac5-4437-ad33-5252ca4ae11d (1979c563-bac5-4437-ad33-5252ca4ae11d): created successfully
Jul 10 13:00:50 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-77ee1b72-2c46-478c-8d54-8196f2c32913 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73aaf793-df4a-4f05-b652-72b2700ae8c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:50 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-77ee1b72-2c46-478c-8d54-8196f2c32913 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Flow 'volume_create_manager' (9cfa2151-6bf2-4d05-b268-67e5212a8846) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:00:50 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-77ee1b72-2c46-478c-8d54-8196f2c32913 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Created volume successfully.
Jul 10 13:00:50 devstack sudo[106118]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3cace817-eb93-4b0f-862e-7644844f195b tempest-CreateVolumesFromImageTest-1102869783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3cdc76c1-d41f-4bba-80f5-789dd31a8287" returned: 0 in 0.665s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:50 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3cace817-eb93-4b0f-862e-7644844f195b tempest-CreateVolumesFromImageTest-1102869783 None] Lock "cinder-quobyte-3cdc76c1-d41f-4bba-80f5-789dd31a8287" released by "delete_volume" :: held 1.542s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:00:50 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-3cace817-eb93-4b0f-862e-7644844f195b tempest-CreateVolumesFromImageTest-1102869783 None] Created reservations ['4fe2316b-dd10-4a80-8816-d65623e03be2', '5afc9c0f-4d24-4ef2-853e-c0dfa99b666f', '8c6eac9e-b497-43a9-807a-81f4ee640fb5', 'fc38bffc-4457-4a96-8cf1-bbf021c6ed15'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:00:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3cace817-eb93-4b0f-862e-7644844f195b tempest-CreateVolumesFromImageTest-1102869783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:00:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3cace817-eb93-4b0f-862e-7644844f195b tempest-CreateVolumesFromImageTest-1102869783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:00:50 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3cace817-eb93-4b0f-862e-7644844f195b tempest-CreateVolumesFromImageTest-1102869783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:00:50 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3cace817-eb93-4b0f-862e-7644844f195b tempest-CreateVolumesFromImageTest-1102869783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:00:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3cace817-eb93-4b0f-862e-7644844f195b tempest-CreateVolumesFromImageTest-1102869783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:00:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3cace817-eb93-4b0f-862e-7644844f195b tempest-CreateVolumesFromImageTest-1102869783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:50 devstack sudo[106124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:00:50 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:51 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-62bd89f5-8a6a-4eee-b2b5-3c393c156c1c tempest-CreateVolumesFromImageTest-1102869783 None] Acquiring lock "cinder-0aedaec1-d7db-4cdc-9414-79e26e97d5cf-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:00:51 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-62bd89f5-8a6a-4eee-b2b5-3c393c156c1c tempest-CreateVolumesFromImageTest-1102869783 None] Lock "cinder-0aedaec1-d7db-4cdc-9414-79e26e97d5cf-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:00:51 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-62bd89f5-8a6a-4eee-b2b5-3c393c156c1c tempest-CreateVolumesFromImageTest-1102869783 None] Acquiring lock "cinder-quobyte-0aedaec1-d7db-4cdc-9414-79e26e97d5cf" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:00:51 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-62bd89f5-8a6a-4eee-b2b5-3c393c156c1c tempest-CreateVolumesFromImageTest-1102869783 None] Lock "cinder-quobyte-0aedaec1-d7db-4cdc-9414-79e26e97d5cf" acquired by "delete_volume" :: waited 0.017s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:00:51 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b4a7fb-a4fd-484c-a4ae-dd68db75d260]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:00:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-62bd89f5-8a6a-4eee-b2b5-3c393c156c1c tempest-CreateVolumesFromImageTest-1102869783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0aedaec1-d7db-4cdc-9414-79e26e97d5cf {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:51 devstack sudo[106121]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-67ee6efb-14fb-44a1-8767-e1f1edc9a977 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4fdff3f6-2dde-4892-8af2-beb59cfd1313 1073741824" returned: 0 in 0.884s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-67ee6efb-14fb-44a1-8767-e1f1edc9a977 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4fdff3f6-2dde-4892-8af2-beb59cfd1313 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:51 devstack sudo[106132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4fdff3f6-2dde-4892-8af2-beb59cfd1313
Jul 10 13:00:51 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:51 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3cace817-eb93-4b0f-862e-7644844f195b tempest-CreateVolumesFromImageTest-1102869783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.694s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:51 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-3cace817-eb93-4b0f-862e-7644844f195b tempest-CreateVolumesFromImageTest-1102869783 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:00:51 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-3cace817-eb93-4b0f-862e-7644844f195b tempest-CreateVolumesFromImageTest-1102869783 None] Deleted volume successfully.
Jul 10 13:00:51 devstack sudo[106131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0aedaec1-d7db-4cdc-9414-79e26e97d5cf
Jul 10 13:00:51 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:51 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3cace817-eb93-4b0f-862e-7644844f195b tempest-CreateVolumesFromImageTest-1102869783 None] Lock "cinder-3cdc76c1-d41f-4bba-80f5-789dd31a8287-delete_volume" released by "delete_volume" :: held 2.442s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:00:51 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-67ee6efb-14fb-44a1-8767-e1f1edc9a977 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4fdff3f6-2dde-4892-8af2-beb59cfd1313" returned: 0 in 0.646s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:51 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-67ee6efb-14fb-44a1-8767-e1f1edc9a977 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 13:00:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-67ee6efb-14fb-44a1-8767-e1f1edc9a977 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:00:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-6fcca8e8-688f-44b6-9fef-6cb387f47bd8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.601s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:00:51 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-6fcca8e8-688f-44b6-9fef-6cb387f47bd8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1383875860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f51904bd-e872-4fa8-ba56-8c064a3898d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84e579c70c144614bc09f57470b7adb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:00:39Z,use_quota=True,user_id='c068905698ca495e8e18b2b59f3d1563',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 13:00:51 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-6fcca8e8-688f-44b6-9fef-6cb387f47bd8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Creating volume f51904bd-e872-4fa8-ba56-8c064a3898d5 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 13:00:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-6fcca8e8-688f-44b6-9fef-6cb387f47bd8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:00:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-6fcca8e8-688f-44b6-9fef-6cb387f47bd8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:00:51 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-6fcca8e8-688f-44b6-9fef-6cb387f47bd8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:00:51 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-6fcca8e8-688f-44b6-9fef-6cb387f47bd8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:00:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-6fcca8e8-688f-44b6-9fef-6cb387f47bd8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:00:51 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-6fcca8e8-688f-44b6-9fef-6cb387f47bd8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 13:00:51 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-6fcca8e8-688f-44b6-9fef-6cb387f47bd8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 13:00:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6fcca8e8-688f-44b6-9fef-6cb387f47bd8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f51904bd-e872-4fa8-ba56-8c064a3898d5 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-67ee6efb-14fb-44a1-8767-e1f1edc9a977 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6471756c-b13c-4af6-8032-7637a0a2a7ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fdff3f6-2dde-4892-8af2-beb59cfd1313', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:51 devstack sudo[106139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f51904bd-e872-4fa8-ba56-8c064a3898d5 1073741824
Jul 10 13:00:51 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-67ee6efb-14fb-44a1-8767-e1f1edc9a977 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e757b742-7247-49db-9daa-adc16efb7d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:51 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-67ee6efb-14fb-44a1-8767-e1f1edc9a977 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Volume volume-4fdff3f6-2dde-4892-8af2-beb59cfd1313 (4fdff3f6-2dde-4892-8af2-beb59cfd1313): created successfully
Jul 10 13:00:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-67ee6efb-14fb-44a1-8767-e1f1edc9a977 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e757b742-7247-49db-9daa-adc16efb7d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-67ee6efb-14fb-44a1-8767-e1f1edc9a977 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Flow 'volume_create_manager' (3a7cd5c3-292f-4252-93cb-6d2fabe9389b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:00:51 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-67ee6efb-14fb-44a1-8767-e1f1edc9a977 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Created volume successfully.
Jul 10 13:00:51 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-62bd89f5-8a6a-4eee-b2b5-3c393c156c1c tempest-CreateVolumesFromImageTest-1102869783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0aedaec1-d7db-4cdc-9414-79e26e97d5cf" returned: 0 in 0.809s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-62bd89f5-8a6a-4eee-b2b5-3c393c156c1c tempest-CreateVolumesFromImageTest-1102869783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0aedaec1-d7db-4cdc-9414-79e26e97d5cf {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:52 devstack sudo[106141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0aedaec1-d7db-4cdc-9414-79e26e97d5cf
Jul 10 13:00:52 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:52 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-62bd89f5-8a6a-4eee-b2b5-3c393c156c1c tempest-CreateVolumesFromImageTest-1102869783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0aedaec1-d7db-4cdc-9414-79e26e97d5cf" returned: 0 in 0.664s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:52 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-62bd89f5-8a6a-4eee-b2b5-3c393c156c1c tempest-CreateVolumesFromImageTest-1102869783 None] Lock "cinder-quobyte-0aedaec1-d7db-4cdc-9414-79e26e97d5cf" released by "delete_volume" :: held 1.512s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:00:52 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-62bd89f5-8a6a-4eee-b2b5-3c393c156c1c tempest-CreateVolumesFromImageTest-1102869783 None] Created reservations ['02aec106-7f54-49f2-ba29-5f7cc06e98b2', '6b32e31f-19c1-46c7-9e85-3667d30991d6', '9ce1f98b-18a1-4258-a4b7-d898a0ab01b5', 'a048d3f7-a078-42aa-8270-3e5e37675377'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:00:52 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6fcca8e8-688f-44b6-9fef-6cb387f47bd8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f51904bd-e872-4fa8-ba56-8c064a3898d5 1073741824" returned: 0 in 0.856s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-62bd89f5-8a6a-4eee-b2b5-3c393c156c1c tempest-CreateVolumesFromImageTest-1102869783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:00:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-62bd89f5-8a6a-4eee-b2b5-3c393c156c1c tempest-CreateVolumesFromImageTest-1102869783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:00:52 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-62bd89f5-8a6a-4eee-b2b5-3c393c156c1c tempest-CreateVolumesFromImageTest-1102869783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:00:52 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-62bd89f5-8a6a-4eee-b2b5-3c393c156c1c tempest-CreateVolumesFromImageTest-1102869783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:00:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-62bd89f5-8a6a-4eee-b2b5-3c393c156c1c tempest-CreateVolumesFromImageTest-1102869783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:00:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-62bd89f5-8a6a-4eee-b2b5-3c393c156c1c tempest-CreateVolumesFromImageTest-1102869783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6fcca8e8-688f-44b6-9fef-6cb387f47bd8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f51904bd-e872-4fa8-ba56-8c064a3898d5 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:52 devstack sudo[106147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:00:52 devstack sudo[106147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:52 devstack sudo[106148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f51904bd-e872-4fa8-ba56-8c064a3898d5
Jul 10 13:00:52 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:53 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-531467e2-633c-4ebc-b59b-ea32e5ddf94d tempest-CreateVolumesFromImageTest-1102869783 None] Acquiring lock "cinder-e95fdf8e-507a-4603-966c-a4a26daa7b76-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:00:53 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-531467e2-633c-4ebc-b59b-ea32e5ddf94d tempest-CreateVolumesFromImageTest-1102869783 None] Lock "cinder-e95fdf8e-507a-4603-966c-a4a26daa7b76-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:00:53 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-531467e2-633c-4ebc-b59b-ea32e5ddf94d tempest-CreateVolumesFromImageTest-1102869783 None] Acquiring lock "cinder-quobyte-e95fdf8e-507a-4603-966c-a4a26daa7b76" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:00:53 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-531467e2-633c-4ebc-b59b-ea32e5ddf94d tempest-CreateVolumesFromImageTest-1102869783 None] Lock "cinder-quobyte-e95fdf8e-507a-4603-966c-a4a26daa7b76" acquired by "delete_volume" :: waited 0.021s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:00:53 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a8b082-d3ce-47c9-ba94-6c11b6a620c9]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:00:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-531467e2-633c-4ebc-b59b-ea32e5ddf94d tempest-CreateVolumesFromImageTest-1102869783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e95fdf8e-507a-4603-966c-a4a26daa7b76 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:53 devstack sudo[106147]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-62bd89f5-8a6a-4eee-b2b5-3c393c156c1c tempest-CreateVolumesFromImageTest-1102869783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.702s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:53 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-62bd89f5-8a6a-4eee-b2b5-3c393c156c1c tempest-CreateVolumesFromImageTest-1102869783 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:00:53 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-62bd89f5-8a6a-4eee-b2b5-3c393c156c1c tempest-CreateVolumesFromImageTest-1102869783 None] Deleted volume successfully.
Jul 10 13:00:53 devstack sudo[106153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e95fdf8e-507a-4603-966c-a4a26daa7b76
Jul 10 13:00:53 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:53 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:53 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-62bd89f5-8a6a-4eee-b2b5-3c393c156c1c tempest-CreateVolumesFromImageTest-1102869783 None] Lock "cinder-0aedaec1-d7db-4cdc-9414-79e26e97d5cf-delete_volume" released by "delete_volume" :: held 2.445s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:00:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6fcca8e8-688f-44b6-9fef-6cb387f47bd8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f51904bd-e872-4fa8-ba56-8c064a3898d5" returned: 0 in 0.729s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:53 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-6fcca8e8-688f-44b6-9fef-6cb387f47bd8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] <== create_volume: return (1655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 13:00:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-6fcca8e8-688f-44b6-9fef-6cb387f47bd8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.661s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:00:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1289d2e3-bc43-463c-8e0d-684447332e38 tempest-VolumeDependencyTests-267861649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.981s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:00:53 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-1289d2e3-bc43-463c-8e0d-684447332e38 tempest-VolumeDependencyTests-267861649 None] Creating offline snapshot 72cca1ab-a75e-4d44-aa24-ed57705d68cd of volume 0bc213eb-0dd0-47cc-b32e-58cf28aee65b {{(pid=87378) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 10 13:00:53 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6fcca8e8-688f-44b6-9fef-6cb387f47bd8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05815068-b3c7-49e7-9841-90d2fd8ad09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f51904bd-e872-4fa8-ba56-8c064a3898d5', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:53 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6fcca8e8-688f-44b6-9fef-6cb387f47bd8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53508934-daa8-4735-a138-6bc37f8c20c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:00:53 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b59fa5-0cd9-4a21-a6b9-deb73ddf0f67]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:00:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1289d2e3-bc43-463c-8e0d-684447332e38 tempest-VolumeDependencyTests-267861649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:53 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-6fcca8e8-688f-44b6-9fef-6cb387f47bd8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Volume volume-f51904bd-e872-4fa8-ba56-8c064a3898d5 (f51904bd-e872-4fa8-ba56-8c064a3898d5): created successfully
Jul 10 13:00:53 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6fcca8e8-688f-44b6-9fef-6cb387f47bd8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53508934-daa8-4735-a138-6bc37f8c20c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:00:53 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6fcca8e8-688f-44b6-9fef-6cb387f47bd8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Flow 'volume_create_manager' (aa5ee31f-16ac-4dfb-9d2c-07cfb8a82570) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:00:53 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-6fcca8e8-688f-44b6-9fef-6cb387f47bd8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Created volume successfully.
Jul 10 13:00:53 devstack sudo[106155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b
Jul 10 13:00:53 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:54 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3017f211-e4a7-4d59-be2a-d8157f3db592 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Acquiring lock "cinder-f51904bd-e872-4fa8-ba56-8c064a3898d5-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:00:54 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3017f211-e4a7-4d59-be2a-d8157f3db592 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "cinder-f51904bd-e872-4fa8-ba56-8c064a3898d5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:00:54 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-531467e2-633c-4ebc-b59b-ea32e5ddf94d tempest-CreateVolumesFromImageTest-1102869783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e95fdf8e-507a-4603-966c-a4a26daa7b76" returned: 0 in 0.849s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-531467e2-633c-4ebc-b59b-ea32e5ddf94d tempest-CreateVolumesFromImageTest-1102869783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e95fdf8e-507a-4603-966c-a4a26daa7b76 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:54 devstack sudo[106163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e95fdf8e-507a-4603-966c-a4a26daa7b76
Jul 10 13:00:54 devstack sudo[106163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:54 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3017f211-e4a7-4d59-be2a-d8157f3db592 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Acquiring lock "cinder-quobyte-f51904bd-e872-4fa8-ba56-8c064a3898d5" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:00:54 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3017f211-e4a7-4d59-be2a-d8157f3db592 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "cinder-quobyte-f51904bd-e872-4fa8-ba56-8c064a3898d5" acquired by "delete_volume" :: waited 0.018s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:00:54 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c4c634-3bee-4d85-8128-3e60bd83b839]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:00:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3017f211-e4a7-4d59-be2a-d8157f3db592 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f51904bd-e872-4fa8-ba56-8c064a3898d5 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:54 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1289d2e3-bc43-463c-8e0d-684447332e38 tempest-VolumeDependencyTests-267861649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b" returned: 0 in 0.796s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1289d2e3-bc43-463c-8e0d-684447332e38 tempest-VolumeDependencyTests-267861649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b.72cca1ab-a75e-4d44-aa24-ed57705d68cd 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:54 devstack sudo[106166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b.72cca1ab-a75e-4d44-aa24-ed57705d68cd 1G
Jul 10 13:00:54 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:54 devstack sudo[106165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f51904bd-e872-4fa8-ba56-8c064a3898d5
Jul 10 13:00:54 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:54 devstack sudo[106163]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-531467e2-633c-4ebc-b59b-ea32e5ddf94d tempest-CreateVolumesFromImageTest-1102869783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e95fdf8e-507a-4603-966c-a4a26daa7b76" returned: 0 in 0.652s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:54 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-531467e2-633c-4ebc-b59b-ea32e5ddf94d tempest-CreateVolumesFromImageTest-1102869783 None] Lock "cinder-quobyte-e95fdf8e-507a-4603-966c-a4a26daa7b76" released by "delete_volume" :: held 1.550s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:00:54 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-531467e2-633c-4ebc-b59b-ea32e5ddf94d tempest-CreateVolumesFromImageTest-1102869783 None] Created reservations ['3570640c-7da2-4757-b2a4-3304deeeb295', '69f5abc7-9bc2-49db-b221-9e4ffb4dfe49', 'e39ef8f0-c566-4d6b-b35c-ed8e00d040c0', '4505a4d6-c15c-4a82-b589-f3e1ad1ef31d'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:00:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-531467e2-633c-4ebc-b59b-ea32e5ddf94d tempest-CreateVolumesFromImageTest-1102869783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:00:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-531467e2-633c-4ebc-b59b-ea32e5ddf94d tempest-CreateVolumesFromImageTest-1102869783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:00:55 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-531467e2-633c-4ebc-b59b-ea32e5ddf94d tempest-CreateVolumesFromImageTest-1102869783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:00:55 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-531467e2-633c-4ebc-b59b-ea32e5ddf94d tempest-CreateVolumesFromImageTest-1102869783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:00:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-531467e2-633c-4ebc-b59b-ea32e5ddf94d tempest-CreateVolumesFromImageTest-1102869783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:00:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-531467e2-633c-4ebc-b59b-ea32e5ddf94d tempest-CreateVolumesFromImageTest-1102869783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:55 devstack sudo[106177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:00:55 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:55 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3017f211-e4a7-4d59-be2a-d8157f3db592 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f51904bd-e872-4fa8-ba56-8c064a3898d5" returned: 0 in 0.835s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3017f211-e4a7-4d59-be2a-d8157f3db592 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f51904bd-e872-4fa8-ba56-8c064a3898d5 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:55 devstack sudo[106179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f51904bd-e872-4fa8-ba56-8c064a3898d5
Jul 10 13:00:55 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:55 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1289d2e3-bc43-463c-8e0d-684447332e38 tempest-VolumeDependencyTests-267861649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b.72cca1ab-a75e-4d44-aa24-ed57705d68cd 1G" returned: 0 in 0.889s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1289d2e3-bc43-463c-8e0d-684447332e38 tempest-VolumeDependencyTests-267861649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b.72cca1ab-a75e-4d44-aa24-ed57705d68cd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:55 devstack sudo[106181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b.72cca1ab-a75e-4d44-aa24-ed57705d68cd
Jul 10 13:00:55 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:55 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-edcda135-3f98-4af9-b0b2-3f6a6f8d7853 tempest-CreateVolumesFromImageTest-1102869783 None] Acquiring lock "cinder-06bc4536-277b-4417-bc99-0f41dc843d6f-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:00:55 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-edcda135-3f98-4af9-b0b2-3f6a6f8d7853 tempest-CreateVolumesFromImageTest-1102869783 None] Lock "cinder-06bc4536-277b-4417-bc99-0f41dc843d6f-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:00:55 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-edcda135-3f98-4af9-b0b2-3f6a6f8d7853 tempest-CreateVolumesFromImageTest-1102869783 None] Acquiring lock "cinder-quobyte-06bc4536-277b-4417-bc99-0f41dc843d6f" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:00:55 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-edcda135-3f98-4af9-b0b2-3f6a6f8d7853 tempest-CreateVolumesFromImageTest-1102869783 None] Lock "cinder-quobyte-06bc4536-277b-4417-bc99-0f41dc843d6f" acquired by "delete_volume" :: waited 0.019s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:00:55 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[556b4f1e-c0e2-43b4-a670-58e2b1d2ba08]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:00:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-edcda135-3f98-4af9-b0b2-3f6a6f8d7853 tempest-CreateVolumesFromImageTest-1102869783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-06bc4536-277b-4417-bc99-0f41dc843d6f {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:55 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-531467e2-633c-4ebc-b59b-ea32e5ddf94d tempest-CreateVolumesFromImageTest-1102869783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.781s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:55 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-531467e2-633c-4ebc-b59b-ea32e5ddf94d tempest-CreateVolumesFromImageTest-1102869783 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:00:55 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-531467e2-633c-4ebc-b59b-ea32e5ddf94d tempest-CreateVolumesFromImageTest-1102869783 None] Deleted volume successfully.
Jul 10 13:00:55 devstack sudo[106184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-06bc4536-277b-4417-bc99-0f41dc843d6f
Jul 10 13:00:55 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:55 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-531467e2-633c-4ebc-b59b-ea32e5ddf94d tempest-CreateVolumesFromImageTest-1102869783 None] Lock "cinder-e95fdf8e-507a-4603-966c-a4a26daa7b76-delete_volume" released by "delete_volume" :: held 2.589s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:00:55 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3017f211-e4a7-4d59-be2a-d8157f3db592 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f51904bd-e872-4fa8-ba56-8c064a3898d5" returned: 0 in 0.759s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:55 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3017f211-e4a7-4d59-be2a-d8157f3db592 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "cinder-quobyte-f51904bd-e872-4fa8-ba56-8c064a3898d5" released by "delete_volume" :: held 1.640s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:00:56 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-3017f211-e4a7-4d59-be2a-d8157f3db592 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Created reservations ['8e1b6231-b2ef-4a45-b11b-5c438ca8b430', 'c0192bdd-13b1-479b-947e-5c9641de334d', 'c8793e51-ed20-4311-bc30-e58b936e9e5b', 'dd9074c6-1557-49d8-b0ea-45eba1d568f3'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:00:56 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1289d2e3-bc43-463c-8e0d-684447332e38 tempest-VolumeDependencyTests-267861649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b.72cca1ab-a75e-4d44-aa24-ed57705d68cd" returned: 0 in 0.758s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:56 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-1289d2e3-bc43-463c-8e0d-684447332e38 tempest-VolumeDependencyTests-267861649 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b.72cca1ab-a75e-4d44-aa24-ed57705d68cd is being set with open permissions: ugo+rw
Jul 10 13:00:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1289d2e3-bc43-463c-8e0d-684447332e38 tempest-VolumeDependencyTests-267861649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b.72cca1ab-a75e-4d44-aa24-ed57705d68cd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:56 devstack sudo[106190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b.72cca1ab-a75e-4d44-aa24-ed57705d68cd
Jul 10 13:00:56 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3017f211-e4a7-4d59-be2a-d8157f3db592 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:00:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3017f211-e4a7-4d59-be2a-d8157f3db592 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:00:56 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3017f211-e4a7-4d59-be2a-d8157f3db592 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:00:56 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3017f211-e4a7-4d59-be2a-d8157f3db592 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:00:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3017f211-e4a7-4d59-be2a-d8157f3db592 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:00:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3017f211-e4a7-4d59-be2a-d8157f3db592 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:56 devstack sudo[106192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:00:56 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:56 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-0d7c08c3-cd42-4396-8bd9-5920d9d595d7 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Acquiring lock "cinder-4fdff3f6-2dde-4892-8af2-beb59cfd1313-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:00:56 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-0d7c08c3-cd42-4396-8bd9-5920d9d595d7 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "cinder-4fdff3f6-2dde-4892-8af2-beb59cfd1313-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:00:56 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-0d7c08c3-cd42-4396-8bd9-5920d9d595d7 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Acquiring lock "cinder-quobyte-4fdff3f6-2dde-4892-8af2-beb59cfd1313" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:00:56 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-0d7c08c3-cd42-4396-8bd9-5920d9d595d7 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "cinder-quobyte-4fdff3f6-2dde-4892-8af2-beb59cfd1313" acquired by "delete_volume" :: waited 0.018s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:00:56 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7e3ac6-179a-4da7-8faa-14b2872a58b9]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:00:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0d7c08c3-cd42-4396-8bd9-5920d9d595d7 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4fdff3f6-2dde-4892-8af2-beb59cfd1313 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:56 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-edcda135-3f98-4af9-b0b2-3f6a6f8d7853 tempest-CreateVolumesFromImageTest-1102869783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-06bc4536-277b-4417-bc99-0f41dc843d6f" returned: 0 in 0.991s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-edcda135-3f98-4af9-b0b2-3f6a6f8d7853 tempest-CreateVolumesFromImageTest-1102869783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-06bc4536-277b-4417-bc99-0f41dc843d6f {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:56 devstack sudo[106199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4fdff3f6-2dde-4892-8af2-beb59cfd1313
Jul 10 13:00:56 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:56 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1289d2e3-bc43-463c-8e0d-684447332e38 tempest-VolumeDependencyTests-267861649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b.72cca1ab-a75e-4d44-aa24-ed57705d68cd" returned: 0 in 0.692s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:56 devstack sudo[106200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-06bc4536-277b-4417-bc99-0f41dc843d6f
Jul 10 13:00:56 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1289d2e3-bc43-463c-8e0d-684447332e38 tempest-VolumeDependencyTests-267861649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:56 devstack sudo[106204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b.info
Jul 10 13:00:56 devstack sudo[106204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:56 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3017f211-e4a7-4d59-be2a-d8157f3db592 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.746s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:56 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-3017f211-e4a7-4d59-be2a-d8157f3db592 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:00:56 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-3017f211-e4a7-4d59-be2a-d8157f3db592 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Deleted volume successfully.
Jul 10 13:00:56 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3017f211-e4a7-4d59-be2a-d8157f3db592 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "cinder-f51904bd-e872-4fa8-ba56-8c064a3898d5-delete_volume" released by "delete_volume" :: held 2.652s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:00:57 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0d7c08c3-cd42-4396-8bd9-5920d9d595d7 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4fdff3f6-2dde-4892-8af2-beb59cfd1313" returned: 0 in 0.793s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0d7c08c3-cd42-4396-8bd9-5920d9d595d7 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4fdff3f6-2dde-4892-8af2-beb59cfd1313 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:57 devstack sudo[106211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4fdff3f6-2dde-4892-8af2-beb59cfd1313
Jul 10 13:00:57 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:57 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-edcda135-3f98-4af9-b0b2-3f6a6f8d7853 tempest-CreateVolumesFromImageTest-1102869783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-06bc4536-277b-4417-bc99-0f41dc843d6f" returned: 0 in 0.755s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:57 devstack sudo[106204]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:57 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-edcda135-3f98-4af9-b0b2-3f6a6f8d7853 tempest-CreateVolumesFromImageTest-1102869783 None] Lock "cinder-quobyte-06bc4536-277b-4417-bc99-0f41dc843d6f" released by "delete_volume" :: held 1.802s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:00:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1289d2e3-bc43-463c-8e0d-684447332e38 tempest-VolumeDependencyTests-267861649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b.info" returned: 0 in 0.718s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:57 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-1289d2e3-bc43-463c-8e0d-684447332e38 tempest-VolumeDependencyTests-267861649 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b.info is being set with open permissions: ugo+rw
Jul 10 13:00:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1289d2e3-bc43-463c-8e0d-684447332e38 tempest-VolumeDependencyTests-267861649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:57 devstack sudo[106213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b.info
Jul 10 13:00:57 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:57 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-edcda135-3f98-4af9-b0b2-3f6a6f8d7853 tempest-CreateVolumesFromImageTest-1102869783 None] Created reservations ['a6f281d1-c8d7-46a3-abd9-c05b0ca28030', '69d87f6d-d062-48a0-b72f-95e27976fbb6', 'a6e047d5-2640-4ed9-b8fb-d4e8f0df0d3f', '4c8a3d10-bdbc-40e6-bb50-9420e785f38a'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:00:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-edcda135-3f98-4af9-b0b2-3f6a6f8d7853 tempest-CreateVolumesFromImageTest-1102869783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:00:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-edcda135-3f98-4af9-b0b2-3f6a6f8d7853 tempest-CreateVolumesFromImageTest-1102869783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:00:57 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-edcda135-3f98-4af9-b0b2-3f6a6f8d7853 tempest-CreateVolumesFromImageTest-1102869783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:00:57 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-edcda135-3f98-4af9-b0b2-3f6a6f8d7853 tempest-CreateVolumesFromImageTest-1102869783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:00:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-edcda135-3f98-4af9-b0b2-3f6a6f8d7853 tempest-CreateVolumesFromImageTest-1102869783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:00:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-edcda135-3f98-4af9-b0b2-3f6a6f8d7853 tempest-CreateVolumesFromImageTest-1102869783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:57 devstack sudo[106215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:00:57 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:58 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0d7c08c3-cd42-4396-8bd9-5920d9d595d7 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4fdff3f6-2dde-4892-8af2-beb59cfd1313" returned: 0 in 0.659s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:58 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-0d7c08c3-cd42-4396-8bd9-5920d9d595d7 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "cinder-quobyte-4fdff3f6-2dde-4892-8af2-beb59cfd1313" released by "delete_volume" :: held 1.503s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:00:58 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-0d7c08c3-cd42-4396-8bd9-5920d9d595d7 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Created reservations ['d565cf3e-020f-449a-883f-096f72bcbbd5', '699bc74f-a26a-40c2-af09-91e782f2439b', 'b0e75244-dc90-4de6-b25d-fa03633be37f', '62a0220f-e15e-4669-bade-7876ed231a82'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:00:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0d7c08c3-cd42-4396-8bd9-5920d9d595d7 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:00:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0d7c08c3-cd42-4396-8bd9-5920d9d595d7 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:00:58 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-0d7c08c3-cd42-4396-8bd9-5920d9d595d7 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:00:58 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-0d7c08c3-cd42-4396-8bd9-5920d9d595d7 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:00:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0d7c08c3-cd42-4396-8bd9-5920d9d595d7 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:00:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0d7c08c3-cd42-4396-8bd9-5920d9d595d7 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:58 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1289d2e3-bc43-463c-8e0d-684447332e38 tempest-VolumeDependencyTests-267861649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b.info" returned: 0 in 0.761s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:58 devstack sudo[106219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:00:58 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1289d2e3-bc43-463c-8e0d-684447332e38 tempest-VolumeDependencyTests-267861649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.720s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:00:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.842s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:00:58 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:00:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9642ab4-fac2-4adf-8f8f-e5f69d079bee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdc050b6427f4133a5b25c2bec71dbc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:00:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:00:38Z,use_quota=True,user_id='9178493fcf824166a27e9cd0bea2eb38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06e88013-0a26-4ca3-8d35-a2e0a1e71672),volume_type_id=06e88013-0a26-4ca3-8d35-a2e0a1e71672)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 13:00:58 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Creating volume b9642ab4-fac2-4adf-8f8f-e5f69d079bee {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 13:00:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:00:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:00:58 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:00:58 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:00:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:00:58 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 13:00:58 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 13:00:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b9642ab4-fac2-4adf-8f8f-e5f69d079bee 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:58 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-1289d2e3-bc43-463c-8e0d-684447332e38 tempest-VolumeDependencyTests-267861649 None] Create snapshot completed successfully
Jul 10 13:00:58 devstack sudo[106222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b9642ab4-fac2-4adf-8f8f-e5f69d079bee 1073741824
Jul 10 13:00:58 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:58 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-edcda135-3f98-4af9-b0b2-3f6a6f8d7853 tempest-CreateVolumesFromImageTest-1102869783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.775s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:58 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-edcda135-3f98-4af9-b0b2-3f6a6f8d7853 tempest-CreateVolumesFromImageTest-1102869783 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:00:58 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-edcda135-3f98-4af9-b0b2-3f6a6f8d7853 tempest-CreateVolumesFromImageTest-1102869783 None] Deleted volume successfully.
Jul 10 13:00:58 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-edcda135-3f98-4af9-b0b2-3f6a6f8d7853 tempest-CreateVolumesFromImageTest-1102869783 None] Lock "cinder-06bc4536-277b-4417-bc99-0f41dc843d6f-delete_volume" released by "delete_volume" :: held 2.847s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:00:58 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1cc8db4d-4105-4e1c-b3a7-ccd204131673 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Acquiring lock "cinder-1979c563-bac5-4437-ad33-5252ca4ae11d-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:00:58 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1cc8db4d-4105-4e1c-b3a7-ccd204131673 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "cinder-1979c563-bac5-4437-ad33-5252ca4ae11d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:00:58 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1cc8db4d-4105-4e1c-b3a7-ccd204131673 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Acquiring lock "cinder-quobyte-1979c563-bac5-4437-ad33-5252ca4ae11d" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:00:58 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1cc8db4d-4105-4e1c-b3a7-ccd204131673 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "cinder-quobyte-1979c563-bac5-4437-ad33-5252ca4ae11d" acquired by "delete_volume" :: waited 0.022s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:00:58 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ffe6370-59e1-4782-bab9-11779a87bbc8]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:00:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1cc8db4d-4105-4e1c-b3a7-ccd204131673 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1979c563-bac5-4437-ad33-5252ca4ae11d {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:59 devstack sudo[106224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1979c563-bac5-4437-ad33-5252ca4ae11d
Jul 10 13:00:59 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:59 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0d7c08c3-cd42-4396-8bd9-5920d9d595d7 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.818s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:59 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-0d7c08c3-cd42-4396-8bd9-5920d9d595d7 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:00:59 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-0d7c08c3-cd42-4396-8bd9-5920d9d595d7 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Deleted volume successfully.
Jul 10 13:00:59 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-0d7c08c3-cd42-4396-8bd9-5920d9d595d7 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "cinder-4fdff3f6-2dde-4892-8af2-beb59cfd1313-delete_volume" released by "delete_volume" :: held 2.600s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:00:59 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b9642ab4-fac2-4adf-8f8f-e5f69d079bee 1073741824" returned: 0 in 1.100s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b9642ab4-fac2-4adf-8f8f-e5f69d079bee {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:59 devstack sudo[106233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b9642ab4-fac2-4adf-8f8f-e5f69d079bee
Jul 10 13:00:59 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:00:59 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root
Jul 10 13:00:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1cc8db4d-4105-4e1c-b3a7-ccd204131673 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1979c563-bac5-4437-ad33-5252ca4ae11d" returned: 0 in 0.964s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:00:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1cc8db4d-4105-4e1c-b3a7-ccd204131673 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1979c563-bac5-4437-ad33-5252ca4ae11d {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:00:59 devstack sudo[106239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1979c563-bac5-4437-ad33-5252ca4ae11d
Jul 10 13:00:59 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:00 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 13:01:00 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] Flow 'volume_create_manager' (95b4c1b8-acf3-419e-8ed1-7ff81dc8c6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:01:00 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (947595ca-c27c-482d-82d0-1363e92c73ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:00 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (947595ca-c27c-482d-82d0-1363e92c73ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1367105474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f47e067-d841-4714-aafe-6df87914d292,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b55db6bd5a3477787e6310297009360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:01:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=72cca1ab-a75e-4d44-aa24-ed57705d68cd,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:01:00Z,use_quota=True,user_id='78db252798a14ecc8262d4785a8e4d9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:00 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3086fb40-9dd5-4f32-a8f2-193527df3e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:00 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3086fb40-9dd5-4f32-a8f2-193527df3e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:00 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b827eaf4-5c34-4220-84ec-79795a2a91bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:00 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b827eaf4-5c34-4220-84ec-79795a2a91bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3f47e067-d841-4714-aafe-6df87914d292', 'volume_name': 'volume-3f47e067-d841-4714-aafe-6df87914d292', 'volume_size': 1, 'snapshot_id': '72cca1ab-a75e-4d44-aa24-ed57705d68cd'}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:00 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ace73699-5f67-427e-8ff3-d0e79f5cb11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:00 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ace73699-5f67-427e-8ff3-d0e79f5cb11b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:00 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49e9dcd6-511e-4eb8-ad56-f91b03027fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:00 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] Volume 3f47e067-d841-4714-aafe-6df87914d292: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3f47e067-d841-4714-aafe-6df87914d292', 'volume_size': 1, 'snapshot_id': '72cca1ab-a75e-4d44-aa24-ed57705d68cd'}
Jul 10 13:01:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:01:00 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b9642ab4-fac2-4adf-8f8f-e5f69d079bee" returned: 0 in 0.845s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:00 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] <== create_volume: return (2001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 13:01:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:01:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.094s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:01:00 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] Acquiring lock "cinder-quobyte-72cca1ab-a75e-4d44-aa24-ed57705d68cd-3f47e067-d841-4714-aafe-6df87914d292" by "_create_volume_from_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:01:00 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] Lock "cinder-quobyte-72cca1ab-a75e-4d44-aa24-ed57705d68cd-3f47e067-d841-4714-aafe-6df87914d292" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:01:00 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] Creating volume 3f47e067-d841-4714-aafe-6df87914d292 from snapshot 72cca1ab-a75e-4d44-aa24-ed57705d68cd {{(pid=87378) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 10 13:01:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:01:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:01:00 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:01:00 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:01:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:01:00 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 13:01:00 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] Acquiring lock "cinder-quobyte-3f47e067-d841-4714-aafe-6df87914d292" by "_copy_volume_from_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:01:00 devstack cinder-volume[87378]: DEBUG cinder.volume.volume_utils [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Attempting download of a799f54a-6443-455c-91db-db5a8815ec19 ((None, [{'url': 'file:///opt/stack/data/glance/images/a799f54a-6443-455c-91db-db5a8815ec19', 'metadata': {}}])) to volume b9642ab4-fac2-4adf-8f8f-e5f69d079bee. {{(pid=87378) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 10 13:01:00 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] Lock "cinder-quobyte-3f47e067-d841-4714-aafe-6df87914d292" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:01:00 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] snapshot: 72cca1ab-a75e-4d44-aa24-ed57705d68cd, volume: 3f47e067-d841-4714-aafe-6df87914d292,  {{(pid=87378) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 10 13:01:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:01:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:01:00 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:01:00 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:01:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:01:00 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[430d966a-4b8b-4590-9520-b6bdadb03417]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:01:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b.72cca1ab-a75e-4d44-aa24-ed57705d68cd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:00 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c8f8fe-7150-44d5-96c7-7614dc96a67e]: (4, 'raw') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:01:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a799f54a-6443-455c-91db-db5a8815ec19_l23absvj {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:00 devstack sudo[106243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a799f54a-6443-455c-91db-db5a8815ec19_l23absvj
Jul 10 13:01:00 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:00 devstack sudo[106242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b.72cca1ab-a75e-4d44-aa24-ed57705d68cd
Jul 10 13:01:00 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:00 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1cc8db4d-4105-4e1c-b3a7-ccd204131673 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1979c563-bac5-4437-ad33-5252ca4ae11d" returned: 0 in 0.726s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:00 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1cc8db4d-4105-4e1c-b3a7-ccd204131673 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "cinder-quobyte-1979c563-bac5-4437-ad33-5252ca4ae11d" released by "delete_volume" :: held 1.747s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:01:00 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-1cc8db4d-4105-4e1c-b3a7-ccd204131673 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Created reservations ['764d672e-1ca0-4fc5-b8c5-8fc0ba30e7d6', '6901f14b-79ab-41a0-8239-cc6488494c8f', '134d1bc6-f889-4043-a18e-ea19683c2b95', 'dcc21acd-357b-4812-b11c-0595b513c23c'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:01:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1cc8db4d-4105-4e1c-b3a7-ccd204131673 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:01:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1cc8db4d-4105-4e1c-b3a7-ccd204131673 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:01:00 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-1cc8db4d-4105-4e1c-b3a7-ccd204131673 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:01:00 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-1cc8db4d-4105-4e1c-b3a7-ccd204131673 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:01:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1cc8db4d-4105-4e1c-b3a7-ccd204131673 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:01:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1cc8db4d-4105-4e1c-b3a7-ccd204131673 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:00 devstack sudo[106247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:01:00 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:01 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-47a2b67a-5d57-4291-b817-ba9b3bfc92ce tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Acquiring lock "cinder-e24ed74a-05aa-43ba-a58d-6bcd810662f2-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:01:01 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-47a2b67a-5d57-4291-b817-ba9b3bfc92ce tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "cinder-e24ed74a-05aa-43ba-a58d-6bcd810662f2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:01:01 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-47a2b67a-5d57-4291-b817-ba9b3bfc92ce tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Acquiring lock "cinder-quobyte-e24ed74a-05aa-43ba-a58d-6bcd810662f2" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:01:01 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-47a2b67a-5d57-4291-b817-ba9b3bfc92ce tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "cinder-quobyte-e24ed74a-05aa-43ba-a58d-6bcd810662f2" acquired by "delete_volume" :: waited 0.025s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:01:01 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4180a4-61e3-4a39-b009-09698d14e080]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:01:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-47a2b67a-5d57-4291-b817-ba9b3bfc92ce tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e24ed74a-05aa-43ba-a58d-6bcd810662f2 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:01 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b.72cca1ab-a75e-4d44-aa24-ed57705d68cd" returned: 0 in 0.922s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:01 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 13:01:01 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] will copy from snapshot at /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b {{(pid=87378) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 10 13:01:01 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] Creating direct copy from snapshot {{(pid=87378) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 10 13:01:01 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8a4580-420c-4c03-b012-55c728e1ded0]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:01:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:01 devstack sudo[106252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e24ed74a-05aa-43ba-a58d-6bcd810662f2
Jul 10 13:01:01 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:01 devstack sudo[106254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b
Jul 10 13:01:01 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:01 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a799f54a-6443-455c-91db-db5a8815ec19_l23absvj" returned: 0 in 1.155s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a799f54a-6443-455c-91db-db5a8815ec19_l23absvj {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:01 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1cc8db4d-4105-4e1c-b3a7-ccd204131673 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.931s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:01 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-1cc8db4d-4105-4e1c-b3a7-ccd204131673 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:01:01 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-1cc8db4d-4105-4e1c-b3a7-ccd204131673 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Deleted volume successfully.
Jul 10 13:01:01 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1cc8db4d-4105-4e1c-b3a7-ccd204131673 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "cinder-1979c563-bac5-4437-ad33-5252ca4ae11d-delete_volume" released by "delete_volume" :: held 2.960s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:01:01 devstack sudo[106259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a799f54a-6443-455c-91db-db5a8815ec19_l23absvj
Jul 10 13:01:01 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:02 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-47a2b67a-5d57-4291-b817-ba9b3bfc92ce tempest-CreateVolumesFromSourceVolumeTest-957425387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e24ed74a-05aa-43ba-a58d-6bcd810662f2" returned: 0 in 0.924s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-47a2b67a-5d57-4291-b817-ba9b3bfc92ce tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e24ed74a-05aa-43ba-a58d-6bcd810662f2 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:02 devstack sudo[106265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e24ed74a-05aa-43ba-a58d-6bcd810662f2
Jul 10 13:01:02 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:02 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b" returned: 0 in 1.064s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:02 devstack cinder-volume[87378]: DEBUG cinder.utils [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] Path /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3f47e067-d841-4714-aafe-6df87914d292 not found in is_blk_device check {{(pid=87378) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 10 13:01:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3f47e067-d841-4714-aafe-6df87914d292 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:02 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:02 devstack sudo[106272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3f47e067-d841-4714-aafe-6df87914d292
Jul 10 13:01:02 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a799f54a-6443-455c-91db-db5a8815ec19_l23absvj" returned: 1 in 0.879s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a799f54a-6443-455c-91db-db5a8815ec19_l23absvj' failed. Not Retrying. {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 10 13:01:02 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[068a9b96-8dbd-4a03-914a-33f446307411]: (4, 'raw') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:01:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a799f54a-6443-455c-91db-db5a8815ec19_eag83arrdevstack@QuobyteHD {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:02 devstack sudo[106274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a799f54a-6443-455c-91db-db5a8815ec19_eag83arrdevstack@QuobyteHD
Jul 10 13:01:02 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:02 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-47a2b67a-5d57-4291-b817-ba9b3bfc92ce tempest-CreateVolumesFromSourceVolumeTest-957425387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e24ed74a-05aa-43ba-a58d-6bcd810662f2" returned: 0 in 0.732s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:02 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-47a2b67a-5d57-4291-b817-ba9b3bfc92ce tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "cinder-quobyte-e24ed74a-05aa-43ba-a58d-6bcd810662f2" released by "delete_volume" :: held 1.718s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:01:03 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-47a2b67a-5d57-4291-b817-ba9b3bfc92ce tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Created reservations ['b7e3f9bc-42a6-41ff-8bbc-6f5844a731db', 'e95c97c7-f9ff-4991-932b-bb2b7deb8aa5', 'b1833e3b-8359-4bb0-8a34-77f890b04251', 'e99bf1d8-18e7-45af-8e3d-ba30b1a180cf'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:01:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-47a2b67a-5d57-4291-b817-ba9b3bfc92ce tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:01:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-47a2b67a-5d57-4291-b817-ba9b3bfc92ce tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:01:03 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-47a2b67a-5d57-4291-b817-ba9b3bfc92ce tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:01:03 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-47a2b67a-5d57-4291-b817-ba9b3bfc92ce tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:01:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-47a2b67a-5d57-4291-b817-ba9b3bfc92ce tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:01:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-47a2b67a-5d57-4291-b817-ba9b3bfc92ce tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:03 devstack sudo[106279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:01:03 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:03 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a799f54a-6443-455c-91db-db5a8815ec19_eag83arrdevstack@QuobyteHD" returned: 0 in 0.847s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a799f54a-6443-455c-91db-db5a8815ec19_eag83arrdevstack@QuobyteHD {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:03 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b3c6f8ce-c5be-4a55-a7de-e35e21c35b62 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Acquiring lock "cinder-50144674-4409-47e2-a4bb-58f345844e53-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:01:03 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b3c6f8ce-c5be-4a55-a7de-e35e21c35b62 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "cinder-50144674-4409-47e2-a4bb-58f345844e53-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:01:03 devstack sudo[106285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a799f54a-6443-455c-91db-db5a8815ec19_eag83arrdevstack@QuobyteHD
Jul 10 13:01:03 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:03 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b3c6f8ce-c5be-4a55-a7de-e35e21c35b62 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Acquiring lock "cinder-quobyte-50144674-4409-47e2-a4bb-58f345844e53" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:01:03 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b3c6f8ce-c5be-4a55-a7de-e35e21c35b62 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "cinder-quobyte-50144674-4409-47e2-a4bb-58f345844e53" acquired by "delete_volume" :: waited 0.041s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:01:03 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b67d71a-03f9-414a-8476-b719606f9e31]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:01:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b3c6f8ce-c5be-4a55-a7de-e35e21c35b62 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-50144674-4409-47e2-a4bb-58f345844e53 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:04 devstack sudo[106293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-50144674-4409-47e2-a4bb-58f345844e53
Jul 10 13:01:04 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:04 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-47a2b67a-5d57-4291-b817-ba9b3bfc92ce tempest-CreateVolumesFromSourceVolumeTest-957425387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 1.839s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:04 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-47a2b67a-5d57-4291-b817-ba9b3bfc92ce tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:01:04 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-47a2b67a-5d57-4291-b817-ba9b3bfc92ce tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Deleted volume successfully.
Jul 10 13:01:05 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-47a2b67a-5d57-4291-b817-ba9b3bfc92ce tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "cinder-e24ed74a-05aa-43ba-a58d-6bcd810662f2-delete_volume" released by "delete_volume" :: held 3.897s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:01:05 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a799f54a-6443-455c-91db-db5a8815ec19_eag83arrdevstack@QuobyteHD" returned: 1 in 2.107s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a799f54a-6443-455c-91db-db5a8815ec19_eag83arrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 10 13:01:05 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] a799f54a-6443-455c-91db-db5a8815ec19 was raw, converting to raw {{(pid=87378) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 10 13:01:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a799f54a-6443-455c-91db-db5a8815ec19_eag83arrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b9642ab4-fac2-4adf-8f8f-e5f69d079bee {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:05 devstack sudo[106303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a799f54a-6443-455c-91db-db5a8815ec19_eag83arrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b9642ab4-fac2-4adf-8f8f-e5f69d079bee
Jul 10 13:01:05 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:05 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b3c6f8ce-c5be-4a55-a7de-e35e21c35b62 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-50144674-4409-47e2-a4bb-58f345844e53" returned: 0 in 2.043s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b3c6f8ce-c5be-4a55-a7de-e35e21c35b62 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-50144674-4409-47e2-a4bb-58f345844e53 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:05 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 13:01:05 devstack sudo[106305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-50144674-4409-47e2-a4bb-58f345844e53
Jul 10 13:01:05 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Flow 'volume_create_manager' (eda6e3ea-4b41-4d91-a0e9-fe413992a9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:01:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42f53772-beb7-4fcc-84c6-aeda5d85df06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42f53772-beb7-4fcc-84c6-aeda5d85df06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:01:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2af04ef9-435b-4025-8ff5-be4571c09a4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='633f6ab35c5343bd87cd81bff95b4c8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:01:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:01:06Z,use_quota=True,user_id='62d04b526dfe46929897dbf2e1bc7543',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ef3f094-eb71-41f5-8f16-956c71ee1c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ef3f094-eb71-41f5-8f16-956c71ee1c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7bb72d3-8ce3-4b76-adf8-0b640b9888f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:05 devstack cinder-volume[87378]: DEBUG cinder.image.glance [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Creating Keystone auth plugin from conf {{(pid=87378) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 10 13:01:06 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7bb72d3-8ce3-4b76-adf8-0b640b9888f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2af04ef9-435b-4025-8ff5-be4571c09a4a', 'volume_name': 'volume-2af04ef9-435b-4025-8ff5-be4571c09a4a', 'volume_size': 1, 'image_id': 'b822bc03-487d-4aa6-a050-4fbd32aaf056', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b822bc03-487d-4aa6-a050-4fbd32aaf056', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9cb0e2819961375a28d689b1f213a396', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '633f6ab35c5343bd87cd81bff95b4c8d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'feb711d441847d6c8b022ce3381773fffc1afa127a34413a27808cc6503c5d8b58654f45e74cef4648a31a94e8d3cee913399636321b453875c3eb7834798ba3', 'id': 'b822bc03-487d-4aa6-a050-4fbd32aaf056', 'created_at': datetime.datetime(2026, 7, 10, 11, 1, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 11, 1, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b822bc03-487d-4aa6-a050-4fbd32aaf056/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74a0a1765bb0>}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:06 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59074b60-fad5-42fa-8bb8-c9d525d1929c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:06 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59074b60-fad5-42fa-8bb8-c9d525d1929c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:06 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56ae9874-ac43-4dda-a5c0-3f3b8c18dcc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:06 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Volume 2af04ef9-435b-4025-8ff5-be4571c09a4a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2af04ef9-435b-4025-8ff5-be4571c09a4a', 'volume_size': 1, 'image_id': 'b822bc03-487d-4aa6-a050-4fbd32aaf056', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b822bc03-487d-4aa6-a050-4fbd32aaf056', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9cb0e2819961375a28d689b1f213a396', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '633f6ab35c5343bd87cd81bff95b4c8d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'feb711d441847d6c8b022ce3381773fffc1afa127a34413a27808cc6503c5d8b58654f45e74cef4648a31a94e8d3cee913399636321b453875c3eb7834798ba3', 'id': 'b822bc03-487d-4aa6-a050-4fbd32aaf056', 'created_at': datetime.datetime(2026, 7, 10, 11, 1, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 11, 1, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b822bc03-487d-4aa6-a050-4fbd32aaf056/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74a0a1765bb0>}
Jul 10 13:01:06 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Trying to clone 2af04ef9-435b-4025-8ff5-be4571c09a4a from image b822bc03-487d-4aa6-a050-4fbd32aaf056 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b822bc03-487d-4aa6-a050-4fbd32aaf056', 'metadata': {}}]). {{(pid=87378) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 10 13:01:07 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b822bc03-487d-4aa6-a050-4fbd32aaf056_gyec84pzdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87378) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 10 13:01:07 devstack cinder-volume[87378]: INFO cinder.image.image_utils [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Image download 0.00 MB at 0.00 MB/s
Jul 10 13:01:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b3c6f8ce-c5be-4a55-a7de-e35e21c35b62 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-50144674-4409-47e2-a4bb-58f345844e53" returned: 0 in 1.494s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:07 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:07 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b3c6f8ce-c5be-4a55-a7de-e35e21c35b62 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "cinder-quobyte-50144674-4409-47e2-a4bb-58f345844e53" released by "delete_volume" :: held 3.655s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:01:07 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c929f4df-6d35-464c-93c8-ede9122734ff]: (4, 'raw') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:01:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b822bc03-487d-4aa6-a050-4fbd32aaf056_gyec84pzdevstack@QuobyteHD {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:07 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-b3c6f8ce-c5be-4a55-a7de-e35e21c35b62 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Created reservations ['be8c2e87-cd19-4a0f-885e-1521ea6a8274', '2eba5eb2-c9bf-4d59-8298-caa9dfa0a83b', 'f392abeb-d16d-44b2-ac59-15316b5d89fd', '3d2c4dd0-3969-4e77-bec8-2340e80f2b0b'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:01:07 devstack sudo[106311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b822bc03-487d-4aa6-a050-4fbd32aaf056_gyec84pzdevstack@QuobyteHD
Jul 10 13:01:07 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-b3c6f8ce-c5be-4a55-a7de-e35e21c35b62 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:01:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-b3c6f8ce-c5be-4a55-a7de-e35e21c35b62 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:01:07 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-b3c6f8ce-c5be-4a55-a7de-e35e21c35b62 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:01:07 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-b3c6f8ce-c5be-4a55-a7de-e35e21c35b62 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:01:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-b3c6f8ce-c5be-4a55-a7de-e35e21c35b62 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:01:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b3c6f8ce-c5be-4a55-a7de-e35e21c35b62 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:07 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a799f54a-6443-455c-91db-db5a8815ec19_eag83arrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b9642ab4-fac2-4adf-8f8f-e5f69d079bee" returned: 0 in 2.287s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:07 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a799f54a-6443-455c-91db-db5a8815ec19_eag83arrdevstack@QuobyteHD, size 0.00 MB, duration 2.31 sec, destination /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b9642ab4-fac2-4adf-8f8f-e5f69d079bee {{(pid=87378) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 10 13:01:07 devstack cinder-volume[87378]: INFO cinder.image.image_utils [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Converted 0.00 MB image at 0.00 MB/s
Jul 10 13:01:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b9642ab4-fac2-4adf-8f8f-e5f69d079bee 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:07 devstack sudo[106313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:01:07 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:07 devstack sudo[106314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b9642ab4-fac2-4adf-8f8f-e5f69d079bee 1G
Jul 10 13:01:07 devstack sudo[106314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:08 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-00736027-d8b7-46a3-8b30-c7ea6e2478c8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Acquiring lock "cinder-b7a302de-50af-4c70-a17c-e67466b7a364-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:01:08 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-00736027-d8b7-46a3-8b30-c7ea6e2478c8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "cinder-b7a302de-50af-4c70-a17c-e67466b7a364-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:01:08 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-00736027-d8b7-46a3-8b30-c7ea6e2478c8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Acquiring lock "cinder-quobyte-b7a302de-50af-4c70-a17c-e67466b7a364" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:01:08 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-00736027-d8b7-46a3-8b30-c7ea6e2478c8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "cinder-quobyte-b7a302de-50af-4c70-a17c-e67466b7a364" acquired by "delete_volume" :: waited 0.029s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:01:08 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36208ae-a67a-4c57-a930-b47c038bdd3a]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:01:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-00736027-d8b7-46a3-8b30-c7ea6e2478c8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b7a302de-50af-4c70-a17c-e67466b7a364 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:09 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b3c6f8ce-c5be-4a55-a7de-e35e21c35b62 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 1.320s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:09 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-b3c6f8ce-c5be-4a55-a7de-e35e21c35b62 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:01:09 devstack sudo[106317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b7a302de-50af-4c70-a17c-e67466b7a364
Jul 10 13:01:09 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:09 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-b3c6f8ce-c5be-4a55-a7de-e35e21c35b62 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Deleted volume successfully.
Jul 10 13:01:09 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-b3c6f8ce-c5be-4a55-a7de-e35e21c35b62 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "cinder-50144674-4409-47e2-a4bb-58f345844e53-delete_volume" released by "delete_volume" :: held 5.644s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:01:09 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b822bc03-487d-4aa6-a050-4fbd32aaf056_gyec84pzdevstack@QuobyteHD" returned: 0 in 1.952s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b822bc03-487d-4aa6-a050-4fbd32aaf056_gyec84pzdevstack@QuobyteHD {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:09 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3f47e067-d841-4714-aafe-6df87914d292" returned: 0 in 6.880s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:09 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[de897365-c6e9-4e19-945e-8eb5f24f6944]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:01:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:09 devstack sudo[106322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b822bc03-487d-4aa6-a050-4fbd32aaf056_gyec84pzdevstack@QuobyteHD
Jul 10 13:01:09 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:09 devstack sudo[106323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b
Jul 10 13:01:09 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:09 devstack sudo[106314]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b9642ab4-fac2-4adf-8f8f-e5f69d079bee 1G" returned: 0 in 1.746s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:09 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5302c67-f092-4ae0-b8e8-aef9a08835f6]: (4, 'raw') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:01:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b9642ab4-fac2-4adf-8f8f-e5f69d079bee {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:09 devstack sudo[106330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b9642ab4-fac2-4adf-8f8f-e5f69d079bee
Jul 10 13:01:09 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:09 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-00736027-d8b7-46a3-8b30-c7ea6e2478c8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b7a302de-50af-4c70-a17c-e67466b7a364" returned: 0 in 1.277s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-00736027-d8b7-46a3-8b30-c7ea6e2478c8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b7a302de-50af-4c70-a17c-e67466b7a364 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:09 devstack sudo[106336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b7a302de-50af-4c70-a17c-e67466b7a364
Jul 10 13:01:09 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:10 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b822bc03-487d-4aa6-a050-4fbd32aaf056_gyec84pzdevstack@QuobyteHD" returned: 1 in 0.857s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b822bc03-487d-4aa6-a050-4fbd32aaf056_gyec84pzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 10 13:01:10 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Temporary image b822bc03-487d-4aa6-a050-4fbd32aaf056 is fetched for user 62d04b526dfe46929897dbf2e1bc7543. {{(pid=87378) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 10 13:01:10 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aebb540-572d-48d6-9971-bc370e5753fa]: (4, 'raw') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:01:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b822bc03-487d-4aa6-a050-4fbd32aaf056_gyec84pzdevstack@QuobyteHD {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:10 devstack sudo[106343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b822bc03-487d-4aa6-a050-4fbd32aaf056_gyec84pzdevstack@QuobyteHD
Jul 10 13:01:10 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:10 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b" returned: 0 in 1.079s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:10 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] Image conversion details: src /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b, size 1024.00 MB, duration 6.88 sec, destination /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3f47e067-d841-4714-aafe-6df87914d292 {{(pid=87378) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 10 13:01:10 devstack cinder-volume[87378]: INFO cinder.image.image_utils [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] Converted 1024.00 MB image at 148.80 MB/s
Jul 10 13:01:10 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3f47e067-d841-4714-aafe-6df87914d292 is being set with open permissions: ugo+rw
Jul 10 13:01:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3f47e067-d841-4714-aafe-6df87914d292 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:10 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:10 devstack sudo[106348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3f47e067-d841-4714-aafe-6df87914d292
Jul 10 13:01:10 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b9642ab4-fac2-4adf-8f8f-e5f69d079bee" returned: 0 in 0.881s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b9642ab4-fac2-4adf-8f8f-e5f69d079bee {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:10 devstack sudo[106350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b9642ab4-fac2-4adf-8f8f-e5f69d079bee
Jul 10 13:01:10 devstack sudo[106350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:10 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-00736027-d8b7-46a3-8b30-c7ea6e2478c8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b7a302de-50af-4c70-a17c-e67466b7a364" returned: 0 in 0.730s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:10 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-00736027-d8b7-46a3-8b30-c7ea6e2478c8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "cinder-quobyte-b7a302de-50af-4c70-a17c-e67466b7a364" released by "delete_volume" :: held 2.087s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:01:10 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-00736027-d8b7-46a3-8b30-c7ea6e2478c8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Created reservations ['7613d504-6135-4dbb-988f-0a4487893409', 'fd50e68c-bdfd-4545-9114-5b7a807b764a', 'f70a5b6b-0722-464b-b2f8-f00712d31978', '18c21a0a-b2a5-4583-bdb2-9c2a91ede26c'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:01:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-00736027-d8b7-46a3-8b30-c7ea6e2478c8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:01:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-00736027-d8b7-46a3-8b30-c7ea6e2478c8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:01:10 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-00736027-d8b7-46a3-8b30-c7ea6e2478c8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:01:10 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-00736027-d8b7-46a3-8b30-c7ea6e2478c8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:01:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-00736027-d8b7-46a3-8b30-c7ea6e2478c8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:01:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-00736027-d8b7-46a3-8b30-c7ea6e2478c8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:10 devstack sudo[106353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:01:10 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:11 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b822bc03-487d-4aa6-a050-4fbd32aaf056_gyec84pzdevstack@QuobyteHD" returned: 0 in 0.846s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b822bc03-487d-4aa6-a050-4fbd32aaf056_gyec84pzdevstack@QuobyteHD {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:11 devstack sudo[106358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b822bc03-487d-4aa6-a050-4fbd32aaf056_gyec84pzdevstack@QuobyteHD
Jul 10 13:01:11 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:11 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3f47e067-d841-4714-aafe-6df87914d292" returned: 0 in 0.745s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:11 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] Lock "cinder-quobyte-3f47e067-d841-4714-aafe-6df87914d292" released by "_copy_volume_from_snapshot" :: held 10.822s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:01:11 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] Lock "cinder-quobyte-72cca1ab-a75e-4d44-aa24-ed57705d68cd-3f47e067-d841-4714-aafe-6df87914d292" released by "_create_volume_from_snapshot" :: held 10.866s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:01:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.889s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:01:11 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49e9dcd6-511e-4eb8-ad56-f91b03027fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f47e067-d841-4714-aafe-6df87914d292', 'volume_size': 1, 'snapshot_id': '72cca1ab-a75e-4d44-aa24-ed57705d68cd'}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:11 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (850f913c-0a7b-4baa-b3ec-3b60363ad9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:11 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] Volume volume-3f47e067-d841-4714-aafe-6df87914d292 (3f47e067-d841-4714-aafe-6df87914d292): created successfully
Jul 10 13:01:11 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (850f913c-0a7b-4baa-b3ec-3b60363ad9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:11 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] Flow 'volume_create_manager' (95b4c1b8-acf3-419e-8ed1-7ff81dc8c6a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:01:11 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-5eede68d-bb2e-46d4-8bad-bd134fbfedd3 tempest-VolumeDependencyTests-267861649 None] Created volume successfully.
Jul 10 13:01:11 devstack sudo[106350]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b9642ab4-fac2-4adf-8f8f-e5f69d079bee" returned: 1 in 0.897s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b9642ab4-fac2-4adf-8f8f-e5f69d079bee' failed. Not Retrying. {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 10 13:01:11 devstack cinder-volume[87378]: DEBUG cinder.volume.volume_utils [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Downloaded image a799f54a-6443-455c-91db-db5a8815ec19 ((None, [{'url': 'file:///opt/stack/data/glance/images/a799f54a-6443-455c-91db-db5a8815ec19', 'metadata': {}}])) to volume b9642ab4-fac2-4adf-8f8f-e5f69d079bee successfully. {{(pid=87378) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 10 13:01:11 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Temporary image a799f54a-6443-455c-91db-db5a8815ec19 for user 9178493fcf824166a27e9cd0bea2eb38 is deleted. {{(pid=87378) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 10 13:01:11 devstack cinder-volume[87378]: DEBUG cinder.volume.volume_utils [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Marking volume b9642ab4-fac2-4adf-8f8f-e5f69d079bee as bootable. {{(pid=87378) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 10 13:01:11 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Copying metadata from image a799f54a-6443-455c-91db-db5a8815ec19 to b9642ab4-fac2-4adf-8f8f-e5f69d079bee. {{(pid=87378) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 10 13:01:11 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Creating volume glance metadata for volume b9642ab4-fac2-4adf-8f8f-e5f69d079bee backed by image a799f54a-6443-455c-91db-db5a8815ec19 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'a799f54a-6443-455c-91db-db5a8815ec19', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '859102d24c4c5c18d253a59dcdfacd84', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87378) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 10 13:01:11 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8a04c47-158f-4c57-aebc-fe52be4fda84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9642ab4-fac2-4adf-8f8f-e5f69d079bee', 'volume_size': 1, 'image_id': 'a799f54a-6443-455c-91db-db5a8815ec19', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a799f54a-6443-455c-91db-db5a8815ec19', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '859102d24c4c5c18d253a59dcdfacd84', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fdc050b6427f4133a5b25c2bec71dbc2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '546e338d6459ff7386c04674cab05688954cc1f335e297f05e92ec69b41d6e9ed3833aa9603d0728f49c89e95e6aff6632bc75b31d744ddaaca3343885f30574', 'id': 'a799f54a-6443-455c-91db-db5a8815ec19', 'created_at': datetime.datetime(2026, 7, 10, 11, 0, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 11, 0, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a799f54a-6443-455c-91db-db5a8815ec19/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74a0a1726fc0>}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:11 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e98483d3-f217-4c98-b66b-665b347cc410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:11 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Volume volume-b9642ab4-fac2-4adf-8f8f-e5f69d079bee (b9642ab4-fac2-4adf-8f8f-e5f69d079bee): created successfully
Jul 10 13:01:11 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e98483d3-f217-4c98-b66b-665b347cc410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:11 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Flow 'volume_create_manager' (c9c1fe04-676f-4d5a-8346-731ad6adceac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:01:11 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-cbe09d57-674b-4ef0-8416-852013ddcfb1 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Created volume successfully.
Jul 10 13:01:11 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-00736027-d8b7-46a3-8b30-c7ea6e2478c8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.754s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:11 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-00736027-d8b7-46a3-8b30-c7ea6e2478c8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:01:11 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-00736027-d8b7-46a3-8b30-c7ea6e2478c8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Deleted volume successfully.
Jul 10 13:01:11 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-00736027-d8b7-46a3-8b30-c7ea6e2478c8 tempest-CreateVolumesFromSourceVolumeTest-957425387 None] Lock "cinder-b7a302de-50af-4c70-a17c-e67466b7a364-delete_volume" released by "delete_volume" :: held 3.162s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:01:11 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b822bc03-487d-4aa6-a050-4fbd32aaf056_gyec84pzdevstack@QuobyteHD" returned: 1 in 0.761s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b822bc03-487d-4aa6-a050-4fbd32aaf056_gyec84pzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 10 13:01:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:01:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:01:11 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:01:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2af04ef9-435b-4025-8ff5-be4571c09a4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='633f6ab35c5343bd87cd81bff95b4c8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:01:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:01:06Z,use_quota=True,user_id='62d04b526dfe46929897dbf2e1bc7543',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 13:01:11 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Creating volume 2af04ef9-435b-4025-8ff5-be4571c09a4a {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 13:01:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:01:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:01:11 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:01:11 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:01:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:01:11 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 13:01:11 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 13:01:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2af04ef9-435b-4025-8ff5-be4571c09a4a 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:11 devstack sudo[106367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2af04ef9-435b-4025-8ff5-be4571c09a4a 1073741824
Jul 10 13:01:11 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:12 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-645b6a44-478b-4eb0-84fb-cbf4d428dac5 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Acquiring lock "cinder-b9642ab4-fac2-4adf-8f8f-e5f69d079bee-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:01:12 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-38151069-939e-4c0f-9946-fd7fae9cd852 tempest-VolumeDependencyTests-267861649 None] Acquiring lock "cinder-72cca1ab-a75e-4d44-aa24-ed57705d68cd-delete_snapshot" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:01:12 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-38151069-939e-4c0f-9946-fd7fae9cd852 tempest-VolumeDependencyTests-267861649 None] Lock "cinder-72cca1ab-a75e-4d44-aa24-ed57705d68cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:01:12 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-38151069-939e-4c0f-9946-fd7fae9cd852 tempest-VolumeDependencyTests-267861649 None] Acquiring lock "cinder-quobyte-0bc213eb-0dd0-47cc-b32e-58cf28aee65b" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:01:12 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-645b6a44-478b-4eb0-84fb-cbf4d428dac5 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Lock "cinder-b9642ab4-fac2-4adf-8f8f-e5f69d079bee-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:01:12 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-38151069-939e-4c0f-9946-fd7fae9cd852 tempest-VolumeDependencyTests-267861649 None] Lock "cinder-quobyte-0bc213eb-0dd0-47cc-b32e-58cf28aee65b" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:01:12 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-38151069-939e-4c0f-9946-fd7fae9cd852 tempest-VolumeDependencyTests-267861649 None] Acquiring lock "cinder-quobyte-72cca1ab-a75e-4d44-aa24-ed57705d68cd" by "_delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:01:12 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-38151069-939e-4c0f-9946-fd7fae9cd852 tempest-VolumeDependencyTests-267861649 None] Lock "cinder-quobyte-72cca1ab-a75e-4d44-aa24-ed57705d68cd" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:01:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-38151069-939e-4c0f-9946-fd7fae9cd852 tempest-VolumeDependencyTests-267861649 None] Deleting offline snapshot 72cca1ab-a75e-4d44-aa24-ed57705d68cd of volume 0bc213eb-0dd0-47cc-b32e-58cf28aee65b {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 10 13:01:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-38151069-939e-4c0f-9946-fd7fae9cd852 tempest-VolumeDependencyTests-267861649 None] snapshot_file for this snap is: volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b.72cca1ab-a75e-4d44-aa24-ed57705d68cd {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 10 13:01:12 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[55715815-e449-4494-a359-63041273893e]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:01:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-38151069-939e-4c0f-9946-fd7fae9cd852 tempest-VolumeDependencyTests-267861649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b.72cca1ab-a75e-4d44-aa24-ed57705d68cd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:12 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-645b6a44-478b-4eb0-84fb-cbf4d428dac5 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Acquiring lock "cinder-quobyte-b9642ab4-fac2-4adf-8f8f-e5f69d079bee" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:01:12 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-645b6a44-478b-4eb0-84fb-cbf4d428dac5 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Lock "cinder-quobyte-b9642ab4-fac2-4adf-8f8f-e5f69d079bee" acquired by "delete_volume" :: waited 0.037s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:01:12 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[62511c0c-9187-4444-87ca-f2daec378bfd]: (4, 'raw') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:01:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-645b6a44-478b-4eb0-84fb-cbf4d428dac5 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b9642ab4-fac2-4adf-8f8f-e5f69d079bee {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:12 devstack sudo[106371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b.72cca1ab-a75e-4d44-aa24-ed57705d68cd
Jul 10 13:01:12 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:12 devstack sudo[106373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b9642ab4-fac2-4adf-8f8f-e5f69d079bee
Jul 10 13:01:12 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:12 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2af04ef9-435b-4025-8ff5-be4571c09a4a 1073741824" returned: 0 in 1.011s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2af04ef9-435b-4025-8ff5-be4571c09a4a {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:12 devstack sudo[106377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2af04ef9-435b-4025-8ff5-be4571c09a4a
Jul 10 13:01:12 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:12 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 13:01:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:01:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:01:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:01:13 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:01:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:01:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:13 devstack sudo[106379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:01:13 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:13 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-645b6a44-478b-4eb0-84fb-cbf4d428dac5 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b9642ab4-fac2-4adf-8f8f-e5f69d079bee" returned: 0 in 0.966s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-645b6a44-478b-4eb0-84fb-cbf4d428dac5 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b9642ab4-fac2-4adf-8f8f-e5f69d079bee {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:13 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-38151069-939e-4c0f-9946-fd7fae9cd852 tempest-VolumeDependencyTests-267861649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b.72cca1ab-a75e-4d44-aa24-ed57705d68cd" returned: 0 in 1.181s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:13 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-38151069-939e-4c0f-9946-fd7fae9cd852 tempest-VolumeDependencyTests-267861649 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 13:01:13 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a900773f-53aa-4843-a17b-b3ff0a530c59]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:01:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-38151069-939e-4c0f-9946-fd7fae9cd852 tempest-VolumeDependencyTests-267861649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:13 devstack sudo[106388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b9642ab4-fac2-4adf-8f8f-e5f69d079bee
Jul 10 13:01:13 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:13 devstack sudo[106389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b
Jul 10 13:01:13 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:13 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2af04ef9-435b-4025-8ff5-be4571c09a4a" returned: 0 in 0.942s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:13 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] <== create_volume: return (2011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 13:01:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.015s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:01:13 devstack cinder-volume[87378]: DEBUG cinder.volume.volume_utils [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Attempting download of b822bc03-487d-4aa6-a050-4fbd32aaf056 ((None, [{'url': 'file:///opt/stack/data/glance/images/b822bc03-487d-4aa6-a050-4fbd32aaf056', 'metadata': {}}])) to volume 2af04ef9-435b-4025-8ff5-be4571c09a4a. {{(pid=87378) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 10 13:01:13 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[05115fb8-4503-4159-b655-b16a92c6af24]: (4, 'raw') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:01:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b822bc03-487d-4aa6-a050-4fbd32aaf056_mh_8xcfu {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:14 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 1.007s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:14 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:01:14 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager._thread_info {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 13:01:14 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread count: 28 {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 10 13:01:14 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread info: [<_MainThread(MainThread, started 128233544536192)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128233445424704)>, <Thread(Thread-3 (stat_writer), started daemon 128233435118528)>, <Thread(Rabbit-heartbeat, started daemon 128233435718016)>, <Thread(Thread-5 (_runner), started daemon 128233432624448)>, <Thread(Thread-7 (_runner), started daemon 128233432674688)>, <Thread(fd_logger, started daemon 128233428569472)>, <Thread(privsep_reader, started daemon 128233429417088)>, <Thread(tpool_thread_0, started daemon 128233421182656)>, <Thread(tpool_thread_1, started daemon 128233412789952)>, <Thread(tpool_thread_2, started daemon 128233404397248)>, <Thread(tpool_thread_3, started daemon 128233396004544)>, <Thread(tpool_thread_4, started daemon 128233387611840)>, <Thread(tpool_thread_5, started daemon 128233379219136)>, <Thread(tpool_thread_6, started daemon 128233370826432)>, <Thread(tpool_thread_7, started daemon 128233362433728)>, <Thread(tpool_thread_8, started daemon 128233354041024)>, <Thread(tpool_thread_9, started daemon 128233345631936)>, <Thread(tpool_thread_10, started daemon 128233337222848)>, <Thread(tpool_thread_11, started daemon 128233328813760)>, <Thread(tpool_thread_12, started daemon 128233320404672)>, <Thread(tpool_thread_13, started daemon 128233311995584)>, <Thread(tpool_thread_14, started daemon 128233303586496)>, <Thread(tpool_thread_15, started daemon 128233295177408)>, <Thread(tpool_thread_16, started daemon 128233286768320)>, <Thread(tpool_thread_17, started daemon 128233278359232)>, <Thread(tpool_thread_18, started daemon 128233269950144)>, <Thread(tpool_thread_19, started daemon 128233261541056)>] {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 10 13:01:14 devstack sudo[106394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b822bc03-487d-4aa6-a050-4fbd32aaf056_mh_8xcfu
Jul 10 13:01:14 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:14 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-645b6a44-478b-4eb0-84fb-cbf4d428dac5 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b9642ab4-fac2-4adf-8f8f-e5f69d079bee" returned: 1 in 0.935s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-645b6a44-478b-4eb0-84fb-cbf4d428dac5 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b9642ab4-fac2-4adf-8f8f-e5f69d079bee' failed. Not Retrying. {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 10 13:01:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-645b6a44-478b-4eb0-84fb-cbf4d428dac5 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b9642ab4-fac2-4adf-8f8f-e5f69d079bee {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:14 devstack sudo[106401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b9642ab4-fac2-4adf-8f8f-e5f69d079bee
Jul 10 13:01:14 devstack sudo[106401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:14 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-38151069-939e-4c0f-9946-fd7fae9cd852 tempest-VolumeDependencyTests-267861649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b" returned: 0 in 1.014s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-38151069-939e-4c0f-9946-fd7fae9cd852 tempest-VolumeDependencyTests-267861649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b.72cca1ab-a75e-4d44-aa24-ed57705d68cd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:14 devstack sudo[106404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b.72cca1ab-a75e-4d44-aa24-ed57705d68cd
Jul 10 13:01:14 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:14 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b822bc03-487d-4aa6-a050-4fbd32aaf056_mh_8xcfu" returned: 0 in 0.906s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b822bc03-487d-4aa6-a050-4fbd32aaf056_mh_8xcfu {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:14 devstack sudo[106408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b822bc03-487d-4aa6-a050-4fbd32aaf056_mh_8xcfu
Jul 10 13:01:14 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:15 devstack sudo[106401]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-645b6a44-478b-4eb0-84fb-cbf4d428dac5 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-b9642ab4-fac2-4adf-8f8f-e5f69d079bee" returned: 0 in 0.820s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:15 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-645b6a44-478b-4eb0-84fb-cbf4d428dac5 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Lock "cinder-quobyte-b9642ab4-fac2-4adf-8f8f-e5f69d079bee" released by "delete_volume" :: held 2.825s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:01:15 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-645b6a44-478b-4eb0-84fb-cbf4d428dac5 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Created reservations ['6a1c5d9a-e733-447e-8d31-8db0229a3a2f', '3ee26456-1f26-43c8-be5f-afd5488b8056', '09b4f33f-df7a-4f6d-b68b-f2b636107db5', '0e3d36ab-2411-456b-9904-d6ae6c8d8118'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:01:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-645b6a44-478b-4eb0-84fb-cbf4d428dac5 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:01:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-645b6a44-478b-4eb0-84fb-cbf4d428dac5 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:01:15 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-645b6a44-478b-4eb0-84fb-cbf4d428dac5 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:01:15 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-645b6a44-478b-4eb0-84fb-cbf4d428dac5 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:01:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-645b6a44-478b-4eb0-84fb-cbf4d428dac5 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:01:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-645b6a44-478b-4eb0-84fb-cbf4d428dac5 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:15 devstack sudo[106414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:01:15 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:15 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-38151069-939e-4c0f-9946-fd7fae9cd852 tempest-VolumeDependencyTests-267861649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b.72cca1ab-a75e-4d44-aa24-ed57705d68cd" returned: 0 in 0.928s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-38151069-939e-4c0f-9946-fd7fae9cd852 tempest-VolumeDependencyTests-267861649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b.72cca1ab-a75e-4d44-aa24-ed57705d68cd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:15 devstack sudo[106416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b.72cca1ab-a75e-4d44-aa24-ed57705d68cd
Jul 10 13:01:15 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:15 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b822bc03-487d-4aa6-a050-4fbd32aaf056_mh_8xcfu" returned: 1 in 0.981s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b822bc03-487d-4aa6-a050-4fbd32aaf056_mh_8xcfu' failed. Not Retrying. {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 10 13:01:15 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[829440bd-dd46-4212-9455-b4f4c5b97787]: (4, 'raw') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:01:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b822bc03-487d-4aa6-a050-4fbd32aaf056_gyec84pzdevstack@QuobyteHD {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:16 devstack sudo[106420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b822bc03-487d-4aa6-a050-4fbd32aaf056_gyec84pzdevstack@QuobyteHD
Jul 10 13:01:16 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:16 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-645b6a44-478b-4eb0-84fb-cbf4d428dac5 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.849s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:16 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-645b6a44-478b-4eb0-84fb-cbf4d428dac5 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:01:16 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-645b6a44-478b-4eb0-84fb-cbf4d428dac5 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Deleted volume successfully.
Jul 10 13:01:16 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-645b6a44-478b-4eb0-84fb-cbf4d428dac5 tempest-VolumeAndVolumeTypeFromImageTest-2062084970 None] Lock "cinder-b9642ab4-fac2-4adf-8f8f-e5f69d079bee-delete_volume" released by "delete_volume" :: held 4.062s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:01:16 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-38151069-939e-4c0f-9946-fd7fae9cd852 tempest-VolumeDependencyTests-267861649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b.72cca1ab-a75e-4d44-aa24-ed57705d68cd" returned: 0 in 0.814s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:16 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-38151069-939e-4c0f-9946-fd7fae9cd852 tempest-VolumeDependencyTests-267861649 None] Lock "cinder-quobyte-72cca1ab-a75e-4d44-aa24-ed57705d68cd" released by "_delete_snapshot" :: held 4.092s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:01:16 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-38151069-939e-4c0f-9946-fd7fae9cd852 tempest-VolumeDependencyTests-267861649 None] Lock "cinder-quobyte-0bc213eb-0dd0-47cc-b32e-58cf28aee65b" released by "delete_snapshot" :: held 4.132s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:01:16 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-38151069-939e-4c0f-9946-fd7fae9cd852 tempest-VolumeDependencyTests-267861649 None] Created reservations ['d3f8cdd8-9510-4350-9c61-153f6b471522', '77d1adb9-31d2-412d-ba0f-80f7b4cffd62', 'f46dd1a0-ba6a-4ced-a170-973dfd576162', '12bfb10c-b093-4f6e-a459-47a6d222db03'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:01:16 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-38151069-939e-4c0f-9946-fd7fae9cd852 tempest-VolumeDependencyTests-267861649 None] Delete snapshot completed successfully.
Jul 10 13:01:16 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-38151069-939e-4c0f-9946-fd7fae9cd852 tempest-VolumeDependencyTests-267861649 None] Lock "cinder-72cca1ab-a75e-4d44-aa24-ed57705d68cd-delete_snapshot" released by "delete_snapshot" :: held 4.301s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:01:16 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b822bc03-487d-4aa6-a050-4fbd32aaf056_gyec84pzdevstack@QuobyteHD" returned: 0 in 0.997s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b822bc03-487d-4aa6-a050-4fbd32aaf056_gyec84pzdevstack@QuobyteHD {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:16 devstack sudo[106426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b822bc03-487d-4aa6-a050-4fbd32aaf056_gyec84pzdevstack@QuobyteHD
Jul 10 13:01:16 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:17 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-21c29849-15e4-485f-8287-3efc66a028ee tempest-VolumeDependencyTests-267861649 None] Acquiring lock "cinder-0bc213eb-0dd0-47cc-b32e-58cf28aee65b-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:01:17 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-21c29849-15e4-485f-8287-3efc66a028ee tempest-VolumeDependencyTests-267861649 None] Lock "cinder-0bc213eb-0dd0-47cc-b32e-58cf28aee65b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:01:17 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b822bc03-487d-4aa6-a050-4fbd32aaf056_gyec84pzdevstack@QuobyteHD" returned: 1 in 0.819s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b822bc03-487d-4aa6-a050-4fbd32aaf056_gyec84pzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 10 13:01:17 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] b822bc03-487d-4aa6-a050-4fbd32aaf056 was raw, converting to raw {{(pid=87378) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 10 13:01:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b822bc03-487d-4aa6-a050-4fbd32aaf056_gyec84pzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2af04ef9-435b-4025-8ff5-be4571c09a4a {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:17 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-21c29849-15e4-485f-8287-3efc66a028ee tempest-VolumeDependencyTests-267861649 None] Acquiring lock "cinder-quobyte-0bc213eb-0dd0-47cc-b32e-58cf28aee65b" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:01:17 devstack sudo[106431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b822bc03-487d-4aa6-a050-4fbd32aaf056_gyec84pzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2af04ef9-435b-4025-8ff5-be4571c09a4a
Jul 10 13:01:17 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:17 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-21c29849-15e4-485f-8287-3efc66a028ee tempest-VolumeDependencyTests-267861649 None] Lock "cinder-quobyte-0bc213eb-0dd0-47cc-b32e-58cf28aee65b" acquired by "delete_volume" :: waited 0.029s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:01:17 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbec755-d6c9-4b96-a5e9-5e8f88181b7e]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:01:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-21c29849-15e4-485f-8287-3efc66a028ee tempest-VolumeDependencyTests-267861649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:17 devstack sudo[106433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b
Jul 10 13:01:17 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:18 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b822bc03-487d-4aa6-a050-4fbd32aaf056_gyec84pzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2af04ef9-435b-4025-8ff5-be4571c09a4a" returned: 0 in 1.038s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:18 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b822bc03-487d-4aa6-a050-4fbd32aaf056_gyec84pzdevstack@QuobyteHD, size 0.00 MB, duration 1.04 sec, destination /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2af04ef9-435b-4025-8ff5-be4571c09a4a {{(pid=87378) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 10 13:01:18 devstack cinder-volume[87378]: INFO cinder.image.image_utils [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Converted 0.00 MB image at 0.00 MB/s
Jul 10 13:01:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2af04ef9-435b-4025-8ff5-be4571c09a4a 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:18 devstack sudo[106442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2af04ef9-435b-4025-8ff5-be4571c09a4a 1G
Jul 10 13:01:18 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:18 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-21c29849-15e4-485f-8287-3efc66a028ee tempest-VolumeDependencyTests-267861649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b" returned: 0 in 0.994s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-21c29849-15e4-485f-8287-3efc66a028ee tempest-VolumeDependencyTests-267861649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:18 devstack sudo[106444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b
Jul 10 13:01:18 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:19 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-21c29849-15e4-485f-8287-3efc66a028ee tempest-VolumeDependencyTests-267861649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-0bc213eb-0dd0-47cc-b32e-58cf28aee65b" returned: 0 in 0.716s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:19 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2af04ef9-435b-4025-8ff5-be4571c09a4a 1G" returned: 0 in 0.788s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:19 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-21c29849-15e4-485f-8287-3efc66a028ee tempest-VolumeDependencyTests-267861649 None] Lock "cinder-quobyte-0bc213eb-0dd0-47cc-b32e-58cf28aee65b" released by "delete_volume" :: held 1.793s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:01:19 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a9a11a-97d7-45fd-ac02-3474e92344b7]: (4, 'raw') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:01:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2af04ef9-435b-4025-8ff5-be4571c09a4a {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:19 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-21c29849-15e4-485f-8287-3efc66a028ee tempest-VolumeDependencyTests-267861649 None] Created reservations ['38b77981-d2ee-4e3d-a13b-5500cb897d73', '6b78d455-89dd-47e5-86b2-097ef2830731', '3dcf449f-eee2-4672-adf3-abb4a76954ca', 'b6d23094-4321-45e4-966c-8ed6a8704cb0'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:01:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-21c29849-15e4-485f-8287-3efc66a028ee tempest-VolumeDependencyTests-267861649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:01:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-21c29849-15e4-485f-8287-3efc66a028ee tempest-VolumeDependencyTests-267861649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:01:19 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-21c29849-15e4-485f-8287-3efc66a028ee tempest-VolumeDependencyTests-267861649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:01:19 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-21c29849-15e4-485f-8287-3efc66a028ee tempest-VolumeDependencyTests-267861649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:01:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-21c29849-15e4-485f-8287-3efc66a028ee tempest-VolumeDependencyTests-267861649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:01:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-21c29849-15e4-485f-8287-3efc66a028ee tempest-VolumeDependencyTests-267861649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:19 devstack sudo[106451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2af04ef9-435b-4025-8ff5-be4571c09a4a
Jul 10 13:01:19 devstack sudo[106451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:19 devstack sudo[106453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:01:19 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:19 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3b046da4-5a9c-4ca7-8d96-97fe1f1d0427 tempest-VolumeDependencyTests-267861649 None] Acquiring lock "cinder-3f47e067-d841-4714-aafe-6df87914d292-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:01:19 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3b046da4-5a9c-4ca7-8d96-97fe1f1d0427 tempest-VolumeDependencyTests-267861649 None] Lock "cinder-3f47e067-d841-4714-aafe-6df87914d292-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:01:20 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3b046da4-5a9c-4ca7-8d96-97fe1f1d0427 tempest-VolumeDependencyTests-267861649 None] Acquiring lock "cinder-quobyte-3f47e067-d841-4714-aafe-6df87914d292" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:01:20 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3b046da4-5a9c-4ca7-8d96-97fe1f1d0427 tempest-VolumeDependencyTests-267861649 None] Lock "cinder-quobyte-3f47e067-d841-4714-aafe-6df87914d292" acquired by "delete_volume" :: waited 0.068s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:01:20 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c46faa8-6ac0-4931-ba65-b9380982d7e5]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:01:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3b046da4-5a9c-4ca7-8d96-97fe1f1d0427 tempest-VolumeDependencyTests-267861649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3f47e067-d841-4714-aafe-6df87914d292 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:20 devstack sudo[106455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3f47e067-d841-4714-aafe-6df87914d292
Jul 10 13:01:20 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:20 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-21c29849-15e4-485f-8287-3efc66a028ee tempest-VolumeDependencyTests-267861649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.830s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:20 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-21c29849-15e4-485f-8287-3efc66a028ee tempest-VolumeDependencyTests-267861649 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:01:20 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-21c29849-15e4-485f-8287-3efc66a028ee tempest-VolumeDependencyTests-267861649 None] Deleted volume successfully.
Jul 10 13:01:20 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-21c29849-15e4-485f-8287-3efc66a028ee tempest-VolumeDependencyTests-267861649 None] Lock "cinder-0bc213eb-0dd0-47cc-b32e-58cf28aee65b-delete_volume" released by "delete_volume" :: held 2.964s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:01:20 devstack sudo[106451]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2af04ef9-435b-4025-8ff5-be4571c09a4a" returned: 0 in 1.123s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2af04ef9-435b-4025-8ff5-be4571c09a4a {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:20 devstack sudo[106460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2af04ef9-435b-4025-8ff5-be4571c09a4a
Jul 10 13:01:20 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:21 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3b046da4-5a9c-4ca7-8d96-97fe1f1d0427 tempest-VolumeDependencyTests-267861649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3f47e067-d841-4714-aafe-6df87914d292" returned: 0 in 0.919s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3b046da4-5a9c-4ca7-8d96-97fe1f1d0427 tempest-VolumeDependencyTests-267861649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3f47e067-d841-4714-aafe-6df87914d292 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:21 devstack sudo[106466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3f47e067-d841-4714-aafe-6df87914d292
Jul 10 13:01:21 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:21 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5e82aa8-65fe-4a1d-a986-c871f00bb85d tempest-CreateVolumesFromSnapshotTest-150382642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 13:01:21 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d5e82aa8-65fe-4a1d-a986-c871f00bb85d tempest-CreateVolumesFromSnapshotTest-150382642 None] Flow 'volume_create_manager' (1cc0a8f7-1999-4e9c-8616-bad667330b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:01:21 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d5e82aa8-65fe-4a1d-a986-c871f00bb85d tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb8ed080-8249-42b9-9604-38a65076a6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:21 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d5e82aa8-65fe-4a1d-a986-c871f00bb85d tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb8ed080-8249-42b9-9604-38a65076a6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-843679296',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1cad374-d781-49ce-826f-8f2ce5c6e08d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36dd55e6e5424501bb898fff48c2de7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:01:21Z,use_quota=True,user_id='e9848d08eaca40c9bab9da37596a97ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:21 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d5e82aa8-65fe-4a1d-a986-c871f00bb85d tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e197bb4c-3539-4aa0-84d7-6932fbb57328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:21 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d5e82aa8-65fe-4a1d-a986-c871f00bb85d tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e197bb4c-3539-4aa0-84d7-6932fbb57328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:21 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d5e82aa8-65fe-4a1d-a986-c871f00bb85d tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb2f90b2-a5ed-4ed0-9a63-33e4353e458a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:21 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d5e82aa8-65fe-4a1d-a986-c871f00bb85d tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb2f90b2-a5ed-4ed0-9a63-33e4353e458a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1cad374-d781-49ce-826f-8f2ce5c6e08d', 'volume_name': 'volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:21 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d5e82aa8-65fe-4a1d-a986-c871f00bb85d tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9a4daf7-a945-4837-9045-8ea7c62ec7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:21 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d5e82aa8-65fe-4a1d-a986-c871f00bb85d tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9a4daf7-a945-4837-9045-8ea7c62ec7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:21 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d5e82aa8-65fe-4a1d-a986-c871f00bb85d tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dba594e6-4d5c-48a4-88ec-56640f76c054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:21 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-d5e82aa8-65fe-4a1d-a986-c871f00bb85d tempest-CreateVolumesFromSnapshotTest-150382642 None] Volume e1cad374-d781-49ce-826f-8f2ce5c6e08d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d', 'volume_size': 1}
Jul 10 13:01:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d5e82aa8-65fe-4a1d-a986-c871f00bb85d tempest-CreateVolumesFromSnapshotTest-150382642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:01:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d5e82aa8-65fe-4a1d-a986-c871f00bb85d tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:01:21 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-d5e82aa8-65fe-4a1d-a986-c871f00bb85d tempest-CreateVolumesFromSnapshotTest-150382642 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-843679296',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1cad374-d781-49ce-826f-8f2ce5c6e08d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36dd55e6e5424501bb898fff48c2de7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:01:21Z,use_quota=True,user_id='e9848d08eaca40c9bab9da37596a97ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 13:01:21 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-d5e82aa8-65fe-4a1d-a986-c871f00bb85d tempest-CreateVolumesFromSnapshotTest-150382642 None] Creating volume e1cad374-d781-49ce-826f-8f2ce5c6e08d {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 13:01:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d5e82aa8-65fe-4a1d-a986-c871f00bb85d tempest-CreateVolumesFromSnapshotTest-150382642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:01:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d5e82aa8-65fe-4a1d-a986-c871f00bb85d tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:01:21 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-d5e82aa8-65fe-4a1d-a986-c871f00bb85d tempest-CreateVolumesFromSnapshotTest-150382642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:01:21 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-d5e82aa8-65fe-4a1d-a986-c871f00bb85d tempest-CreateVolumesFromSnapshotTest-150382642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:01:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d5e82aa8-65fe-4a1d-a986-c871f00bb85d tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:01:21 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-d5e82aa8-65fe-4a1d-a986-c871f00bb85d tempest-CreateVolumesFromSnapshotTest-150382642 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 13:01:21 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-d5e82aa8-65fe-4a1d-a986-c871f00bb85d tempest-CreateVolumesFromSnapshotTest-150382642 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 13:01:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d5e82aa8-65fe-4a1d-a986-c871f00bb85d tempest-CreateVolumesFromSnapshotTest-150382642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:21 devstack sudo[106471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d 1073741824
Jul 10 13:01:21 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:21 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2af04ef9-435b-4025-8ff5-be4571c09a4a" returned: 1 in 0.953s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2af04ef9-435b-4025-8ff5-be4571c09a4a' failed. Not Retrying. {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 10 13:01:21 devstack cinder-volume[87378]: DEBUG cinder.volume.volume_utils [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Downloaded image b822bc03-487d-4aa6-a050-4fbd32aaf056 ((None, [{'url': 'file:///opt/stack/data/glance/images/b822bc03-487d-4aa6-a050-4fbd32aaf056', 'metadata': {}}])) to volume 2af04ef9-435b-4025-8ff5-be4571c09a4a successfully. {{(pid=87378) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 10 13:01:21 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Temporary image b822bc03-487d-4aa6-a050-4fbd32aaf056 for user 62d04b526dfe46929897dbf2e1bc7543 is deleted. {{(pid=87378) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 10 13:01:21 devstack cinder-volume[87378]: DEBUG cinder.volume.volume_utils [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Marking volume 2af04ef9-435b-4025-8ff5-be4571c09a4a as bootable. {{(pid=87378) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 10 13:01:21 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Copying metadata from image b822bc03-487d-4aa6-a050-4fbd32aaf056 to 2af04ef9-435b-4025-8ff5-be4571c09a4a. {{(pid=87378) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 10 13:01:21 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Creating volume glance metadata for volume 2af04ef9-435b-4025-8ff5-be4571c09a4a backed by image b822bc03-487d-4aa6-a050-4fbd32aaf056 with: {'image_id': 'b822bc03-487d-4aa6-a050-4fbd32aaf056', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '9cb0e2819961375a28d689b1f213a396', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87378) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 10 13:01:21 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56ae9874-ac43-4dda-a5c0-3f3b8c18dcc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2af04ef9-435b-4025-8ff5-be4571c09a4a', 'volume_size': 1, 'image_id': 'b822bc03-487d-4aa6-a050-4fbd32aaf056', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b822bc03-487d-4aa6-a050-4fbd32aaf056', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9cb0e2819961375a28d689b1f213a396', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '633f6ab35c5343bd87cd81bff95b4c8d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'feb711d441847d6c8b022ce3381773fffc1afa127a34413a27808cc6503c5d8b58654f45e74cef4648a31a94e8d3cee913399636321b453875c3eb7834798ba3', 'id': 'b822bc03-487d-4aa6-a050-4fbd32aaf056', 'created_at': datetime.datetime(2026, 7, 10, 11, 1, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 11, 1, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b822bc03-487d-4aa6-a050-4fbd32aaf056/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74a0a1765bb0>}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:21 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00fafb9e-6ce7-457c-b94d-fee0fb810857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:21 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Volume volume-2af04ef9-435b-4025-8ff5-be4571c09a4a (2af04ef9-435b-4025-8ff5-be4571c09a4a): created successfully
Jul 10 13:01:21 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00fafb9e-6ce7-457c-b94d-fee0fb810857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:21 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Flow 'volume_create_manager' (eda6e3ea-4b41-4d91-a0e9-fe413992a9dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:01:21 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-67012f3e-0b88-4620-9eec-4b5691718263 tempest-VolumeImageDependencyTests-135235759 None] Created volume successfully.
Jul 10 13:01:21 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3b046da4-5a9c-4ca7-8d96-97fe1f1d0427 tempest-VolumeDependencyTests-267861649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3f47e067-d841-4714-aafe-6df87914d292" returned: 0 in 0.702s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:21 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3b046da4-5a9c-4ca7-8d96-97fe1f1d0427 tempest-VolumeDependencyTests-267861649 None] Lock "cinder-quobyte-3f47e067-d841-4714-aafe-6df87914d292" released by "delete_volume" :: held 1.698s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:01:21 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-3b046da4-5a9c-4ca7-8d96-97fe1f1d0427 tempest-VolumeDependencyTests-267861649 None] Created reservations ['d77d7e2d-8cc2-4926-a602-feeefefccf07', 'd7244f11-3513-4e02-bdb0-085e2b66a617', '87e61e99-8858-442a-8dfd-8a150c06ee62', '54b82a98-7d3a-4386-bac1-639988390b98'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:01:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3b046da4-5a9c-4ca7-8d96-97fe1f1d0427 tempest-VolumeDependencyTests-267861649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:01:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3b046da4-5a9c-4ca7-8d96-97fe1f1d0427 tempest-VolumeDependencyTests-267861649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:01:21 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3b046da4-5a9c-4ca7-8d96-97fe1f1d0427 tempest-VolumeDependencyTests-267861649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:01:21 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3b046da4-5a9c-4ca7-8d96-97fe1f1d0427 tempest-VolumeDependencyTests-267861649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:01:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3b046da4-5a9c-4ca7-8d96-97fe1f1d0427 tempest-VolumeDependencyTests-267861649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:01:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3b046da4-5a9c-4ca7-8d96-97fe1f1d0427 tempest-VolumeDependencyTests-267861649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:21 devstack sudo[106474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:01:21 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:22 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-6fcc2ad5-e3d8-4bc2-b58f-f5ec034088f6 tempest-VolumeImageDependencyTests-135235759 None] Acquiring lock "cinder-2af04ef9-435b-4025-8ff5-be4571c09a4a-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:01:22 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-6fcc2ad5-e3d8-4bc2-b58f-f5ec034088f6 tempest-VolumeImageDependencyTests-135235759 None] Lock "cinder-2af04ef9-435b-4025-8ff5-be4571c09a4a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:01:22 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d5e82aa8-65fe-4a1d-a986-c871f00bb85d tempest-CreateVolumesFromSnapshotTest-150382642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d 1073741824" returned: 0 in 1.097s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:22 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-6fcc2ad5-e3d8-4bc2-b58f-f5ec034088f6 tempest-VolumeImageDependencyTests-135235759 None] Acquiring lock "cinder-quobyte-2af04ef9-435b-4025-8ff5-be4571c09a4a" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:01:22 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-6fcc2ad5-e3d8-4bc2-b58f-f5ec034088f6 tempest-VolumeImageDependencyTests-135235759 None] Lock "cinder-quobyte-2af04ef9-435b-4025-8ff5-be4571c09a4a" acquired by "delete_volume" :: waited 0.026s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:01:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d5e82aa8-65fe-4a1d-a986-c871f00bb85d tempest-CreateVolumesFromSnapshotTest-150382642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:22 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3b046da4-5a9c-4ca7-8d96-97fe1f1d0427 tempest-VolumeDependencyTests-267861649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.843s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:22 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-3b046da4-5a9c-4ca7-8d96-97fe1f1d0427 tempest-VolumeDependencyTests-267861649 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:01:22 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23e29d8-9ffe-4278-8ecb-42ca59b98550]: (4, 'raw') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:01:22 devstack sudo[106481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d
Jul 10 13:01:22 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6fcc2ad5-e3d8-4bc2-b58f-f5ec034088f6 tempest-VolumeImageDependencyTests-135235759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2af04ef9-435b-4025-8ff5-be4571c09a4a {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:22 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-3b046da4-5a9c-4ca7-8d96-97fe1f1d0427 tempest-VolumeDependencyTests-267861649 None] Deleted volume successfully.
Jul 10 13:01:22 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3b046da4-5a9c-4ca7-8d96-97fe1f1d0427 tempest-VolumeDependencyTests-267861649 None] Lock "cinder-3f47e067-d841-4714-aafe-6df87914d292-delete_volume" released by "delete_volume" :: held 2.851s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:01:22 devstack sudo[106483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2af04ef9-435b-4025-8ff5-be4571c09a4a
Jul 10 13:01:22 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:23 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d5e82aa8-65fe-4a1d-a986-c871f00bb85d tempest-CreateVolumesFromSnapshotTest-150382642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d" returned: 0 in 0.820s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:23 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-d5e82aa8-65fe-4a1d-a986-c871f00bb85d tempest-CreateVolumesFromSnapshotTest-150382642 None] <== create_volume: return (2014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 13:01:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d5e82aa8-65fe-4a1d-a986-c871f00bb85d tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.017s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:01:23 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d5e82aa8-65fe-4a1d-a986-c871f00bb85d tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dba594e6-4d5c-48a4-88ec-56640f76c054) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:23 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d5e82aa8-65fe-4a1d-a986-c871f00bb85d tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c6e5958-2b5e-46c4-9237-14effe1fd39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:23 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-d5e82aa8-65fe-4a1d-a986-c871f00bb85d tempest-CreateVolumesFromSnapshotTest-150382642 None] Volume volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d (e1cad374-d781-49ce-826f-8f2ce5c6e08d): created successfully
Jul 10 13:01:23 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d5e82aa8-65fe-4a1d-a986-c871f00bb85d tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c6e5958-2b5e-46c4-9237-14effe1fd39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:23 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d5e82aa8-65fe-4a1d-a986-c871f00bb85d tempest-CreateVolumesFromSnapshotTest-150382642 None] Flow 'volume_create_manager' (1cc0a8f7-1999-4e9c-8616-bad667330b34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:01:23 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-d5e82aa8-65fe-4a1d-a986-c871f00bb85d tempest-CreateVolumesFromSnapshotTest-150382642 None] Created volume successfully.
Jul 10 13:01:23 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6fcc2ad5-e3d8-4bc2-b58f-f5ec034088f6 tempest-VolumeImageDependencyTests-135235759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2af04ef9-435b-4025-8ff5-be4571c09a4a" returned: 0 in 0.916s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6fcc2ad5-e3d8-4bc2-b58f-f5ec034088f6 tempest-VolumeImageDependencyTests-135235759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2af04ef9-435b-4025-8ff5-be4571c09a4a {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:23 devstack sudo[106488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2af04ef9-435b-4025-8ff5-be4571c09a4a
Jul 10 13:01:23 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:24 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6fcc2ad5-e3d8-4bc2-b58f-f5ec034088f6 tempest-VolumeImageDependencyTests-135235759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2af04ef9-435b-4025-8ff5-be4571c09a4a" returned: 1 in 0.836s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6fcc2ad5-e3d8-4bc2-b58f-f5ec034088f6 tempest-VolumeImageDependencyTests-135235759 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2af04ef9-435b-4025-8ff5-be4571c09a4a' failed. Not Retrying. {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 10 13:01:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6fcc2ad5-e3d8-4bc2-b58f-f5ec034088f6 tempest-VolumeImageDependencyTests-135235759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2af04ef9-435b-4025-8ff5-be4571c09a4a {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:24 devstack sudo[106493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2af04ef9-435b-4025-8ff5-be4571c09a4a
Jul 10 13:01:24 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-28870038-5109-467a-ad43-e69bcc8d2384 tempest-CreateVolumesFromSnapshotTest-150382642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:01:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-28870038-5109-467a-ad43-e69bcc8d2384 tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:01:24 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-28870038-5109-467a-ad43-e69bcc8d2384 tempest-CreateVolumesFromSnapshotTest-150382642 None] Creating offline snapshot c91ad715-c3db-4d99-bfeb-1e9bb83ecac8 of volume e1cad374-d781-49ce-826f-8f2ce5c6e08d {{(pid=87378) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 10 13:01:24 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[76aac37b-5b67-4595-88e5-37955bb19296]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:01:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-28870038-5109-467a-ad43-e69bcc8d2384 tempest-CreateVolumesFromSnapshotTest-150382642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:25 devstack sudo[106495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d
Jul 10 13:01:25 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:25 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6fcc2ad5-e3d8-4bc2-b58f-f5ec034088f6 tempest-VolumeImageDependencyTests-135235759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2af04ef9-435b-4025-8ff5-be4571c09a4a" returned: 0 in 0.775s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:25 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-6fcc2ad5-e3d8-4bc2-b58f-f5ec034088f6 tempest-VolumeImageDependencyTests-135235759 None] Lock "cinder-quobyte-2af04ef9-435b-4025-8ff5-be4571c09a4a" released by "delete_volume" :: held 2.625s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:01:25 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-6fcc2ad5-e3d8-4bc2-b58f-f5ec034088f6 tempest-VolumeImageDependencyTests-135235759 None] Created reservations ['623a4558-fd10-4b6f-b694-5fd5a6972599', '269b7127-0eb4-4e19-81f9-8cff1f0c8af3', 'ebaac6e3-28b4-4a09-9dc6-a68f24f7ddc6', '9de28057-e83e-492d-956a-1ac4e8a78379'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:01:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-6fcc2ad5-e3d8-4bc2-b58f-f5ec034088f6 tempest-VolumeImageDependencyTests-135235759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:01:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-6fcc2ad5-e3d8-4bc2-b58f-f5ec034088f6 tempest-VolumeImageDependencyTests-135235759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:01:25 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-6fcc2ad5-e3d8-4bc2-b58f-f5ec034088f6 tempest-VolumeImageDependencyTests-135235759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:01:25 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-6fcc2ad5-e3d8-4bc2-b58f-f5ec034088f6 tempest-VolumeImageDependencyTests-135235759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:01:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-6fcc2ad5-e3d8-4bc2-b58f-f5ec034088f6 tempest-VolumeImageDependencyTests-135235759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:01:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6fcc2ad5-e3d8-4bc2-b58f-f5ec034088f6 tempest-VolumeImageDependencyTests-135235759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:25 devstack sudo[106498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:01:25 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:25 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-28870038-5109-467a-ad43-e69bcc8d2384 tempest-CreateVolumesFromSnapshotTest-150382642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d" returned: 0 in 0.981s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-28870038-5109-467a-ad43-e69bcc8d2384 tempest-CreateVolumesFromSnapshotTest-150382642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d.c91ad715-c3db-4d99-bfeb-1e9bb83ecac8 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:25 devstack sudo[106503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d.c91ad715-c3db-4d99-bfeb-1e9bb83ecac8 1G
Jul 10 13:01:25 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:26 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6fcc2ad5-e3d8-4bc2-b58f-f5ec034088f6 tempest-VolumeImageDependencyTests-135235759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.955s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:26 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-6fcc2ad5-e3d8-4bc2-b58f-f5ec034088f6 tempest-VolumeImageDependencyTests-135235759 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:01:26 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-6fcc2ad5-e3d8-4bc2-b58f-f5ec034088f6 tempest-VolumeImageDependencyTests-135235759 None] Deleted volume successfully.
Jul 10 13:01:26 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-6fcc2ad5-e3d8-4bc2-b58f-f5ec034088f6 tempest-VolumeImageDependencyTests-135235759 None] Lock "cinder-2af04ef9-435b-4025-8ff5-be4571c09a4a-delete_volume" released by "delete_volume" :: held 3.911s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:01:26 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-28870038-5109-467a-ad43-e69bcc8d2384 tempest-CreateVolumesFromSnapshotTest-150382642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d.c91ad715-c3db-4d99-bfeb-1e9bb83ecac8 1G" returned: 0 in 1.060s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-28870038-5109-467a-ad43-e69bcc8d2384 tempest-CreateVolumesFromSnapshotTest-150382642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d.c91ad715-c3db-4d99-bfeb-1e9bb83ecac8 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:27 devstack sudo[106511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d.c91ad715-c3db-4d99-bfeb-1e9bb83ecac8
Jul 10 13:01:27 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:27 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-28870038-5109-467a-ad43-e69bcc8d2384 tempest-CreateVolumesFromSnapshotTest-150382642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d.c91ad715-c3db-4d99-bfeb-1e9bb83ecac8" returned: 0 in 0.838s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:27 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-28870038-5109-467a-ad43-e69bcc8d2384 tempest-CreateVolumesFromSnapshotTest-150382642 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d.c91ad715-c3db-4d99-bfeb-1e9bb83ecac8 is being set with open permissions: ugo+rw
Jul 10 13:01:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-28870038-5109-467a-ad43-e69bcc8d2384 tempest-CreateVolumesFromSnapshotTest-150382642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d.c91ad715-c3db-4d99-bfeb-1e9bb83ecac8 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:27 devstack sudo[106516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d.c91ad715-c3db-4d99-bfeb-1e9bb83ecac8
Jul 10 13:01:27 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:28 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-28870038-5109-467a-ad43-e69bcc8d2384 tempest-CreateVolumesFromSnapshotTest-150382642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d.c91ad715-c3db-4d99-bfeb-1e9bb83ecac8" returned: 0 in 0.931s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-28870038-5109-467a-ad43-e69bcc8d2384 tempest-CreateVolumesFromSnapshotTest-150382642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:28 devstack sudo[106555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d.info
Jul 10 13:01:28 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:29 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-28870038-5109-467a-ad43-e69bcc8d2384 tempest-CreateVolumesFromSnapshotTest-150382642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d.info" returned: 0 in 0.874s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:29 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-28870038-5109-467a-ad43-e69bcc8d2384 tempest-CreateVolumesFromSnapshotTest-150382642 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d.info is being set with open permissions: ugo+rw
Jul 10 13:01:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-28870038-5109-467a-ad43-e69bcc8d2384 tempest-CreateVolumesFromSnapshotTest-150382642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:29 devstack sudo[106559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d.info
Jul 10 13:01:29 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:30 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:30 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-28870038-5109-467a-ad43-e69bcc8d2384 tempest-CreateVolumesFromSnapshotTest-150382642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d.info" returned: 0 in 0.876s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:30 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-28870038-5109-467a-ad43-e69bcc8d2384 tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.674s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:01:30 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-28870038-5109-467a-ad43-e69bcc8d2384 tempest-CreateVolumesFromSnapshotTest-150382642 None] Create snapshot completed successfully
Jul 10 13:01:31 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c1dd574d-62ac-46d8-a785-95c9eb4cf59d tempest-ProjectAdminTests-895444352 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.750259399414, 'free_capacity_gb': 1775.750259399414, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87378) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 10 13:01:31 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:UPDATE=170,cinder:SELECT=137,cinder:INSERT=46,cinder:DELETE=15 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 13:01:31 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:SELECT=127,cinder:UPDATE=188,cinder:INSERT=54,cinder:DELETE=18 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 13:01:32 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5a7d784-62e0-4c19-b414-4cea49b81dc3 tempest-CreateVolumesFromSnapshotTest-150382642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 13:01:32 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d5a7d784-62e0-4c19-b414-4cea49b81dc3 tempest-CreateVolumesFromSnapshotTest-150382642 None] Flow 'volume_create_manager' (0399bcb8-83fa-4017-9627-05d516c78d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:01:32 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d5a7d784-62e0-4c19-b414-4cea49b81dc3 tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3410da20-62cf-4b89-8283-c0d025b2c0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:32 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d5a7d784-62e0-4c19-b414-4cea49b81dc3 tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3410da20-62cf-4b89-8283-c0d025b2c0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:01:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1984829275',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=427e3b87-b55a-4687-ab0d-8ea3e7c37fb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36dd55e6e5424501bb898fff48c2de7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:01:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:01:32Z,use_quota=True,user_id='e9848d08eaca40c9bab9da37596a97ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:32 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d5a7d784-62e0-4c19-b414-4cea49b81dc3 tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f954f23-8a65-4d6e-bb34-08ec3e685654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:32 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d5a7d784-62e0-4c19-b414-4cea49b81dc3 tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f954f23-8a65-4d6e-bb34-08ec3e685654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:32 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d5a7d784-62e0-4c19-b414-4cea49b81dc3 tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0b9e8ae-a6ec-44ae-a192-1dec00e1aaf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:32 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d5a7d784-62e0-4c19-b414-4cea49b81dc3 tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0b9e8ae-a6ec-44ae-a192-1dec00e1aaf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '427e3b87-b55a-4687-ab0d-8ea3e7c37fb9', 'volume_name': 'volume-427e3b87-b55a-4687-ab0d-8ea3e7c37fb9', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:32 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d5a7d784-62e0-4c19-b414-4cea49b81dc3 tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (834684c7-c7d5-406a-9d0c-06d5e5a2698e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:32 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d5a7d784-62e0-4c19-b414-4cea49b81dc3 tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (834684c7-c7d5-406a-9d0c-06d5e5a2698e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:32 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d5a7d784-62e0-4c19-b414-4cea49b81dc3 tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d955ca90-29fa-49b8-8556-e7f5158c6972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:32 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-d5a7d784-62e0-4c19-b414-4cea49b81dc3 tempest-CreateVolumesFromSnapshotTest-150382642 None] Volume 427e3b87-b55a-4687-ab0d-8ea3e7c37fb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-427e3b87-b55a-4687-ab0d-8ea3e7c37fb9', 'volume_size': 1}
Jul 10 13:01:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d5a7d784-62e0-4c19-b414-4cea49b81dc3 tempest-CreateVolumesFromSnapshotTest-150382642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:01:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d5a7d784-62e0-4c19-b414-4cea49b81dc3 tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:01:32 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-d5a7d784-62e0-4c19-b414-4cea49b81dc3 tempest-CreateVolumesFromSnapshotTest-150382642 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:01:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1984829275',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=427e3b87-b55a-4687-ab0d-8ea3e7c37fb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36dd55e6e5424501bb898fff48c2de7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:01:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:01:32Z,use_quota=True,user_id='e9848d08eaca40c9bab9da37596a97ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 13:01:32 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-d5a7d784-62e0-4c19-b414-4cea49b81dc3 tempest-CreateVolumesFromSnapshotTest-150382642 None] Creating volume 427e3b87-b55a-4687-ab0d-8ea3e7c37fb9 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 13:01:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d5a7d784-62e0-4c19-b414-4cea49b81dc3 tempest-CreateVolumesFromSnapshotTest-150382642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:01:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d5a7d784-62e0-4c19-b414-4cea49b81dc3 tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:01:32 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-d5a7d784-62e0-4c19-b414-4cea49b81dc3 tempest-CreateVolumesFromSnapshotTest-150382642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:01:32 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-d5a7d784-62e0-4c19-b414-4cea49b81dc3 tempest-CreateVolumesFromSnapshotTest-150382642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:01:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d5a7d784-62e0-4c19-b414-4cea49b81dc3 tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:01:32 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-d5a7d784-62e0-4c19-b414-4cea49b81dc3 tempest-CreateVolumesFromSnapshotTest-150382642 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 13:01:32 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-d5a7d784-62e0-4c19-b414-4cea49b81dc3 tempest-CreateVolumesFromSnapshotTest-150382642 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 13:01:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d5a7d784-62e0-4c19-b414-4cea49b81dc3 tempest-CreateVolumesFromSnapshotTest-150382642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-427e3b87-b55a-4687-ab0d-8ea3e7c37fb9 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:32 devstack sudo[106562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-427e3b87-b55a-4687-ab0d-8ea3e7c37fb9 1073741824
Jul 10 13:01:32 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:32 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f43b2dc-f506-431b-a380-726e42da501a tempest-CreateVolumesFromSnapshotTest-150382642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 13:01:32 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5f43b2dc-f506-431b-a380-726e42da501a tempest-CreateVolumesFromSnapshotTest-150382642 None] Flow 'volume_create_manager' (f4699014-5e44-43fa-8f1d-3b998d3ec168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:01:32 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5f43b2dc-f506-431b-a380-726e42da501a tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d6053af-917f-4f30-ac4a-131b8e1d9652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:32 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5f43b2dc-f506-431b-a380-726e42da501a tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d6053af-917f-4f30-ac4a-131b8e1d9652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:01:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1023415547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=589e646c-5dad-48e3-a605-c9358afad287,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36dd55e6e5424501bb898fff48c2de7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:01:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:01:32Z,use_quota=True,user_id='e9848d08eaca40c9bab9da37596a97ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:32 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5f43b2dc-f506-431b-a380-726e42da501a tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (357b2a33-d303-4b22-b7c3-3ba790238055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:32 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5f43b2dc-f506-431b-a380-726e42da501a tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (357b2a33-d303-4b22-b7c3-3ba790238055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:32 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5f43b2dc-f506-431b-a380-726e42da501a tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0ba9fc3-aab4-45e3-b1dd-5513ca481782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:32 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5f43b2dc-f506-431b-a380-726e42da501a tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0ba9fc3-aab4-45e3-b1dd-5513ca481782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '589e646c-5dad-48e3-a605-c9358afad287', 'volume_name': 'volume-589e646c-5dad-48e3-a605-c9358afad287', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:32 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5f43b2dc-f506-431b-a380-726e42da501a tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10ce1a17-52fc-4524-ac6c-53cf7fb089f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:32 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5f43b2dc-f506-431b-a380-726e42da501a tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10ce1a17-52fc-4524-ac6c-53cf7fb089f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:32 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5f43b2dc-f506-431b-a380-726e42da501a tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf942e44-6b7d-4925-9024-9c75d4f2ec5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:32 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-5f43b2dc-f506-431b-a380-726e42da501a tempest-CreateVolumesFromSnapshotTest-150382642 None] Volume 589e646c-5dad-48e3-a605-c9358afad287: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-589e646c-5dad-48e3-a605-c9358afad287', 'volume_size': 1}
Jul 10 13:01:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5f43b2dc-f506-431b-a380-726e42da501a tempest-CreateVolumesFromSnapshotTest-150382642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:01:33 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-23e6f732-5ba7-47d3-86cc-01ba3c9cdaa1 tempest-CreateVolumesFromSnapshotTest-150382642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 13:01:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-23e6f732-5ba7-47d3-86cc-01ba3c9cdaa1 tempest-CreateVolumesFromSnapshotTest-150382642 None] Flow 'volume_create_manager' (a9edf674-b8eb-4276-ab28-2c064d468a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:01:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-23e6f732-5ba7-47d3-86cc-01ba3c9cdaa1 tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4169379-adae-4a4b-b01d-45865413f646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-23e6f732-5ba7-47d3-86cc-01ba3c9cdaa1 tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4169379-adae-4a4b-b01d-45865413f646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:01:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-590093791',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c2fcb45-6639-4e4e-b60c-be89987509cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36dd55e6e5424501bb898fff48c2de7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:01:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:01:33Z,use_quota=True,user_id='e9848d08eaca40c9bab9da37596a97ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-23e6f732-5ba7-47d3-86cc-01ba3c9cdaa1 tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (488d4b9e-fab9-4bc2-bc92-14dda0c3745c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-23e6f732-5ba7-47d3-86cc-01ba3c9cdaa1 tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (488d4b9e-fab9-4bc2-bc92-14dda0c3745c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-23e6f732-5ba7-47d3-86cc-01ba3c9cdaa1 tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b07a350-2404-4976-9ba2-e1775a2a8bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-23e6f732-5ba7-47d3-86cc-01ba3c9cdaa1 tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b07a350-2404-4976-9ba2-e1775a2a8bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c2fcb45-6639-4e4e-b60c-be89987509cd', 'volume_name': 'volume-5c2fcb45-6639-4e4e-b60c-be89987509cd', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-23e6f732-5ba7-47d3-86cc-01ba3c9cdaa1 tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3448cc0c-7d11-4e48-8d7e-3480565b9e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-23e6f732-5ba7-47d3-86cc-01ba3c9cdaa1 tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3448cc0c-7d11-4e48-8d7e-3480565b9e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-23e6f732-5ba7-47d3-86cc-01ba3c9cdaa1 tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9e7b3af-671f-48c9-b6c8-a51ac6f58f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:33 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-23e6f732-5ba7-47d3-86cc-01ba3c9cdaa1 tempest-CreateVolumesFromSnapshotTest-150382642 None] Volume 5c2fcb45-6639-4e4e-b60c-be89987509cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c2fcb45-6639-4e4e-b60c-be89987509cd', 'volume_size': 1}
Jul 10 13:01:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-23e6f732-5ba7-47d3-86cc-01ba3c9cdaa1 tempest-CreateVolumesFromSnapshotTest-150382642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:01:33 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d5a7d784-62e0-4c19-b414-4cea49b81dc3 tempest-CreateVolumesFromSnapshotTest-150382642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-427e3b87-b55a-4687-ab0d-8ea3e7c37fb9 1073741824" returned: 0 in 1.537s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d5a7d784-62e0-4c19-b414-4cea49b81dc3 tempest-CreateVolumesFromSnapshotTest-150382642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-427e3b87-b55a-4687-ab0d-8ea3e7c37fb9 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:33 devstack sudo[106568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-427e3b87-b55a-4687-ab0d-8ea3e7c37fb9
Jul 10 13:01:33 devstack sudo[106568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:34 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dcd1465-4e13-496c-adbf-018e015bf4d6 tempest-CreateVolumesFromSnapshotTest-150382642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 13:01:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0dcd1465-4e13-496c-adbf-018e015bf4d6 tempest-CreateVolumesFromSnapshotTest-150382642 None] Flow 'volume_create_manager' (2ee1fc5b-0950-42f1-b295-31be15a21b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:01:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0dcd1465-4e13-496c-adbf-018e015bf4d6 tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dafb7d1-7994-4f3e-a223-748229c21102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0dcd1465-4e13-496c-adbf-018e015bf4d6 tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dafb7d1-7994-4f3e-a223-748229c21102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:01:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1439818596',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee74ad61-8def-4b31-9602-61b4fb79bb51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36dd55e6e5424501bb898fff48c2de7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:01:34Z,use_quota=True,user_id='e9848d08eaca40c9bab9da37596a97ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0dcd1465-4e13-496c-adbf-018e015bf4d6 tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43b231ab-74ed-4c81-ab02-f636a94114ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0dcd1465-4e13-496c-adbf-018e015bf4d6 tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43b231ab-74ed-4c81-ab02-f636a94114ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0dcd1465-4e13-496c-adbf-018e015bf4d6 tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c18d415-08a7-4496-9ecd-fcf78b9afc01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0dcd1465-4e13-496c-adbf-018e015bf4d6 tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c18d415-08a7-4496-9ecd-fcf78b9afc01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee74ad61-8def-4b31-9602-61b4fb79bb51', 'volume_name': 'volume-ee74ad61-8def-4b31-9602-61b4fb79bb51', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0dcd1465-4e13-496c-adbf-018e015bf4d6 tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40842b49-8e7b-4a32-9d7f-17e25fe11676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0dcd1465-4e13-496c-adbf-018e015bf4d6 tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40842b49-8e7b-4a32-9d7f-17e25fe11676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0dcd1465-4e13-496c-adbf-018e015bf4d6 tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64a9b9ed-1c81-4b1a-b4bb-4f4b0a4a1d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:34 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-0dcd1465-4e13-496c-adbf-018e015bf4d6 tempest-CreateVolumesFromSnapshotTest-150382642 None] Volume ee74ad61-8def-4b31-9602-61b4fb79bb51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee74ad61-8def-4b31-9602-61b4fb79bb51', 'volume_size': 1}
Jul 10 13:01:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0dcd1465-4e13-496c-adbf-018e015bf4d6 tempest-CreateVolumesFromSnapshotTest-150382642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:01:34 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-c577260f-4121-4326-98a8-7957b92fc578 tempest-CreateVolumesFromSnapshotTest-150382642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 13:01:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c577260f-4121-4326-98a8-7957b92fc578 tempest-CreateVolumesFromSnapshotTest-150382642 None] Flow 'volume_create_manager' (a6470943-dd08-427a-b092-c59107314a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:01:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c577260f-4121-4326-98a8-7957b92fc578 tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e3bb70f-b3f0-4af6-9561-5bed05e215d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c577260f-4121-4326-98a8-7957b92fc578 tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e3bb70f-b3f0-4af6-9561-5bed05e215d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1134709575',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cb73387-63c8-41b3-b3a8-945f3e597d22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36dd55e6e5424501bb898fff48c2de7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:01:35Z,use_quota=True,user_id='e9848d08eaca40c9bab9da37596a97ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c577260f-4121-4326-98a8-7957b92fc578 tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27b70d5c-3219-4e3d-8c72-a9764f08e2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c577260f-4121-4326-98a8-7957b92fc578 tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27b70d5c-3219-4e3d-8c72-a9764f08e2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c577260f-4121-4326-98a8-7957b92fc578 tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2357c85b-3425-43a8-bb95-812a27db8dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c577260f-4121-4326-98a8-7957b92fc578 tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2357c85b-3425-43a8-bb95-812a27db8dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cb73387-63c8-41b3-b3a8-945f3e597d22', 'volume_name': 'volume-8cb73387-63c8-41b3-b3a8-945f3e597d22', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c577260f-4121-4326-98a8-7957b92fc578 tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d396651-5b41-45d3-9da6-efaafe27e337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c577260f-4121-4326-98a8-7957b92fc578 tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d396651-5b41-45d3-9da6-efaafe27e337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c577260f-4121-4326-98a8-7957b92fc578 tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cf17019-1c0d-4897-8abd-ce3fd78160c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:34 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-c577260f-4121-4326-98a8-7957b92fc578 tempest-CreateVolumesFromSnapshotTest-150382642 None] Volume 8cb73387-63c8-41b3-b3a8-945f3e597d22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cb73387-63c8-41b3-b3a8-945f3e597d22', 'volume_size': 1}
Jul 10 13:01:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c577260f-4121-4326-98a8-7957b92fc578 tempest-CreateVolumesFromSnapshotTest-150382642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:01:34 devstack sudo[106568]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d5a7d784-62e0-4c19-b414-4cea49b81dc3 tempest-CreateVolumesFromSnapshotTest-150382642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-427e3b87-b55a-4687-ab0d-8ea3e7c37fb9" returned: 0 in 0.986s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:34 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-d5a7d784-62e0-4c19-b414-4cea49b81dc3 tempest-CreateVolumesFromSnapshotTest-150382642 None] <== create_volume: return (2604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 13:01:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d5a7d784-62e0-4c19-b414-4cea49b81dc3 tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.613s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:01:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5f43b2dc-f506-431b-a380-726e42da501a tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.141s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:01:34 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5f43b2dc-f506-431b-a380-726e42da501a tempest-CreateVolumesFromSnapshotTest-150382642 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:01:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1023415547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=589e646c-5dad-48e3-a605-c9358afad287,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36dd55e6e5424501bb898fff48c2de7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:01:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:01:32Z,use_quota=True,user_id='e9848d08eaca40c9bab9da37596a97ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 13:01:34 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-5f43b2dc-f506-431b-a380-726e42da501a tempest-CreateVolumesFromSnapshotTest-150382642 None] Creating volume 589e646c-5dad-48e3-a605-c9358afad287 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 13:01:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5f43b2dc-f506-431b-a380-726e42da501a tempest-CreateVolumesFromSnapshotTest-150382642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:01:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5f43b2dc-f506-431b-a380-726e42da501a tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:01:34 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5f43b2dc-f506-431b-a380-726e42da501a tempest-CreateVolumesFromSnapshotTest-150382642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:01:34 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5f43b2dc-f506-431b-a380-726e42da501a tempest-CreateVolumesFromSnapshotTest-150382642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:01:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5f43b2dc-f506-431b-a380-726e42da501a tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:01:34 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5f43b2dc-f506-431b-a380-726e42da501a tempest-CreateVolumesFromSnapshotTest-150382642 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 13:01:34 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-5f43b2dc-f506-431b-a380-726e42da501a tempest-CreateVolumesFromSnapshotTest-150382642 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 13:01:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5f43b2dc-f506-431b-a380-726e42da501a tempest-CreateVolumesFromSnapshotTest-150382642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-589e646c-5dad-48e3-a605-c9358afad287 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d5a7d784-62e0-4c19-b414-4cea49b81dc3 tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d955ca90-29fa-49b8-8556-e7f5158c6972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-427e3b87-b55a-4687-ab0d-8ea3e7c37fb9', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:34 devstack sudo[106571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-589e646c-5dad-48e3-a605-c9358afad287 1073741824
Jul 10 13:01:34 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d5a7d784-62e0-4c19-b414-4cea49b81dc3 tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58f5e92e-382d-4deb-8257-0da23b405948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:34 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-d5a7d784-62e0-4c19-b414-4cea49b81dc3 tempest-CreateVolumesFromSnapshotTest-150382642 None] Volume volume-427e3b87-b55a-4687-ab0d-8ea3e7c37fb9 (427e3b87-b55a-4687-ab0d-8ea3e7c37fb9): created successfully
Jul 10 13:01:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d5a7d784-62e0-4c19-b414-4cea49b81dc3 tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58f5e92e-382d-4deb-8257-0da23b405948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d5a7d784-62e0-4c19-b414-4cea49b81dc3 tempest-CreateVolumesFromSnapshotTest-150382642 None] Flow 'volume_create_manager' (0399bcb8-83fa-4017-9627-05d516c78d3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:01:34 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-d5a7d784-62e0-4c19-b414-4cea49b81dc3 tempest-CreateVolumesFromSnapshotTest-150382642 None] Created volume successfully.
Jul 10 13:01:36 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5f43b2dc-f506-431b-a380-726e42da501a tempest-CreateVolumesFromSnapshotTest-150382642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-589e646c-5dad-48e3-a605-c9358afad287 1073741824" returned: 0 in 1.273s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5f43b2dc-f506-431b-a380-726e42da501a tempest-CreateVolumesFromSnapshotTest-150382642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-589e646c-5dad-48e3-a605-c9358afad287 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:36 devstack sudo[106585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-589e646c-5dad-48e3-a605-c9358afad287
Jul 10 13:01:36 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:37 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5f43b2dc-f506-431b-a380-726e42da501a tempest-CreateVolumesFromSnapshotTest-150382642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-589e646c-5dad-48e3-a605-c9358afad287" returned: 0 in 0.865s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:37 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5f43b2dc-f506-431b-a380-726e42da501a tempest-CreateVolumesFromSnapshotTest-150382642 None] <== create_volume: return (2207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 13:01:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5f43b2dc-f506-431b-a380-726e42da501a tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.210s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:01:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-23e6f732-5ba7-47d3-86cc-01ba3c9cdaa1 tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.422s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:01:37 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-23e6f732-5ba7-47d3-86cc-01ba3c9cdaa1 tempest-CreateVolumesFromSnapshotTest-150382642 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:01:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-590093791',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c2fcb45-6639-4e4e-b60c-be89987509cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36dd55e6e5424501bb898fff48c2de7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:01:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:01:33Z,use_quota=True,user_id='e9848d08eaca40c9bab9da37596a97ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 13:01:37 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-23e6f732-5ba7-47d3-86cc-01ba3c9cdaa1 tempest-CreateVolumesFromSnapshotTest-150382642 None] Creating volume 5c2fcb45-6639-4e4e-b60c-be89987509cd {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 13:01:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-23e6f732-5ba7-47d3-86cc-01ba3c9cdaa1 tempest-CreateVolumesFromSnapshotTest-150382642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:01:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-23e6f732-5ba7-47d3-86cc-01ba3c9cdaa1 tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:01:37 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-23e6f732-5ba7-47d3-86cc-01ba3c9cdaa1 tempest-CreateVolumesFromSnapshotTest-150382642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:01:37 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-23e6f732-5ba7-47d3-86cc-01ba3c9cdaa1 tempest-CreateVolumesFromSnapshotTest-150382642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:01:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-23e6f732-5ba7-47d3-86cc-01ba3c9cdaa1 tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:01:37 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-23e6f732-5ba7-47d3-86cc-01ba3c9cdaa1 tempest-CreateVolumesFromSnapshotTest-150382642 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 13:01:37 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-23e6f732-5ba7-47d3-86cc-01ba3c9cdaa1 tempest-CreateVolumesFromSnapshotTest-150382642 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 13:01:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-23e6f732-5ba7-47d3-86cc-01ba3c9cdaa1 tempest-CreateVolumesFromSnapshotTest-150382642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5c2fcb45-6639-4e4e-b60c-be89987509cd 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5f43b2dc-f506-431b-a380-726e42da501a tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf942e44-6b7d-4925-9024-9c75d4f2ec5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-589e646c-5dad-48e3-a605-c9358afad287', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5f43b2dc-f506-431b-a380-726e42da501a tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (314f7617-5a16-4131-907c-d79a456f2d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:37 devstack sudo[106588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5c2fcb45-6639-4e4e-b60c-be89987509cd 1073741824
Jul 10 13:01:37 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:37 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-5f43b2dc-f506-431b-a380-726e42da501a tempest-CreateVolumesFromSnapshotTest-150382642 None] Volume volume-589e646c-5dad-48e3-a605-c9358afad287 (589e646c-5dad-48e3-a605-c9358afad287): created successfully
Jul 10 13:01:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5f43b2dc-f506-431b-a380-726e42da501a tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (314f7617-5a16-4131-907c-d79a456f2d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5f43b2dc-f506-431b-a380-726e42da501a tempest-CreateVolumesFromSnapshotTest-150382642 None] Flow 'volume_create_manager' (f4699014-5e44-43fa-8f1d-3b998d3ec168) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:01:37 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-5f43b2dc-f506-431b-a380-726e42da501a tempest-CreateVolumesFromSnapshotTest-150382642 None] Created volume successfully.
Jul 10 13:01:38 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-23e6f732-5ba7-47d3-86cc-01ba3c9cdaa1 tempest-CreateVolumesFromSnapshotTest-150382642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5c2fcb45-6639-4e4e-b60c-be89987509cd 1073741824" returned: 0 in 1.230s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-23e6f732-5ba7-47d3-86cc-01ba3c9cdaa1 tempest-CreateVolumesFromSnapshotTest-150382642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5c2fcb45-6639-4e4e-b60c-be89987509cd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:38 devstack sudo[106594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5c2fcb45-6639-4e4e-b60c-be89987509cd
Jul 10 13:01:38 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:39 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6008eed-7197-4bbc-be46-d3631c29eab8 tempest-ProjectReaderTests-1805919051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 13:01:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d6008eed-7197-4bbc-be46-d3631c29eab8 tempest-ProjectReaderTests-1805919051 None] Flow 'volume_create_manager' (6faa370b-113d-438d-925b-c327edae81b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:01:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d6008eed-7197-4bbc-be46-d3631c29eab8 tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfb50fd8-b5cb-4a66-9181-3ac51b1289d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d6008eed-7197-4bbc-be46-d3631c29eab8 tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfb50fd8-b5cb-4a66-9181-3ac51b1289d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-456351862',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2876be77-15ef-4731-a7d4-b2812ee2764f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eba2bac9ba8240e4b6c7825aeee0bdc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:01:39Z,use_quota=True,user_id='5c9819a9765743f798b8c839da755b20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d6008eed-7197-4bbc-be46-d3631c29eab8 tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (078583f3-94a9-4dda-8db5-2e7e1f444592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d6008eed-7197-4bbc-be46-d3631c29eab8 tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (078583f3-94a9-4dda-8db5-2e7e1f444592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d6008eed-7197-4bbc-be46-d3631c29eab8 tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa054f5d-c7d2-442e-b36c-0a88a551d414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d6008eed-7197-4bbc-be46-d3631c29eab8 tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa054f5d-c7d2-442e-b36c-0a88a551d414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2876be77-15ef-4731-a7d4-b2812ee2764f', 'volume_name': 'volume-2876be77-15ef-4731-a7d4-b2812ee2764f', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:39 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d6008eed-7197-4bbc-be46-d3631c29eab8 tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9577350c-4cc5-426e-8f8e-dcccb624e9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d6008eed-7197-4bbc-be46-d3631c29eab8 tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9577350c-4cc5-426e-8f8e-dcccb624e9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d6008eed-7197-4bbc-be46-d3631c29eab8 tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b3adbe-1aea-414a-ae0e-ea6db500af51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:39 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-d6008eed-7197-4bbc-be46-d3631c29eab8 tempest-ProjectReaderTests-1805919051 None] Volume 2876be77-15ef-4731-a7d4-b2812ee2764f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2876be77-15ef-4731-a7d4-b2812ee2764f', 'volume_size': 1}
Jul 10 13:01:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d6008eed-7197-4bbc-be46-d3631c29eab8 tempest-ProjectReaderTests-1805919051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:01:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-23e6f732-5ba7-47d3-86cc-01ba3c9cdaa1 tempest-CreateVolumesFromSnapshotTest-150382642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5c2fcb45-6639-4e4e-b60c-be89987509cd" returned: 0 in 0.926s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-23e6f732-5ba7-47d3-86cc-01ba3c9cdaa1 tempest-CreateVolumesFromSnapshotTest-150382642 None] <== create_volume: return (2223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 13:01:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-23e6f732-5ba7-47d3-86cc-01ba3c9cdaa1 tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.228s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:01:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0dcd1465-4e13-496c-adbf-018e015bf4d6 tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.772s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:01:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-0dcd1465-4e13-496c-adbf-018e015bf4d6 tempest-CreateVolumesFromSnapshotTest-150382642 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:01:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1439818596',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee74ad61-8def-4b31-9602-61b4fb79bb51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36dd55e6e5424501bb898fff48c2de7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:01:34Z,use_quota=True,user_id='e9848d08eaca40c9bab9da37596a97ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 13:01:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-0dcd1465-4e13-496c-adbf-018e015bf4d6 tempest-CreateVolumesFromSnapshotTest-150382642 None] Creating volume ee74ad61-8def-4b31-9602-61b4fb79bb51 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 13:01:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0dcd1465-4e13-496c-adbf-018e015bf4d6 tempest-CreateVolumesFromSnapshotTest-150382642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:01:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0dcd1465-4e13-496c-adbf-018e015bf4d6 tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:01:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-0dcd1465-4e13-496c-adbf-018e015bf4d6 tempest-CreateVolumesFromSnapshotTest-150382642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:01:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-0dcd1465-4e13-496c-adbf-018e015bf4d6 tempest-CreateVolumesFromSnapshotTest-150382642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:01:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0dcd1465-4e13-496c-adbf-018e015bf4d6 tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:01:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-0dcd1465-4e13-496c-adbf-018e015bf4d6 tempest-CreateVolumesFromSnapshotTest-150382642 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 13:01:39 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-0dcd1465-4e13-496c-adbf-018e015bf4d6 tempest-CreateVolumesFromSnapshotTest-150382642 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 13:01:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0dcd1465-4e13-496c-adbf-018e015bf4d6 tempest-CreateVolumesFromSnapshotTest-150382642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee74ad61-8def-4b31-9602-61b4fb79bb51 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:39 devstack sudo[106598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee74ad61-8def-4b31-9602-61b4fb79bb51 1073741824
Jul 10 13:01:39 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-23e6f732-5ba7-47d3-86cc-01ba3c9cdaa1 tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9e7b3af-671f-48c9-b6c8-a51ac6f58f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c2fcb45-6639-4e4e-b60c-be89987509cd', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-23e6f732-5ba7-47d3-86cc-01ba3c9cdaa1 tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6909a591-b22d-4dec-bbf3-b6be3c9d1894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:39 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-23e6f732-5ba7-47d3-86cc-01ba3c9cdaa1 tempest-CreateVolumesFromSnapshotTest-150382642 None] Volume volume-5c2fcb45-6639-4e4e-b60c-be89987509cd (5c2fcb45-6639-4e4e-b60c-be89987509cd): created successfully
Jul 10 13:01:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-23e6f732-5ba7-47d3-86cc-01ba3c9cdaa1 tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6909a591-b22d-4dec-bbf3-b6be3c9d1894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:39 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-23e6f732-5ba7-47d3-86cc-01ba3c9cdaa1 tempest-CreateVolumesFromSnapshotTest-150382642 None] Flow 'volume_create_manager' (a9edf674-b8eb-4276-ab28-2c064d468a9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:01:39 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-23e6f732-5ba7-47d3-86cc-01ba3c9cdaa1 tempest-CreateVolumesFromSnapshotTest-150382642 None] Created volume successfully.
Jul 10 13:01:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0dcd1465-4e13-496c-adbf-018e015bf4d6 tempest-CreateVolumesFromSnapshotTest-150382642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee74ad61-8def-4b31-9602-61b4fb79bb51 1073741824" returned: 0 in 1.074s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:40 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0dcd1465-4e13-496c-adbf-018e015bf4d6 tempest-CreateVolumesFromSnapshotTest-150382642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee74ad61-8def-4b31-9602-61b4fb79bb51 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:40 devstack sudo[106609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee74ad61-8def-4b31-9602-61b4fb79bb51
Jul 10 13:01:40 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:41 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0dcd1465-4e13-496c-adbf-018e015bf4d6 tempest-CreateVolumesFromSnapshotTest-150382642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee74ad61-8def-4b31-9602-61b4fb79bb51" returned: 0 in 0.784s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:41 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-0dcd1465-4e13-496c-adbf-018e015bf4d6 tempest-CreateVolumesFromSnapshotTest-150382642 None] <== create_volume: return (1925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 13:01:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0dcd1465-4e13-496c-adbf-018e015bf4d6 tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.928s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:01:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c577260f-4121-4326-98a8-7957b92fc578 tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.445s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:01:41 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-c577260f-4121-4326-98a8-7957b92fc578 tempest-CreateVolumesFromSnapshotTest-150382642 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1134709575',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cb73387-63c8-41b3-b3a8-945f3e597d22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36dd55e6e5424501bb898fff48c2de7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:01:35Z,use_quota=True,user_id='e9848d08eaca40c9bab9da37596a97ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 13:01:41 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-c577260f-4121-4326-98a8-7957b92fc578 tempest-CreateVolumesFromSnapshotTest-150382642 None] Creating volume 8cb73387-63c8-41b3-b3a8-945f3e597d22 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 13:01:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c577260f-4121-4326-98a8-7957b92fc578 tempest-CreateVolumesFromSnapshotTest-150382642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:01:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c577260f-4121-4326-98a8-7957b92fc578 tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:01:41 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-c577260f-4121-4326-98a8-7957b92fc578 tempest-CreateVolumesFromSnapshotTest-150382642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:01:41 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-c577260f-4121-4326-98a8-7957b92fc578 tempest-CreateVolumesFromSnapshotTest-150382642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:01:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c577260f-4121-4326-98a8-7957b92fc578 tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:01:41 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-c577260f-4121-4326-98a8-7957b92fc578 tempest-CreateVolumesFromSnapshotTest-150382642 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 13:01:41 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-c577260f-4121-4326-98a8-7957b92fc578 tempest-CreateVolumesFromSnapshotTest-150382642 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 13:01:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c577260f-4121-4326-98a8-7957b92fc578 tempest-CreateVolumesFromSnapshotTest-150382642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8cb73387-63c8-41b3-b3a8-945f3e597d22 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:41 devstack sudo[106612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8cb73387-63c8-41b3-b3a8-945f3e597d22 1073741824
Jul 10 13:01:41 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0dcd1465-4e13-496c-adbf-018e015bf4d6 tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64a9b9ed-1c81-4b1a-b4bb-4f4b0a4a1d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee74ad61-8def-4b31-9602-61b4fb79bb51', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0dcd1465-4e13-496c-adbf-018e015bf4d6 tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (909c242e-25c2-4981-9669-c73467297176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:41 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-0dcd1465-4e13-496c-adbf-018e015bf4d6 tempest-CreateVolumesFromSnapshotTest-150382642 None] Volume volume-ee74ad61-8def-4b31-9602-61b4fb79bb51 (ee74ad61-8def-4b31-9602-61b4fb79bb51): created successfully
Jul 10 13:01:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0dcd1465-4e13-496c-adbf-018e015bf4d6 tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (909c242e-25c2-4981-9669-c73467297176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0dcd1465-4e13-496c-adbf-018e015bf4d6 tempest-CreateVolumesFromSnapshotTest-150382642 None] Flow 'volume_create_manager' (2ee1fc5b-0950-42f1-b295-31be15a21b44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:01:41 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-0dcd1465-4e13-496c-adbf-018e015bf4d6 tempest-CreateVolumesFromSnapshotTest-150382642 None] Created volume successfully.
Jul 10 13:01:42 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c577260f-4121-4326-98a8-7957b92fc578 tempest-CreateVolumesFromSnapshotTest-150382642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8cb73387-63c8-41b3-b3a8-945f3e597d22 1073741824" returned: 0 in 1.031s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c577260f-4121-4326-98a8-7957b92fc578 tempest-CreateVolumesFromSnapshotTest-150382642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8cb73387-63c8-41b3-b3a8-945f3e597d22 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:42 devstack sudo[106618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8cb73387-63c8-41b3-b3a8-945f3e597d22
Jul 10 13:01:42 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:43 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c577260f-4121-4326-98a8-7957b92fc578 tempest-CreateVolumesFromSnapshotTest-150382642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8cb73387-63c8-41b3-b3a8-945f3e597d22" returned: 0 in 0.785s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:43 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-c577260f-4121-4326-98a8-7957b92fc578 tempest-CreateVolumesFromSnapshotTest-150382642 None] <== create_volume: return (1884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 13:01:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c577260f-4121-4326-98a8-7957b92fc578 tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.891s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:01:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d6008eed-7197-4bbc-be46-d3631c29eab8 tempest-ProjectReaderTests-1805919051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.844s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:01:43 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-d6008eed-7197-4bbc-be46-d3631c29eab8 tempest-ProjectReaderTests-1805919051 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-456351862',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2876be77-15ef-4731-a7d4-b2812ee2764f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eba2bac9ba8240e4b6c7825aeee0bdc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:01:39Z,use_quota=True,user_id='5c9819a9765743f798b8c839da755b20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 13:01:43 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-d6008eed-7197-4bbc-be46-d3631c29eab8 tempest-ProjectReaderTests-1805919051 None] Creating volume 2876be77-15ef-4731-a7d4-b2812ee2764f {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 13:01:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d6008eed-7197-4bbc-be46-d3631c29eab8 tempest-ProjectReaderTests-1805919051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:01:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d6008eed-7197-4bbc-be46-d3631c29eab8 tempest-ProjectReaderTests-1805919051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:01:43 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-d6008eed-7197-4bbc-be46-d3631c29eab8 tempest-ProjectReaderTests-1805919051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:01:43 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-d6008eed-7197-4bbc-be46-d3631c29eab8 tempest-ProjectReaderTests-1805919051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:01:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d6008eed-7197-4bbc-be46-d3631c29eab8 tempest-ProjectReaderTests-1805919051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:01:43 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-d6008eed-7197-4bbc-be46-d3631c29eab8 tempest-ProjectReaderTests-1805919051 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 13:01:43 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-d6008eed-7197-4bbc-be46-d3631c29eab8 tempest-ProjectReaderTests-1805919051 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 13:01:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d6008eed-7197-4bbc-be46-d3631c29eab8 tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2876be77-15ef-4731-a7d4-b2812ee2764f 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:43 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c577260f-4121-4326-98a8-7957b92fc578 tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cf17019-1c0d-4897-8abd-ce3fd78160c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cb73387-63c8-41b3-b3a8-945f3e597d22', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:43 devstack sudo[106621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2876be77-15ef-4731-a7d4-b2812ee2764f 1073741824
Jul 10 13:01:43 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:43 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c577260f-4121-4326-98a8-7957b92fc578 tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (972fa12d-c8ca-4836-b7a5-c2bf4d016688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:43 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-c577260f-4121-4326-98a8-7957b92fc578 tempest-CreateVolumesFromSnapshotTest-150382642 None] Volume volume-8cb73387-63c8-41b3-b3a8-945f3e597d22 (8cb73387-63c8-41b3-b3a8-945f3e597d22): created successfully
Jul 10 13:01:43 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c577260f-4121-4326-98a8-7957b92fc578 tempest-CreateVolumesFromSnapshotTest-150382642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (972fa12d-c8ca-4836-b7a5-c2bf4d016688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:43 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-c577260f-4121-4326-98a8-7957b92fc578 tempest-CreateVolumesFromSnapshotTest-150382642 None] Flow 'volume_create_manager' (a6470943-dd08-427a-b092-c59107314a01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:01:43 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-c577260f-4121-4326-98a8-7957b92fc578 tempest-CreateVolumesFromSnapshotTest-150382642 None] Created volume successfully.
Jul 10 13:01:43 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-e271c169-121f-47ba-9c2b-4283de5411cb tempest-ProjectReaderTests-237990147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 13:01:43 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e271c169-121f-47ba-9c2b-4283de5411cb tempest-ProjectReaderTests-237990147 None] Flow 'volume_create_manager' (398a4d46-cb0d-49c0-a992-53e8fa4cea36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:01:43 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e271c169-121f-47ba-9c2b-4283de5411cb tempest-ProjectReaderTests-237990147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (112036ee-cea6-47ac-9714-8cd6703fa2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:43 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e271c169-121f-47ba-9c2b-4283de5411cb tempest-ProjectReaderTests-237990147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (112036ee-cea6-47ac-9714-8cd6703fa2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-85512557',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b5d2c9f-42f7-4776-81b2-b70835407281,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5908b48827b94c09886b81d755ab3c09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:01:43Z,use_quota=True,user_id='f089be7940884cdc9783d9c7bd5a3408',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:43 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e271c169-121f-47ba-9c2b-4283de5411cb tempest-ProjectReaderTests-237990147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f4f3574-a946-49ba-b2ce-9df360c51ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:43 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e271c169-121f-47ba-9c2b-4283de5411cb tempest-ProjectReaderTests-237990147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f4f3574-a946-49ba-b2ce-9df360c51ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:43 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e271c169-121f-47ba-9c2b-4283de5411cb tempest-ProjectReaderTests-237990147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15027a71-f357-483b-8881-0fbe8bd394d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:43 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e271c169-121f-47ba-9c2b-4283de5411cb tempest-ProjectReaderTests-237990147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15027a71-f357-483b-8881-0fbe8bd394d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b5d2c9f-42f7-4776-81b2-b70835407281', 'volume_name': 'volume-1b5d2c9f-42f7-4776-81b2-b70835407281', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:43 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e271c169-121f-47ba-9c2b-4283de5411cb tempest-ProjectReaderTests-237990147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa46d610-ccd6-4467-a12b-388a398dd1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:43 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e271c169-121f-47ba-9c2b-4283de5411cb tempest-ProjectReaderTests-237990147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa46d610-ccd6-4467-a12b-388a398dd1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:43 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e271c169-121f-47ba-9c2b-4283de5411cb tempest-ProjectReaderTests-237990147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30ff1f5f-4995-41e2-a91a-0cd6c887506b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:43 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-e271c169-121f-47ba-9c2b-4283de5411cb tempest-ProjectReaderTests-237990147 None] Volume 1b5d2c9f-42f7-4776-81b2-b70835407281: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b5d2c9f-42f7-4776-81b2-b70835407281', 'volume_size': 1}
Jul 10 13:01:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e271c169-121f-47ba-9c2b-4283de5411cb tempest-ProjectReaderTests-237990147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:01:43 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-761afa6e-3e13-478f-96fd-30194c7957db tempest-CreateVolumesFromSnapshotTest-150382642 None] Acquiring lock "cinder-8cb73387-63c8-41b3-b3a8-945f3e597d22-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:01:43 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-761afa6e-3e13-478f-96fd-30194c7957db tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "cinder-8cb73387-63c8-41b3-b3a8-945f3e597d22-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:01:43 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-761afa6e-3e13-478f-96fd-30194c7957db tempest-CreateVolumesFromSnapshotTest-150382642 None] Acquiring lock "cinder-quobyte-8cb73387-63c8-41b3-b3a8-945f3e597d22" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:01:43 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-761afa6e-3e13-478f-96fd-30194c7957db tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "cinder-quobyte-8cb73387-63c8-41b3-b3a8-945f3e597d22" acquired by "delete_volume" :: waited 0.019s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:01:43 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[284dc91d-24c4-441c-aaf6-ea27cec67a18]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:01:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-761afa6e-3e13-478f-96fd-30194c7957db tempest-CreateVolumesFromSnapshotTest-150382642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8cb73387-63c8-41b3-b3a8-945f3e597d22 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:44 devstack sudo[106626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8cb73387-63c8-41b3-b3a8-945f3e597d22
Jul 10 13:01:44 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:44 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d6008eed-7197-4bbc-be46-d3631c29eab8 tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2876be77-15ef-4731-a7d4-b2812ee2764f 1073741824" returned: 0 in 0.979s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d6008eed-7197-4bbc-be46-d3631c29eab8 tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2876be77-15ef-4731-a7d4-b2812ee2764f {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:44 devstack sudo[106629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2876be77-15ef-4731-a7d4-b2812ee2764f
Jul 10 13:01:44 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:44 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-761afa6e-3e13-478f-96fd-30194c7957db tempest-CreateVolumesFromSnapshotTest-150382642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8cb73387-63c8-41b3-b3a8-945f3e597d22" returned: 0 in 0.816s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-761afa6e-3e13-478f-96fd-30194c7957db tempest-CreateVolumesFromSnapshotTest-150382642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8cb73387-63c8-41b3-b3a8-945f3e597d22 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:44 devstack sudo[106635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8cb73387-63c8-41b3-b3a8-945f3e597d22
Jul 10 13:01:44 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:44 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d6008eed-7197-4bbc-be46-d3631c29eab8 tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2876be77-15ef-4731-a7d4-b2812ee2764f" returned: 0 in 0.667s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:44 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-d6008eed-7197-4bbc-be46-d3631c29eab8 tempest-ProjectReaderTests-1805919051 None] <== create_volume: return (1692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 13:01:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d6008eed-7197-4bbc-be46-d3631c29eab8 tempest-ProjectReaderTests-1805919051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.697s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:01:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e271c169-121f-47ba-9c2b-4283de5411cb tempest-ProjectReaderTests-237990147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.166s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:01:44 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-e271c169-121f-47ba-9c2b-4283de5411cb tempest-ProjectReaderTests-237990147 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-85512557',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b5d2c9f-42f7-4776-81b2-b70835407281,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5908b48827b94c09886b81d755ab3c09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:01:43Z,use_quota=True,user_id='f089be7940884cdc9783d9c7bd5a3408',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 13:01:44 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-e271c169-121f-47ba-9c2b-4283de5411cb tempest-ProjectReaderTests-237990147 None] Creating volume 1b5d2c9f-42f7-4776-81b2-b70835407281 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 13:01:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e271c169-121f-47ba-9c2b-4283de5411cb tempest-ProjectReaderTests-237990147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:01:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e271c169-121f-47ba-9c2b-4283de5411cb tempest-ProjectReaderTests-237990147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:01:44 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-e271c169-121f-47ba-9c2b-4283de5411cb tempest-ProjectReaderTests-237990147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:01:44 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-e271c169-121f-47ba-9c2b-4283de5411cb tempest-ProjectReaderTests-237990147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:01:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e271c169-121f-47ba-9c2b-4283de5411cb tempest-ProjectReaderTests-237990147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:01:44 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-e271c169-121f-47ba-9c2b-4283de5411cb tempest-ProjectReaderTests-237990147 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 13:01:44 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-e271c169-121f-47ba-9c2b-4283de5411cb tempest-ProjectReaderTests-237990147 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 13:01:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e271c169-121f-47ba-9c2b-4283de5411cb tempest-ProjectReaderTests-237990147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1b5d2c9f-42f7-4776-81b2-b70835407281 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:44 devstack sudo[106637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1b5d2c9f-42f7-4776-81b2-b70835407281 1073741824
Jul 10 13:01:44 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d6008eed-7197-4bbc-be46-d3631c29eab8 tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b3adbe-1aea-414a-ae0e-ea6db500af51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2876be77-15ef-4731-a7d4-b2812ee2764f', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d6008eed-7197-4bbc-be46-d3631c29eab8 tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f9e13ab-56e5-4adc-833c-420f255538eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:44 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-d6008eed-7197-4bbc-be46-d3631c29eab8 tempest-ProjectReaderTests-1805919051 None] Volume volume-2876be77-15ef-4731-a7d4-b2812ee2764f (2876be77-15ef-4731-a7d4-b2812ee2764f): created successfully
Jul 10 13:01:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d6008eed-7197-4bbc-be46-d3631c29eab8 tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f9e13ab-56e5-4adc-833c-420f255538eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:44 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-d6008eed-7197-4bbc-be46-d3631c29eab8 tempest-ProjectReaderTests-1805919051 None] Flow 'volume_create_manager' (6faa370b-113d-438d-925b-c327edae81b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:01:45 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-d6008eed-7197-4bbc-be46-d3631c29eab8 tempest-ProjectReaderTests-1805919051 None] Created volume successfully.
Jul 10 13:01:45 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-761afa6e-3e13-478f-96fd-30194c7957db tempest-CreateVolumesFromSnapshotTest-150382642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8cb73387-63c8-41b3-b3a8-945f3e597d22" returned: 0 in 0.926s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:45 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-761afa6e-3e13-478f-96fd-30194c7957db tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "cinder-quobyte-8cb73387-63c8-41b3-b3a8-945f3e597d22" released by "delete_volume" :: held 1.798s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:01:45 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-761afa6e-3e13-478f-96fd-30194c7957db tempest-CreateVolumesFromSnapshotTest-150382642 None] Created reservations ['030d05a5-fd30-4d75-842c-0bf20178ea1a', '60ce033e-3b0a-4900-a30b-583e9363002b', '713a7d81-5c83-44a0-809b-a65e14750b20', '7629e7fe-7c24-49fa-a2f1-01fcebba4e49'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:01:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-761afa6e-3e13-478f-96fd-30194c7957db tempest-CreateVolumesFromSnapshotTest-150382642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:01:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-761afa6e-3e13-478f-96fd-30194c7957db tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:01:45 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-761afa6e-3e13-478f-96fd-30194c7957db tempest-CreateVolumesFromSnapshotTest-150382642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:01:45 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-761afa6e-3e13-478f-96fd-30194c7957db tempest-CreateVolumesFromSnapshotTest-150382642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:01:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-761afa6e-3e13-478f-96fd-30194c7957db tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:01:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-761afa6e-3e13-478f-96fd-30194c7957db tempest-CreateVolumesFromSnapshotTest-150382642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:45 devstack sudo[106644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:01:45 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-dc3d9c0f-881e-4361-82f9-70b3db1723ee tempest-ProjectReaderTests-1805919051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:01:46 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e271c169-121f-47ba-9c2b-4283de5411cb tempest-ProjectReaderTests-237990147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1b5d2c9f-42f7-4776-81b2-b70835407281 1073741824" returned: 0 in 1.233s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:46 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-86255beb-b2fa-4f38-946d-5883b72aad7f tempest-CreateVolumesFromSnapshotTest-150382642 None] Acquiring lock "cinder-ee74ad61-8def-4b31-9602-61b4fb79bb51-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:01:46 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-86255beb-b2fa-4f38-946d-5883b72aad7f tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "cinder-ee74ad61-8def-4b31-9602-61b4fb79bb51-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:01:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e271c169-121f-47ba-9c2b-4283de5411cb tempest-ProjectReaderTests-237990147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1b5d2c9f-42f7-4776-81b2-b70835407281 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:46 devstack sudo[106646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1b5d2c9f-42f7-4776-81b2-b70835407281
Jul 10 13:01:46 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:46 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-86255beb-b2fa-4f38-946d-5883b72aad7f tempest-CreateVolumesFromSnapshotTest-150382642 None] Acquiring lock "cinder-quobyte-ee74ad61-8def-4b31-9602-61b4fb79bb51" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:01:46 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-86255beb-b2fa-4f38-946d-5883b72aad7f tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "cinder-quobyte-ee74ad61-8def-4b31-9602-61b4fb79bb51" acquired by "delete_volume" :: waited 0.031s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:01:46 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b18c34a-7fd3-43ce-8522-a5e97e005527]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:01:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-86255beb-b2fa-4f38-946d-5883b72aad7f tempest-CreateVolumesFromSnapshotTest-150382642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee74ad61-8def-4b31-9602-61b4fb79bb51 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:46 devstack sudo[106648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee74ad61-8def-4b31-9602-61b4fb79bb51
Jul 10 13:01:46 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:46 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-761afa6e-3e13-478f-96fd-30194c7957db tempest-CreateVolumesFromSnapshotTest-150382642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.755s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:46 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-761afa6e-3e13-478f-96fd-30194c7957db tempest-CreateVolumesFromSnapshotTest-150382642 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:01:46 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-761afa6e-3e13-478f-96fd-30194c7957db tempest-CreateVolumesFromSnapshotTest-150382642 None] Deleted volume successfully.
Jul 10 13:01:46 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-761afa6e-3e13-478f-96fd-30194c7957db tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "cinder-8cb73387-63c8-41b3-b3a8-945f3e597d22-delete_volume" released by "delete_volume" :: held 2.832s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:01:46 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e271c169-121f-47ba-9c2b-4283de5411cb tempest-ProjectReaderTests-237990147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1b5d2c9f-42f7-4776-81b2-b70835407281" returned: 0 in 0.705s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:46 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-e271c169-121f-47ba-9c2b-4283de5411cb tempest-ProjectReaderTests-237990147 None] <== create_volume: return (2022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 13:01:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e271c169-121f-47ba-9c2b-4283de5411cb tempest-ProjectReaderTests-237990147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.024s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:01:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-dc3d9c0f-881e-4361-82f9-70b3db1723ee tempest-ProjectReaderTests-1805919051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.885s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:01:46 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e271c169-121f-47ba-9c2b-4283de5411cb tempest-ProjectReaderTests-237990147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30ff1f5f-4995-41e2-a91a-0cd6c887506b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b5d2c9f-42f7-4776-81b2-b70835407281', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:46 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e271c169-121f-47ba-9c2b-4283de5411cb tempest-ProjectReaderTests-237990147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e94cbab-5a4c-4eb6-b75a-0bd26402841d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:46 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-dc3d9c0f-881e-4361-82f9-70b3db1723ee tempest-ProjectReaderTests-1805919051 None] Creating offline snapshot 4f28e717-440a-405d-a859-4ab84f4df368 of volume 2876be77-15ef-4731-a7d4-b2812ee2764f {{(pid=87378) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 10 13:01:46 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-e271c169-121f-47ba-9c2b-4283de5411cb tempest-ProjectReaderTests-237990147 None] Volume volume-1b5d2c9f-42f7-4776-81b2-b70835407281 (1b5d2c9f-42f7-4776-81b2-b70835407281): created successfully
Jul 10 13:01:46 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e271c169-121f-47ba-9c2b-4283de5411cb tempest-ProjectReaderTests-237990147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e94cbab-5a4c-4eb6-b75a-0bd26402841d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:46 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-e271c169-121f-47ba-9c2b-4283de5411cb tempest-ProjectReaderTests-237990147 None] Flow 'volume_create_manager' (398a4d46-cb0d-49c0-a992-53e8fa4cea36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:01:46 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[844f2756-515e-45ca-a6db-7afe493ec461]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:01:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-dc3d9c0f-881e-4361-82f9-70b3db1723ee tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2876be77-15ef-4731-a7d4-b2812ee2764f {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:46 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-e271c169-121f-47ba-9c2b-4283de5411cb tempest-ProjectReaderTests-237990147 None] Created volume successfully.
Jul 10 13:01:47 devstack sudo[106652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2876be77-15ef-4731-a7d4-b2812ee2764f
Jul 10 13:01:47 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:47 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-86255beb-b2fa-4f38-946d-5883b72aad7f tempest-CreateVolumesFromSnapshotTest-150382642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee74ad61-8def-4b31-9602-61b4fb79bb51" returned: 0 in 0.871s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-86255beb-b2fa-4f38-946d-5883b72aad7f tempest-CreateVolumesFromSnapshotTest-150382642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee74ad61-8def-4b31-9602-61b4fb79bb51 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:47 devstack sudo[106657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee74ad61-8def-4b31-9602-61b4fb79bb51
Jul 10 13:01:47 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:47 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-dc3d9c0f-881e-4361-82f9-70b3db1723ee tempest-ProjectReaderTests-1805919051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2876be77-15ef-4731-a7d4-b2812ee2764f" returned: 0 in 0.889s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-dc3d9c0f-881e-4361-82f9-70b3db1723ee tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2876be77-15ef-4731-a7d4-b2812ee2764f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2876be77-15ef-4731-a7d4-b2812ee2764f.4f28e717-440a-405d-a859-4ab84f4df368 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:47 devstack sudo[106664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2876be77-15ef-4731-a7d4-b2812ee2764f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2876be77-15ef-4731-a7d4-b2812ee2764f.4f28e717-440a-405d-a859-4ab84f4df368 1G
Jul 10 13:01:47 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:47 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-86255beb-b2fa-4f38-946d-5883b72aad7f tempest-CreateVolumesFromSnapshotTest-150382642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee74ad61-8def-4b31-9602-61b4fb79bb51" returned: 0 in 0.731s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:47 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-86255beb-b2fa-4f38-946d-5883b72aad7f tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "cinder-quobyte-ee74ad61-8def-4b31-9602-61b4fb79bb51" released by "delete_volume" :: held 1.676s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:01:48 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-86255beb-b2fa-4f38-946d-5883b72aad7f tempest-CreateVolumesFromSnapshotTest-150382642 None] Created reservations ['ef82da9c-a432-4896-8f58-ad13e31dbf46', '31513c9c-09f7-453c-89b0-6620f4b34fce', '1c5cbb13-4c92-43c5-953e-350e152775c8', '76efd190-c244-40df-a468-dfa2f1b8f0dd'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:01:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-86255beb-b2fa-4f38-946d-5883b72aad7f tempest-CreateVolumesFromSnapshotTest-150382642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:01:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-86255beb-b2fa-4f38-946d-5883b72aad7f tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:01:48 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-86255beb-b2fa-4f38-946d-5883b72aad7f tempest-CreateVolumesFromSnapshotTest-150382642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:01:48 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-86255beb-b2fa-4f38-946d-5883b72aad7f tempest-CreateVolumesFromSnapshotTest-150382642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:01:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-86255beb-b2fa-4f38-946d-5883b72aad7f tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:01:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-86255beb-b2fa-4f38-946d-5883b72aad7f tempest-CreateVolumesFromSnapshotTest-150382642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:48 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-369f5162-8145-41af-b011-6e5589285adb tempest-ProjectReaderTests-237990147 None] Acquiring lock "cinder-1b5d2c9f-42f7-4776-81b2-b70835407281-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:01:48 devstack sudo[106666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:01:48 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:48 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-369f5162-8145-41af-b011-6e5589285adb tempest-ProjectReaderTests-237990147 None] Lock "cinder-1b5d2c9f-42f7-4776-81b2-b70835407281-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:01:48 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-369f5162-8145-41af-b011-6e5589285adb tempest-ProjectReaderTests-237990147 None] Acquiring lock "cinder-quobyte-1b5d2c9f-42f7-4776-81b2-b70835407281" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:01:48 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-369f5162-8145-41af-b011-6e5589285adb tempest-ProjectReaderTests-237990147 None] Lock "cinder-quobyte-1b5d2c9f-42f7-4776-81b2-b70835407281" acquired by "delete_volume" :: waited 0.045s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:01:48 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[da49090f-b617-4d36-8e71-a1d0abcdb8d5]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:01:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-369f5162-8145-41af-b011-6e5589285adb tempest-ProjectReaderTests-237990147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1b5d2c9f-42f7-4776-81b2-b70835407281 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:48 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-61c54633-7d79-4157-a4fe-2de4cb250857 tempest-CreateVolumesFromSnapshotTest-150382642 None] Acquiring lock "cinder-5c2fcb45-6639-4e4e-b60c-be89987509cd-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:01:48 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-61c54633-7d79-4157-a4fe-2de4cb250857 tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "cinder-5c2fcb45-6639-4e4e-b60c-be89987509cd-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:01:48 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-61c54633-7d79-4157-a4fe-2de4cb250857 tempest-CreateVolumesFromSnapshotTest-150382642 None] Acquiring lock "cinder-quobyte-5c2fcb45-6639-4e4e-b60c-be89987509cd" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:01:48 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-61c54633-7d79-4157-a4fe-2de4cb250857 tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "cinder-quobyte-5c2fcb45-6639-4e4e-b60c-be89987509cd" acquired by "delete_volume" :: waited 0.039s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:01:48 devstack sudo[106668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1b5d2c9f-42f7-4776-81b2-b70835407281
Jul 10 13:01:48 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:48 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[23686d19-ebfc-4154-8b67-debe71b56381]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:01:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-61c54633-7d79-4157-a4fe-2de4cb250857 tempest-CreateVolumesFromSnapshotTest-150382642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5c2fcb45-6639-4e4e-b60c-be89987509cd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:48 devstack sudo[106673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5c2fcb45-6639-4e4e-b60c-be89987509cd
Jul 10 13:01:48 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:48 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-dc3d9c0f-881e-4361-82f9-70b3db1723ee tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2876be77-15ef-4731-a7d4-b2812ee2764f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2876be77-15ef-4731-a7d4-b2812ee2764f.4f28e717-440a-405d-a859-4ab84f4df368 1G" returned: 0 in 1.163s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-dc3d9c0f-881e-4361-82f9-70b3db1723ee tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2876be77-15ef-4731-a7d4-b2812ee2764f -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2876be77-15ef-4731-a7d4-b2812ee2764f.4f28e717-440a-405d-a859-4ab84f4df368 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:49 devstack sudo[106676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2876be77-15ef-4731-a7d4-b2812ee2764f -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2876be77-15ef-4731-a7d4-b2812ee2764f.4f28e717-440a-405d-a859-4ab84f4df368
Jul 10 13:01:49 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:49 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-86255beb-b2fa-4f38-946d-5883b72aad7f tempest-CreateVolumesFromSnapshotTest-150382642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 1.076s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:49 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-86255beb-b2fa-4f38-946d-5883b72aad7f tempest-CreateVolumesFromSnapshotTest-150382642 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:01:49 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-86255beb-b2fa-4f38-946d-5883b72aad7f tempest-CreateVolumesFromSnapshotTest-150382642 None] Deleted volume successfully.
Jul 10 13:01:49 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-86255beb-b2fa-4f38-946d-5883b72aad7f tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "cinder-ee74ad61-8def-4b31-9602-61b4fb79bb51-delete_volume" released by "delete_volume" :: held 3.117s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:01:49 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-369f5162-8145-41af-b011-6e5589285adb tempest-ProjectReaderTests-237990147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1b5d2c9f-42f7-4776-81b2-b70835407281" returned: 0 in 1.110s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-369f5162-8145-41af-b011-6e5589285adb tempest-ProjectReaderTests-237990147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1b5d2c9f-42f7-4776-81b2-b70835407281 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:49 devstack sudo[106682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1b5d2c9f-42f7-4776-81b2-b70835407281
Jul 10 13:01:49 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:49 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-61c54633-7d79-4157-a4fe-2de4cb250857 tempest-CreateVolumesFromSnapshotTest-150382642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5c2fcb45-6639-4e4e-b60c-be89987509cd" returned: 0 in 1.206s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-61c54633-7d79-4157-a4fe-2de4cb250857 tempest-CreateVolumesFromSnapshotTest-150382642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5c2fcb45-6639-4e4e-b60c-be89987509cd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:49 devstack sudo[106692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5c2fcb45-6639-4e4e-b60c-be89987509cd
Jul 10 13:01:49 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:49 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-dc3d9c0f-881e-4361-82f9-70b3db1723ee tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2876be77-15ef-4731-a7d4-b2812ee2764f -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2876be77-15ef-4731-a7d4-b2812ee2764f.4f28e717-440a-405d-a859-4ab84f4df368" returned: 0 in 1.024s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:49 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-dc3d9c0f-881e-4361-82f9-70b3db1723ee tempest-ProjectReaderTests-1805919051 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2876be77-15ef-4731-a7d4-b2812ee2764f.4f28e717-440a-405d-a859-4ab84f4df368 is being set with open permissions: ugo+rw
Jul 10 13:01:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-dc3d9c0f-881e-4361-82f9-70b3db1723ee tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2876be77-15ef-4731-a7d4-b2812ee2764f.4f28e717-440a-405d-a859-4ab84f4df368 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:50 devstack sudo[106694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2876be77-15ef-4731-a7d4-b2812ee2764f.4f28e717-440a-405d-a859-4ab84f4df368
Jul 10 13:01:50 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:50 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-369f5162-8145-41af-b011-6e5589285adb tempest-ProjectReaderTests-237990147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1b5d2c9f-42f7-4776-81b2-b70835407281" returned: 0 in 0.973s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:50 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-369f5162-8145-41af-b011-6e5589285adb tempest-ProjectReaderTests-237990147 None] Lock "cinder-quobyte-1b5d2c9f-42f7-4776-81b2-b70835407281" released by "delete_volume" :: held 2.134s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:01:50 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-369f5162-8145-41af-b011-6e5589285adb tempest-ProjectReaderTests-237990147 None] Created reservations ['173f56c5-60d3-4307-9116-cd037134bfae', '9ee381fd-44d2-420d-8028-d0da70dde7f4', '2fb8a225-fc97-4cdd-89ff-19eb7fd7dc76', 'f419561c-ba8c-4e72-95cf-e7f8a9e8ccca'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:01:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-369f5162-8145-41af-b011-6e5589285adb tempest-ProjectReaderTests-237990147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:01:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-369f5162-8145-41af-b011-6e5589285adb tempest-ProjectReaderTests-237990147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:01:50 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-369f5162-8145-41af-b011-6e5589285adb tempest-ProjectReaderTests-237990147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:01:50 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-369f5162-8145-41af-b011-6e5589285adb tempest-ProjectReaderTests-237990147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:01:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-369f5162-8145-41af-b011-6e5589285adb tempest-ProjectReaderTests-237990147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:01:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-369f5162-8145-41af-b011-6e5589285adb tempest-ProjectReaderTests-237990147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:50 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-61c54633-7d79-4157-a4fe-2de4cb250857 tempest-CreateVolumesFromSnapshotTest-150382642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5c2fcb45-6639-4e4e-b60c-be89987509cd" returned: 0 in 0.826s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:50 devstack sudo[106698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:01:50 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:50 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-61c54633-7d79-4157-a4fe-2de4cb250857 tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "cinder-quobyte-5c2fcb45-6639-4e4e-b60c-be89987509cd" released by "delete_volume" :: held 2.083s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:01:50 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-61c54633-7d79-4157-a4fe-2de4cb250857 tempest-CreateVolumesFromSnapshotTest-150382642 None] Created reservations ['0e272bb2-1c42-457f-a494-8d1650c53f67', '2a5e1f0d-cbcb-4d02-ba6a-b785a9a670bf', '18f92fe8-cb60-4719-ac7c-de4b95d2f525', '05477051-8710-401c-96e2-ca1dc750a67a'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:01:50 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-dc3d9c0f-881e-4361-82f9-70b3db1723ee tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2876be77-15ef-4731-a7d4-b2812ee2764f.4f28e717-440a-405d-a859-4ab84f4df368" returned: 0 in 0.855s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-61c54633-7d79-4157-a4fe-2de4cb250857 tempest-CreateVolumesFromSnapshotTest-150382642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:01:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-61c54633-7d79-4157-a4fe-2de4cb250857 tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:01:50 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-61c54633-7d79-4157-a4fe-2de4cb250857 tempest-CreateVolumesFromSnapshotTest-150382642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:01:50 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-61c54633-7d79-4157-a4fe-2de4cb250857 tempest-CreateVolumesFromSnapshotTest-150382642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:01:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-61c54633-7d79-4157-a4fe-2de4cb250857 tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:01:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-61c54633-7d79-4157-a4fe-2de4cb250857 tempest-CreateVolumesFromSnapshotTest-150382642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-dc3d9c0f-881e-4361-82f9-70b3db1723ee tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2876be77-15ef-4731-a7d4-b2812ee2764f.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:50 devstack sudo[106701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:01:50 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:50 devstack sudo[106702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2876be77-15ef-4731-a7d4-b2812ee2764f.info
Jul 10 13:01:50 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:51 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-369f5162-8145-41af-b011-6e5589285adb tempest-ProjectReaderTests-237990147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.937s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:51 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-369f5162-8145-41af-b011-6e5589285adb tempest-ProjectReaderTests-237990147 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:01:51 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-369f5162-8145-41af-b011-6e5589285adb tempest-ProjectReaderTests-237990147 None] Deleted volume successfully.
Jul 10 13:01:51 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-369f5162-8145-41af-b011-6e5589285adb tempest-ProjectReaderTests-237990147 None] Lock "cinder-1b5d2c9f-42f7-4776-81b2-b70835407281-delete_volume" released by "delete_volume" :: held 3.443s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:01:51 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-dc3d9c0f-881e-4361-82f9-70b3db1723ee tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2876be77-15ef-4731-a7d4-b2812ee2764f.info" returned: 0 in 0.764s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:51 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-dc3d9c0f-881e-4361-82f9-70b3db1723ee tempest-ProjectReaderTests-1805919051 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2876be77-15ef-4731-a7d4-b2812ee2764f.info is being set with open permissions: ugo+rw
Jul 10 13:01:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-dc3d9c0f-881e-4361-82f9-70b3db1723ee tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2876be77-15ef-4731-a7d4-b2812ee2764f.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:51 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-61c54633-7d79-4157-a4fe-2de4cb250857 tempest-CreateVolumesFromSnapshotTest-150382642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.833s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:51 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-61c54633-7d79-4157-a4fe-2de4cb250857 tempest-CreateVolumesFromSnapshotTest-150382642 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:01:51 devstack sudo[106708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2876be77-15ef-4731-a7d4-b2812ee2764f.info
Jul 10 13:01:51 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:51 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-61c54633-7d79-4157-a4fe-2de4cb250857 tempest-CreateVolumesFromSnapshotTest-150382642 None] Deleted volume successfully.
Jul 10 13:01:51 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-61c54633-7d79-4157-a4fe-2de4cb250857 tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "cinder-5c2fcb45-6639-4e4e-b60c-be89987509cd-delete_volume" released by "delete_volume" :: held 3.253s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:01:51 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-18be1008-d337-4090-afaf-b88c866c0dcc tempest-CreateVolumesFromSnapshotTest-150382642 None] Acquiring lock "cinder-589e646c-5dad-48e3-a605-c9358afad287-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:01:51 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-18be1008-d337-4090-afaf-b88c866c0dcc tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "cinder-589e646c-5dad-48e3-a605-c9358afad287-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:01:51 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-18be1008-d337-4090-afaf-b88c866c0dcc tempest-CreateVolumesFromSnapshotTest-150382642 None] Acquiring lock "cinder-quobyte-589e646c-5dad-48e3-a605-c9358afad287" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:01:51 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-18be1008-d337-4090-afaf-b88c866c0dcc tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "cinder-quobyte-589e646c-5dad-48e3-a605-c9358afad287" acquired by "delete_volume" :: waited 0.020s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:01:52 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[533c7bda-fec3-4446-b310-d66e62596173]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:01:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-18be1008-d337-4090-afaf-b88c866c0dcc tempest-CreateVolumesFromSnapshotTest-150382642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-589e646c-5dad-48e3-a605-c9358afad287 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:52 devstack sudo[106710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-589e646c-5dad-48e3-a605-c9358afad287
Jul 10 13:01:52 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:52 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ab01311-bc58-4918-b70e-3da101c8ad80 tempest-ProjectReaderTests-237990147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 13:01:52 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0ab01311-bc58-4918-b70e-3da101c8ad80 tempest-ProjectReaderTests-237990147 None] Flow 'volume_create_manager' (f1558ead-bb1d-494a-ab94-f4440b61be24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:01:52 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0ab01311-bc58-4918-b70e-3da101c8ad80 tempest-ProjectReaderTests-237990147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f014cca-259b-4346-bde0-b6219f1602d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:52 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0ab01311-bc58-4918-b70e-3da101c8ad80 tempest-ProjectReaderTests-237990147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f014cca-259b-4346-bde0-b6219f1602d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1796555932',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d077793-f5e9-4522-ab4f-4dd5aaf35490,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5908b48827b94c09886b81d755ab3c09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:01:52Z,use_quota=True,user_id='f089be7940884cdc9783d9c7bd5a3408',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:52 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0ab01311-bc58-4918-b70e-3da101c8ad80 tempest-ProjectReaderTests-237990147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (299e10c1-c928-4a1f-bb9c-503ac05130c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:52 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0ab01311-bc58-4918-b70e-3da101c8ad80 tempest-ProjectReaderTests-237990147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (299e10c1-c928-4a1f-bb9c-503ac05130c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:52 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0ab01311-bc58-4918-b70e-3da101c8ad80 tempest-ProjectReaderTests-237990147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a03bba8-4683-409c-97c3-76df060ef1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:52 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0ab01311-bc58-4918-b70e-3da101c8ad80 tempest-ProjectReaderTests-237990147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a03bba8-4683-409c-97c3-76df060ef1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d077793-f5e9-4522-ab4f-4dd5aaf35490', 'volume_name': 'volume-5d077793-f5e9-4522-ab4f-4dd5aaf35490', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:52 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0ab01311-bc58-4918-b70e-3da101c8ad80 tempest-ProjectReaderTests-237990147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23327aff-cf9d-48c9-9c3b-4bc26445d970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:52 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0ab01311-bc58-4918-b70e-3da101c8ad80 tempest-ProjectReaderTests-237990147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23327aff-cf9d-48c9-9c3b-4bc26445d970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:52 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0ab01311-bc58-4918-b70e-3da101c8ad80 tempest-ProjectReaderTests-237990147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43d84956-9527-4ced-94a0-eaa552e8d7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:52 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-0ab01311-bc58-4918-b70e-3da101c8ad80 tempest-ProjectReaderTests-237990147 None] Volume 5d077793-f5e9-4522-ab4f-4dd5aaf35490: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d077793-f5e9-4522-ab4f-4dd5aaf35490', 'volume_size': 1}
Jul 10 13:01:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0ab01311-bc58-4918-b70e-3da101c8ad80 tempest-ProjectReaderTests-237990147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:01:52 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-dc3d9c0f-881e-4361-82f9-70b3db1723ee tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2876be77-15ef-4731-a7d4-b2812ee2764f.info" returned: 0 in 0.876s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-dc3d9c0f-881e-4361-82f9-70b3db1723ee tempest-ProjectReaderTests-1805919051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.721s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:01:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0ab01311-bc58-4918-b70e-3da101c8ad80 tempest-ProjectReaderTests-237990147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.296s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:01:52 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-0ab01311-bc58-4918-b70e-3da101c8ad80 tempest-ProjectReaderTests-237990147 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1796555932',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d077793-f5e9-4522-ab4f-4dd5aaf35490,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5908b48827b94c09886b81d755ab3c09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:01:52Z,use_quota=True,user_id='f089be7940884cdc9783d9c7bd5a3408',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 13:01:52 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-0ab01311-bc58-4918-b70e-3da101c8ad80 tempest-ProjectReaderTests-237990147 None] Creating volume 5d077793-f5e9-4522-ab4f-4dd5aaf35490 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 13:01:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0ab01311-bc58-4918-b70e-3da101c8ad80 tempest-ProjectReaderTests-237990147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:01:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0ab01311-bc58-4918-b70e-3da101c8ad80 tempest-ProjectReaderTests-237990147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:01:52 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-0ab01311-bc58-4918-b70e-3da101c8ad80 tempest-ProjectReaderTests-237990147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:01:52 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-0ab01311-bc58-4918-b70e-3da101c8ad80 tempest-ProjectReaderTests-237990147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:01:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0ab01311-bc58-4918-b70e-3da101c8ad80 tempest-ProjectReaderTests-237990147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:01:52 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-0ab01311-bc58-4918-b70e-3da101c8ad80 tempest-ProjectReaderTests-237990147 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 13:01:52 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-0ab01311-bc58-4918-b70e-3da101c8ad80 tempest-ProjectReaderTests-237990147 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 13:01:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0ab01311-bc58-4918-b70e-3da101c8ad80 tempest-ProjectReaderTests-237990147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d077793-f5e9-4522-ab4f-4dd5aaf35490 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:52 devstack sudo[106713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d077793-f5e9-4522-ab4f-4dd5aaf35490 1073741824
Jul 10 13:01:52 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:52 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-dc3d9c0f-881e-4361-82f9-70b3db1723ee tempest-ProjectReaderTests-1805919051 None] Create snapshot completed successfully
Jul 10 13:01:52 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-18be1008-d337-4090-afaf-b88c866c0dcc tempest-CreateVolumesFromSnapshotTest-150382642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-589e646c-5dad-48e3-a605-c9358afad287" returned: 0 in 0.930s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-18be1008-d337-4090-afaf-b88c866c0dcc tempest-CreateVolumesFromSnapshotTest-150382642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-589e646c-5dad-48e3-a605-c9358afad287 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:52 devstack sudo[106718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-589e646c-5dad-48e3-a605-c9358afad287
Jul 10 13:01:52 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:53 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-49f4fbce-230d-4bd1-ab67-85de9c6aab6a tempest-ProjectReaderTests-1805919051 None] Acquiring lock "cinder-4f28e717-440a-405d-a859-4ab84f4df368-delete_snapshot" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:01:53 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-49f4fbce-230d-4bd1-ab67-85de9c6aab6a tempest-ProjectReaderTests-1805919051 None] Lock "cinder-4f28e717-440a-405d-a859-4ab84f4df368-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:01:53 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-49f4fbce-230d-4bd1-ab67-85de9c6aab6a tempest-ProjectReaderTests-1805919051 None] Acquiring lock "cinder-quobyte-2876be77-15ef-4731-a7d4-b2812ee2764f" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:01:53 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-49f4fbce-230d-4bd1-ab67-85de9c6aab6a tempest-ProjectReaderTests-1805919051 None] Lock "cinder-quobyte-2876be77-15ef-4731-a7d4-b2812ee2764f" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:01:53 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-49f4fbce-230d-4bd1-ab67-85de9c6aab6a tempest-ProjectReaderTests-1805919051 None] Acquiring lock "cinder-quobyte-4f28e717-440a-405d-a859-4ab84f4df368" by "_delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:01:53 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-18be1008-d337-4090-afaf-b88c866c0dcc tempest-CreateVolumesFromSnapshotTest-150382642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-589e646c-5dad-48e3-a605-c9358afad287" returned: 0 in 0.768s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:53 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-49f4fbce-230d-4bd1-ab67-85de9c6aab6a tempest-ProjectReaderTests-1805919051 None] Lock "cinder-quobyte-4f28e717-440a-405d-a859-4ab84f4df368" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:01:53 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-49f4fbce-230d-4bd1-ab67-85de9c6aab6a tempest-ProjectReaderTests-1805919051 None] Deleting offline snapshot 4f28e717-440a-405d-a859-4ab84f4df368 of volume 2876be77-15ef-4731-a7d4-b2812ee2764f {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 10 13:01:53 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-49f4fbce-230d-4bd1-ab67-85de9c6aab6a tempest-ProjectReaderTests-1805919051 None] snapshot_file for this snap is: volume-2876be77-15ef-4731-a7d4-b2812ee2764f.4f28e717-440a-405d-a859-4ab84f4df368 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 10 13:01:53 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-18be1008-d337-4090-afaf-b88c866c0dcc tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "cinder-quobyte-589e646c-5dad-48e3-a605-c9358afad287" released by "delete_volume" :: held 1.799s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:01:53 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0ab01311-bc58-4918-b70e-3da101c8ad80 tempest-ProjectReaderTests-237990147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d077793-f5e9-4522-ab4f-4dd5aaf35490 1073741824" returned: 0 in 1.122s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:53 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[36eac787-1901-4bcc-ad74-f5ab66fa636e]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:01:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-49f4fbce-230d-4bd1-ab67-85de9c6aab6a tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2876be77-15ef-4731-a7d4-b2812ee2764f.4f28e717-440a-405d-a859-4ab84f4df368 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0ab01311-bc58-4918-b70e-3da101c8ad80 tempest-ProjectReaderTests-237990147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d077793-f5e9-4522-ab4f-4dd5aaf35490 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:53 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-18be1008-d337-4090-afaf-b88c866c0dcc tempest-CreateVolumesFromSnapshotTest-150382642 None] Created reservations ['6e9b6653-b0b4-4c60-b675-9decf0ae8e46', 'e53d6231-76aa-4bcc-923d-31eb88ab4750', '1fca8945-1064-4a25-82ae-a1b4fd35a606', 'ef7daaee-a866-4e95-b181-ae6b1bf29dc2'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:01:53 devstack sudo[106726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d077793-f5e9-4522-ab4f-4dd5aaf35490
Jul 10 13:01:53 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:53 devstack sudo[106725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2876be77-15ef-4731-a7d4-b2812ee2764f.4f28e717-440a-405d-a859-4ab84f4df368
Jul 10 13:01:53 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-18be1008-d337-4090-afaf-b88c866c0dcc tempest-CreateVolumesFromSnapshotTest-150382642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:01:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-18be1008-d337-4090-afaf-b88c866c0dcc tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:01:53 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-18be1008-d337-4090-afaf-b88c866c0dcc tempest-CreateVolumesFromSnapshotTest-150382642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:01:53 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-18be1008-d337-4090-afaf-b88c866c0dcc tempest-CreateVolumesFromSnapshotTest-150382642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:01:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-18be1008-d337-4090-afaf-b88c866c0dcc tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:01:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-18be1008-d337-4090-afaf-b88c866c0dcc tempest-CreateVolumesFromSnapshotTest-150382642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:54 devstack sudo[106729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:01:54 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:54 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8d3bd590-5766-429f-9b8c-8bee717c774e tempest-CreateVolumesFromSnapshotTest-150382642 None] Acquiring lock "cinder-427e3b87-b55a-4687-ab0d-8ea3e7c37fb9-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:01:54 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8d3bd590-5766-429f-9b8c-8bee717c774e tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "cinder-427e3b87-b55a-4687-ab0d-8ea3e7c37fb9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:01:54 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8d3bd590-5766-429f-9b8c-8bee717c774e tempest-CreateVolumesFromSnapshotTest-150382642 None] Acquiring lock "cinder-quobyte-427e3b87-b55a-4687-ab0d-8ea3e7c37fb9" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:01:54 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8d3bd590-5766-429f-9b8c-8bee717c774e tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "cinder-quobyte-427e3b87-b55a-4687-ab0d-8ea3e7c37fb9" acquired by "delete_volume" :: waited 0.023s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:01:54 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee7fd0e-21ed-47dc-b310-142a7ba71e96]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:01:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8d3bd590-5766-429f-9b8c-8bee717c774e tempest-CreateVolumesFromSnapshotTest-150382642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-427e3b87-b55a-4687-ab0d-8ea3e7c37fb9 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:54 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a615f1b-84d4-4888-8773-eb180f57c4e7 tempest-SnapshotDependencyTests-1971894314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 13:01:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2a615f1b-84d4-4888-8773-eb180f57c4e7 tempest-SnapshotDependencyTests-1971894314 None] Flow 'volume_create_manager' (cad8e906-55c6-48ab-a705-d6f68128f011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:01:54 devstack sudo[106731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-427e3b87-b55a-4687-ab0d-8ea3e7c37fb9
Jul 10 13:01:54 devstack sudo[106731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2a615f1b-84d4-4888-8773-eb180f57c4e7 tempest-SnapshotDependencyTests-1971894314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (111be1d6-b98b-49da-a998-641017bc7f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2a615f1b-84d4-4888-8773-eb180f57c4e7 tempest-SnapshotDependencyTests-1971894314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (111be1d6-b98b-49da-a998-641017bc7f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:01:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1834648298',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f85f4dbe-42fa-4fc9-85a9-2a3f3f362359,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db01860b01fe4dfdabd1d2a0adf0646e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:01:54Z,use_quota=True,user_id='9a5bb7fcfbc44fe69cbf870c1d28fb1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2a615f1b-84d4-4888-8773-eb180f57c4e7 tempest-SnapshotDependencyTests-1971894314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (580d245b-196d-4dd7-984b-24264ba496da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2a615f1b-84d4-4888-8773-eb180f57c4e7 tempest-SnapshotDependencyTests-1971894314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (580d245b-196d-4dd7-984b-24264ba496da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2a615f1b-84d4-4888-8773-eb180f57c4e7 tempest-SnapshotDependencyTests-1971894314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41ac8809-74c1-43df-8635-6ccba1c57d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2a615f1b-84d4-4888-8773-eb180f57c4e7 tempest-SnapshotDependencyTests-1971894314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41ac8809-74c1-43df-8635-6ccba1c57d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f85f4dbe-42fa-4fc9-85a9-2a3f3f362359', 'volume_name': 'volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2a615f1b-84d4-4888-8773-eb180f57c4e7 tempest-SnapshotDependencyTests-1971894314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd65e73a-c383-4923-ab2e-ce62abbe1082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2a615f1b-84d4-4888-8773-eb180f57c4e7 tempest-SnapshotDependencyTests-1971894314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd65e73a-c383-4923-ab2e-ce62abbe1082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2a615f1b-84d4-4888-8773-eb180f57c4e7 tempest-SnapshotDependencyTests-1971894314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b9d53b1-655d-4983-af88-6df4e2f3fe86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:54 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-2a615f1b-84d4-4888-8773-eb180f57c4e7 tempest-SnapshotDependencyTests-1971894314 None] Volume f85f4dbe-42fa-4fc9-85a9-2a3f3f362359: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359', 'volume_size': 1}
Jul 10 13:01:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2a615f1b-84d4-4888-8773-eb180f57c4e7 tempest-SnapshotDependencyTests-1971894314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:01:54 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-18be1008-d337-4090-afaf-b88c866c0dcc tempest-CreateVolumesFromSnapshotTest-150382642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.800s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:54 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-18be1008-d337-4090-afaf-b88c866c0dcc tempest-CreateVolumesFromSnapshotTest-150382642 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:01:54 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-18be1008-d337-4090-afaf-b88c866c0dcc tempest-CreateVolumesFromSnapshotTest-150382642 None] Deleted volume successfully.
Jul 10 13:01:54 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-18be1008-d337-4090-afaf-b88c866c0dcc tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "cinder-589e646c-5dad-48e3-a605-c9358afad287-delete_volume" released by "delete_volume" :: held 2.916s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:01:54 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-49f4fbce-230d-4bd1-ab67-85de9c6aab6a tempest-ProjectReaderTests-1805919051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2876be77-15ef-4731-a7d4-b2812ee2764f.4f28e717-440a-405d-a859-4ab84f4df368" returned: 0 in 1.059s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:54 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-49f4fbce-230d-4bd1-ab67-85de9c6aab6a tempest-ProjectReaderTests-1805919051 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2876be77-15ef-4731-a7d4-b2812ee2764f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 13:01:54 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0ab01311-bc58-4918-b70e-3da101c8ad80 tempest-ProjectReaderTests-237990147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d077793-f5e9-4522-ab4f-4dd5aaf35490" returned: 0 in 1.027s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:54 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-0ab01311-bc58-4918-b70e-3da101c8ad80 tempest-ProjectReaderTests-237990147 None] <== create_volume: return (2227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 13:01:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0ab01311-bc58-4918-b70e-3da101c8ad80 tempest-ProjectReaderTests-237990147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.232s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:01:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2a615f1b-84d4-4888-8773-eb180f57c4e7 tempest-SnapshotDependencyTests-1971894314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.232s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:01:54 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-2a615f1b-84d4-4888-8773-eb180f57c4e7 tempest-SnapshotDependencyTests-1971894314 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:01:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1834648298',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f85f4dbe-42fa-4fc9-85a9-2a3f3f362359,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db01860b01fe4dfdabd1d2a0adf0646e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:01:54Z,use_quota=True,user_id='9a5bb7fcfbc44fe69cbf870c1d28fb1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 13:01:54 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-2a615f1b-84d4-4888-8773-eb180f57c4e7 tempest-SnapshotDependencyTests-1971894314 None] Creating volume f85f4dbe-42fa-4fc9-85a9-2a3f3f362359 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 13:01:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2a615f1b-84d4-4888-8773-eb180f57c4e7 tempest-SnapshotDependencyTests-1971894314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:01:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2a615f1b-84d4-4888-8773-eb180f57c4e7 tempest-SnapshotDependencyTests-1971894314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:01:54 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-2a615f1b-84d4-4888-8773-eb180f57c4e7 tempest-SnapshotDependencyTests-1971894314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:01:54 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-2a615f1b-84d4-4888-8773-eb180f57c4e7 tempest-SnapshotDependencyTests-1971894314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:01:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2a615f1b-84d4-4888-8773-eb180f57c4e7 tempest-SnapshotDependencyTests-1971894314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:01:54 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-2a615f1b-84d4-4888-8773-eb180f57c4e7 tempest-SnapshotDependencyTests-1971894314 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 13:01:54 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-2a615f1b-84d4-4888-8773-eb180f57c4e7 tempest-SnapshotDependencyTests-1971894314 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 13:01:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2a615f1b-84d4-4888-8773-eb180f57c4e7 tempest-SnapshotDependencyTests-1971894314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:54 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d7d1c6-ff30-4f2e-8063-4d54a89a2d31]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:01:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-49f4fbce-230d-4bd1-ab67-85de9c6aab6a tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2876be77-15ef-4731-a7d4-b2812ee2764f {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:54 devstack sudo[106739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359 1073741824
Jul 10 13:01:54 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0ab01311-bc58-4918-b70e-3da101c8ad80 tempest-ProjectReaderTests-237990147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43d84956-9527-4ced-94a0-eaa552e8d7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d077793-f5e9-4522-ab4f-4dd5aaf35490', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0ab01311-bc58-4918-b70e-3da101c8ad80 tempest-ProjectReaderTests-237990147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7116ab44-26e1-44cf-8a17-60242e18fa42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:54 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-0ab01311-bc58-4918-b70e-3da101c8ad80 tempest-ProjectReaderTests-237990147 None] Volume volume-5d077793-f5e9-4522-ab4f-4dd5aaf35490 (5d077793-f5e9-4522-ab4f-4dd5aaf35490): created successfully
Jul 10 13:01:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0ab01311-bc58-4918-b70e-3da101c8ad80 tempest-ProjectReaderTests-237990147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7116ab44-26e1-44cf-8a17-60242e18fa42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-0ab01311-bc58-4918-b70e-3da101c8ad80 tempest-ProjectReaderTests-237990147 None] Flow 'volume_create_manager' (f1558ead-bb1d-494a-ab94-f4440b61be24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:01:54 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-0ab01311-bc58-4918-b70e-3da101c8ad80 tempest-ProjectReaderTests-237990147 None] Created volume successfully.
Jul 10 13:01:55 devstack sudo[106740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2876be77-15ef-4731-a7d4-b2812ee2764f
Jul 10 13:01:55 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:55 devstack sudo[106731]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8d3bd590-5766-429f-9b8c-8bee717c774e tempest-CreateVolumesFromSnapshotTest-150382642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-427e3b87-b55a-4687-ab0d-8ea3e7c37fb9" returned: 0 in 0.926s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8d3bd590-5766-429f-9b8c-8bee717c774e tempest-CreateVolumesFromSnapshotTest-150382642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-427e3b87-b55a-4687-ab0d-8ea3e7c37fb9 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:55 devstack sudo[106746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-427e3b87-b55a-4687-ab0d-8ea3e7c37fb9
Jul 10 13:01:55 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:55 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-bc629780-5db3-407e-a9cf-c0afee649dce tempest-ProjectReaderTests-237990147 None] Acquiring lock "cinder-5d077793-f5e9-4522-ab4f-4dd5aaf35490-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:01:55 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-bc629780-5db3-407e-a9cf-c0afee649dce tempest-ProjectReaderTests-237990147 None] Lock "cinder-5d077793-f5e9-4522-ab4f-4dd5aaf35490-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:01:55 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-bc629780-5db3-407e-a9cf-c0afee649dce tempest-ProjectReaderTests-237990147 None] Acquiring lock "cinder-quobyte-5d077793-f5e9-4522-ab4f-4dd5aaf35490" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:01:55 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-bc629780-5db3-407e-a9cf-c0afee649dce tempest-ProjectReaderTests-237990147 None] Lock "cinder-quobyte-5d077793-f5e9-4522-ab4f-4dd5aaf35490" acquired by "delete_volume" :: waited 0.015s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:01:55 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef31bf9e-ddaf-4937-a099-cb423cc88b18]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:01:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-bc629780-5db3-407e-a9cf-c0afee649dce tempest-ProjectReaderTests-237990147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d077793-f5e9-4522-ab4f-4dd5aaf35490 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:55 devstack sudo[106755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d077793-f5e9-4522-ab4f-4dd5aaf35490
Jul 10 13:01:55 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:55 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-49f4fbce-230d-4bd1-ab67-85de9c6aab6a tempest-ProjectReaderTests-1805919051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2876be77-15ef-4731-a7d4-b2812ee2764f" returned: 0 in 0.925s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-49f4fbce-230d-4bd1-ab67-85de9c6aab6a tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2876be77-15ef-4731-a7d4-b2812ee2764f.4f28e717-440a-405d-a859-4ab84f4df368 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:55 devstack sudo[106757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2876be77-15ef-4731-a7d4-b2812ee2764f.4f28e717-440a-405d-a859-4ab84f4df368
Jul 10 13:01:55 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:55 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2a615f1b-84d4-4888-8773-eb180f57c4e7 tempest-SnapshotDependencyTests-1971894314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359 1073741824" returned: 0 in 0.977s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2a615f1b-84d4-4888-8773-eb180f57c4e7 tempest-SnapshotDependencyTests-1971894314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:55 devstack sudo[106759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359
Jul 10 13:01:55 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:56 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8d3bd590-5766-429f-9b8c-8bee717c774e tempest-CreateVolumesFromSnapshotTest-150382642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-427e3b87-b55a-4687-ab0d-8ea3e7c37fb9" returned: 0 in 0.802s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:56 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8d3bd590-5766-429f-9b8c-8bee717c774e tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "cinder-quobyte-427e3b87-b55a-4687-ab0d-8ea3e7c37fb9" released by "delete_volume" :: held 1.804s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:01:56 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-8d3bd590-5766-429f-9b8c-8bee717c774e tempest-CreateVolumesFromSnapshotTest-150382642 None] Created reservations ['9cd7deb5-6b02-4d11-961c-7a9e87951e5a', 'a0ae7c2d-c284-49f2-b10c-1a7d3c775146', '376ebd4d-d375-4b56-8b5f-fe80e7ed12b7', 'e79db585-943f-42c0-bdbe-0b1f39baa722'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:01:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-8d3bd590-5766-429f-9b8c-8bee717c774e tempest-CreateVolumesFromSnapshotTest-150382642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:01:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-8d3bd590-5766-429f-9b8c-8bee717c774e tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:01:56 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-8d3bd590-5766-429f-9b8c-8bee717c774e tempest-CreateVolumesFromSnapshotTest-150382642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:01:56 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-8d3bd590-5766-429f-9b8c-8bee717c774e tempest-CreateVolumesFromSnapshotTest-150382642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:01:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-8d3bd590-5766-429f-9b8c-8bee717c774e tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:01:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8d3bd590-5766-429f-9b8c-8bee717c774e tempest-CreateVolumesFromSnapshotTest-150382642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:56 devstack sudo[106762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:01:56 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:56 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-dc72fcdd-499a-4ab5-a94d-a9766e42fdf0 tempest-CreateVolumesFromSnapshotTest-150382642 None] Acquiring lock "cinder-c91ad715-c3db-4d99-bfeb-1e9bb83ecac8-delete_snapshot" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:01:56 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-dc72fcdd-499a-4ab5-a94d-a9766e42fdf0 tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "cinder-c91ad715-c3db-4d99-bfeb-1e9bb83ecac8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:01:56 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-dc72fcdd-499a-4ab5-a94d-a9766e42fdf0 tempest-CreateVolumesFromSnapshotTest-150382642 None] Acquiring lock "cinder-quobyte-e1cad374-d781-49ce-826f-8f2ce5c6e08d" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:01:56 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-dc72fcdd-499a-4ab5-a94d-a9766e42fdf0 tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "cinder-quobyte-e1cad374-d781-49ce-826f-8f2ce5c6e08d" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:01:56 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-dc72fcdd-499a-4ab5-a94d-a9766e42fdf0 tempest-CreateVolumesFromSnapshotTest-150382642 None] Acquiring lock "cinder-quobyte-c91ad715-c3db-4d99-bfeb-1e9bb83ecac8" by "_delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:01:56 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-dc72fcdd-499a-4ab5-a94d-a9766e42fdf0 tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "cinder-quobyte-c91ad715-c3db-4d99-bfeb-1e9bb83ecac8" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:01:56 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-dc72fcdd-499a-4ab5-a94d-a9766e42fdf0 tempest-CreateVolumesFromSnapshotTest-150382642 None] Deleting offline snapshot c91ad715-c3db-4d99-bfeb-1e9bb83ecac8 of volume e1cad374-d781-49ce-826f-8f2ce5c6e08d {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 10 13:01:56 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-dc72fcdd-499a-4ab5-a94d-a9766e42fdf0 tempest-CreateVolumesFromSnapshotTest-150382642 None] snapshot_file for this snap is: volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d.c91ad715-c3db-4d99-bfeb-1e9bb83ecac8 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 10 13:01:56 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a49a8d-87a7-4985-a6dd-285050754c3a]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:01:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-dc72fcdd-499a-4ab5-a94d-a9766e42fdf0 tempest-CreateVolumesFromSnapshotTest-150382642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d.c91ad715-c3db-4d99-bfeb-1e9bb83ecac8 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:56 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2a615f1b-84d4-4888-8773-eb180f57c4e7 tempest-SnapshotDependencyTests-1971894314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359" returned: 0 in 0.779s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:56 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-2a615f1b-84d4-4888-8773-eb180f57c4e7 tempest-SnapshotDependencyTests-1971894314 None] <== create_volume: return (1806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 13:01:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2a615f1b-84d4-4888-8773-eb180f57c4e7 tempest-SnapshotDependencyTests-1971894314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.811s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:01:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2a615f1b-84d4-4888-8773-eb180f57c4e7 tempest-SnapshotDependencyTests-1971894314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b9d53b1-655d-4983-af88-6df4e2f3fe86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2a615f1b-84d4-4888-8773-eb180f57c4e7 tempest-SnapshotDependencyTests-1971894314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a323baf2-d3bf-427a-a927-e1f09e9d2ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:01:56 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-2a615f1b-84d4-4888-8773-eb180f57c4e7 tempest-SnapshotDependencyTests-1971894314 None] Volume volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359 (f85f4dbe-42fa-4fc9-85a9-2a3f3f362359): created successfully
Jul 10 13:01:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2a615f1b-84d4-4888-8773-eb180f57c4e7 tempest-SnapshotDependencyTests-1971894314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a323baf2-d3bf-427a-a927-e1f09e9d2ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:01:56 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:56 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-2a615f1b-84d4-4888-8773-eb180f57c4e7 tempest-SnapshotDependencyTests-1971894314 None] Flow 'volume_create_manager' (cad8e906-55c6-48ab-a705-d6f68128f011) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:01:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-bc629780-5db3-407e-a9cf-c0afee649dce tempest-ProjectReaderTests-237990147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d077793-f5e9-4522-ab4f-4dd5aaf35490" returned: 0 in 1.092s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-bc629780-5db3-407e-a9cf-c0afee649dce tempest-ProjectReaderTests-237990147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d077793-f5e9-4522-ab4f-4dd5aaf35490 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:56 devstack sudo[106772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d.c91ad715-c3db-4d99-bfeb-1e9bb83ecac8
Jul 10 13:01:56 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:56 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-2a615f1b-84d4-4888-8773-eb180f57c4e7 tempest-SnapshotDependencyTests-1971894314 None] Created volume successfully.
Jul 10 13:01:56 devstack sudo[106774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d077793-f5e9-4522-ab4f-4dd5aaf35490
Jul 10 13:01:56 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:56 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-49f4fbce-230d-4bd1-ab67-85de9c6aab6a tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2876be77-15ef-4731-a7d4-b2812ee2764f.4f28e717-440a-405d-a859-4ab84f4df368" returned: 0 in 1.050s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-49f4fbce-230d-4bd1-ab67-85de9c6aab6a tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2876be77-15ef-4731-a7d4-b2812ee2764f.4f28e717-440a-405d-a859-4ab84f4df368 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:56 devstack sudo[106776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2876be77-15ef-4731-a7d4-b2812ee2764f.4f28e717-440a-405d-a859-4ab84f4df368
Jul 10 13:01:56 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:57 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8d3bd590-5766-429f-9b8c-8bee717c774e tempest-CreateVolumesFromSnapshotTest-150382642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.827s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:57 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-8d3bd590-5766-429f-9b8c-8bee717c774e tempest-CreateVolumesFromSnapshotTest-150382642 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:01:57 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-8d3bd590-5766-429f-9b8c-8bee717c774e tempest-CreateVolumesFromSnapshotTest-150382642 None] Deleted volume successfully.
Jul 10 13:01:57 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8d3bd590-5766-429f-9b8c-8bee717c774e tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "cinder-427e3b87-b55a-4687-ab0d-8ea3e7c37fb9-delete_volume" released by "delete_volume" :: held 2.916s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:01:57 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-dc72fcdd-499a-4ab5-a94d-a9766e42fdf0 tempest-CreateVolumesFromSnapshotTest-150382642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d.c91ad715-c3db-4d99-bfeb-1e9bb83ecac8" returned: 0 in 0.877s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:57 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-dc72fcdd-499a-4ab5-a94d-a9766e42fdf0 tempest-CreateVolumesFromSnapshotTest-150382642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 13:01:57 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f54b554-1071-43ad-9cdd-b02fa9fc0b70]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:01:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-dc72fcdd-499a-4ab5-a94d-a9766e42fdf0 tempest-CreateVolumesFromSnapshotTest-150382642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:57 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-bc629780-5db3-407e-a9cf-c0afee649dce tempest-ProjectReaderTests-237990147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-5d077793-f5e9-4522-ab4f-4dd5aaf35490" returned: 0 in 0.744s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:57 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-bc629780-5db3-407e-a9cf-c0afee649dce tempest-ProjectReaderTests-237990147 None] Lock "cinder-quobyte-5d077793-f5e9-4522-ab4f-4dd5aaf35490" released by "delete_volume" :: held 1.890s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:01:57 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-bc629780-5db3-407e-a9cf-c0afee649dce tempest-ProjectReaderTests-237990147 None] Created reservations ['3475ca81-d9e7-4e82-b550-857c56ea6c48', '4f9d0ffe-5acd-40d4-b7ef-ec523dac0dd7', '7ff23747-92d9-4805-9383-eaa7d0af4d3c', '9a17a09a-0532-4385-912d-4cac3e8ec92f'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:01:57 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-49f4fbce-230d-4bd1-ab67-85de9c6aab6a tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2876be77-15ef-4731-a7d4-b2812ee2764f.4f28e717-440a-405d-a859-4ab84f4df368" returned: 0 in 0.750s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:57 devstack sudo[106785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d
Jul 10 13:01:57 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:57 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-49f4fbce-230d-4bd1-ab67-85de9c6aab6a tempest-ProjectReaderTests-1805919051 None] Lock "cinder-quobyte-4f28e717-440a-405d-a859-4ab84f4df368" released by "_delete_snapshot" :: held 3.939s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:01:57 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-49f4fbce-230d-4bd1-ab67-85de9c6aab6a tempest-ProjectReaderTests-1805919051 None] Lock "cinder-quobyte-2876be77-15ef-4731-a7d4-b2812ee2764f" released by "delete_snapshot" :: held 3.980s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:01:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-bc629780-5db3-407e-a9cf-c0afee649dce tempest-ProjectReaderTests-237990147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:01:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-bc629780-5db3-407e-a9cf-c0afee649dce tempest-ProjectReaderTests-237990147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:01:57 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-bc629780-5db3-407e-a9cf-c0afee649dce tempest-ProjectReaderTests-237990147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:01:57 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-bc629780-5db3-407e-a9cf-c0afee649dce tempest-ProjectReaderTests-237990147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:01:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-bc629780-5db3-407e-a9cf-c0afee649dce tempest-ProjectReaderTests-237990147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:01:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-bc629780-5db3-407e-a9cf-c0afee649dce tempest-ProjectReaderTests-237990147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:57 devstack sudo[106787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:01:57 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:57 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-49f4fbce-230d-4bd1-ab67-85de9c6aab6a tempest-ProjectReaderTests-1805919051 None] Created reservations ['642f6948-af9c-496b-8b4d-7efc742d630a', 'cfc56393-4a74-4e90-a144-d87b9a678326', 'da03e54c-a04b-4ae4-a748-fbbc5c2b6102', '693f5a76-148a-420f-a2eb-5067ae9de674'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:01:57 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-49f4fbce-230d-4bd1-ab67-85de9c6aab6a tempest-ProjectReaderTests-1805919051 None] Delete snapshot completed successfully.
Jul 10 13:01:57 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-49f4fbce-230d-4bd1-ab67-85de9c6aab6a tempest-ProjectReaderTests-1805919051 None] Lock "cinder-4f28e717-440a-405d-a859-4ab84f4df368-delete_snapshot" released by "delete_snapshot" :: held 4.252s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:01:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ca31bce4-066a-4484-84bd-c4d7610a7b37 tempest-SnapshotDependencyTests-1971894314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:01:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ca31bce4-066a-4484-84bd-c4d7610a7b37 tempest-SnapshotDependencyTests-1971894314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:01:58 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-ca31bce4-066a-4484-84bd-c4d7610a7b37 tempest-SnapshotDependencyTests-1971894314 None] Creating offline snapshot ec477256-bcf8-4007-b6a6-c4eb64b6bb65 of volume f85f4dbe-42fa-4fc9-85a9-2a3f3f362359 {{(pid=87378) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 10 13:01:58 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3db54067-3d67-43ac-a794-60d3c246ec2c tempest-ProjectReaderTests-1805919051 None] Acquiring lock "cinder-2876be77-15ef-4731-a7d4-b2812ee2764f-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:01:58 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af90ebb-550a-4a88-9c1c-74b063d05d99]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:01:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ca31bce4-066a-4484-84bd-c4d7610a7b37 tempest-SnapshotDependencyTests-1971894314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:58 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3db54067-3d67-43ac-a794-60d3c246ec2c tempest-ProjectReaderTests-1805919051 None] Lock "cinder-2876be77-15ef-4731-a7d4-b2812ee2764f-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:01:58 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3db54067-3d67-43ac-a794-60d3c246ec2c tempest-ProjectReaderTests-1805919051 None] Acquiring lock "cinder-quobyte-2876be77-15ef-4731-a7d4-b2812ee2764f" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:01:58 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3db54067-3d67-43ac-a794-60d3c246ec2c tempest-ProjectReaderTests-1805919051 None] Lock "cinder-quobyte-2876be77-15ef-4731-a7d4-b2812ee2764f" acquired by "delete_volume" :: waited 0.030s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:01:58 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b93d226-5959-4fe2-94b3-690e38227684]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:01:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3db54067-3d67-43ac-a794-60d3c246ec2c tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2876be77-15ef-4731-a7d4-b2812ee2764f {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:58 devstack sudo[106789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359
Jul 10 13:01:58 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:58 devstack sudo[106790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2876be77-15ef-4731-a7d4-b2812ee2764f
Jul 10 13:01:58 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:58 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-bc629780-5db3-407e-a9cf-c0afee649dce tempest-ProjectReaderTests-237990147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.875s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:58 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-bc629780-5db3-407e-a9cf-c0afee649dce tempest-ProjectReaderTests-237990147 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:01:58 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-bc629780-5db3-407e-a9cf-c0afee649dce tempest-ProjectReaderTests-237990147 None] Deleted volume successfully.
Jul 10 13:01:58 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-bc629780-5db3-407e-a9cf-c0afee649dce tempest-ProjectReaderTests-237990147 None] Lock "cinder-5d077793-f5e9-4522-ab4f-4dd5aaf35490-delete_volume" released by "delete_volume" :: held 3.040s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:01:58 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-dc72fcdd-499a-4ab5-a94d-a9766e42fdf0 tempest-CreateVolumesFromSnapshotTest-150382642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d" returned: 0 in 1.171s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-dc72fcdd-499a-4ab5-a94d-a9766e42fdf0 tempest-CreateVolumesFromSnapshotTest-150382642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d.c91ad715-c3db-4d99-bfeb-1e9bb83ecac8 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:58 devstack sudo[106797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d.c91ad715-c3db-4d99-bfeb-1e9bb83ecac8
Jul 10 13:01:58 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:59 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3db54067-3d67-43ac-a794-60d3c246ec2c tempest-ProjectReaderTests-1805919051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2876be77-15ef-4731-a7d4-b2812ee2764f" returned: 0 in 0.896s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3db54067-3d67-43ac-a794-60d3c246ec2c tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2876be77-15ef-4731-a7d4-b2812ee2764f {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:59 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ca31bce4-066a-4484-84bd-c4d7610a7b37 tempest-SnapshotDependencyTests-1971894314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359" returned: 0 in 1.080s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ca31bce4-066a-4484-84bd-c4d7610a7b37 tempest-SnapshotDependencyTests-1971894314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359.ec477256-bcf8-4007-b6a6-c4eb64b6bb65 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:59 devstack sudo[106807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2876be77-15ef-4731-a7d4-b2812ee2764f
Jul 10 13:01:59 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:59 devstack sudo[106808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359.ec477256-bcf8-4007-b6a6-c4eb64b6bb65 1G
Jul 10 13:01:59 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:59 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-dc72fcdd-499a-4ab5-a94d-a9766e42fdf0 tempest-CreateVolumesFromSnapshotTest-150382642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d.c91ad715-c3db-4d99-bfeb-1e9bb83ecac8" returned: 0 in 0.889s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:01:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-dc72fcdd-499a-4ab5-a94d-a9766e42fdf0 tempest-CreateVolumesFromSnapshotTest-150382642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d.c91ad715-c3db-4d99-bfeb-1e9bb83ecac8 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:01:59 devstack sudo[106817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d.c91ad715-c3db-4d99-bfeb-1e9bb83ecac8
Jul 10 13:01:59 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:01:59 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root
Jul 10 13:01:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3db54067-3d67-43ac-a794-60d3c246ec2c tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2876be77-15ef-4731-a7d4-b2812ee2764f" returned: 0 in 0.866s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:00 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3db54067-3d67-43ac-a794-60d3c246ec2c tempest-ProjectReaderTests-1805919051 None] Lock "cinder-quobyte-2876be77-15ef-4731-a7d4-b2812ee2764f" released by "delete_volume" :: held 1.846s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:02:00 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-3db54067-3d67-43ac-a794-60d3c246ec2c tempest-ProjectReaderTests-1805919051 None] Created reservations ['b14a5444-cb26-47c2-bfd6-2f385a4f4034', '4984e393-0805-4d8f-ab85-fcf872bdbfc5', '064f93cc-6fc5-4d8c-b6e0-f8c201daae4b', '2ef3a49a-15d6-4ae9-9b9c-afe38f20697f'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:02:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3db54067-3d67-43ac-a794-60d3c246ec2c tempest-ProjectReaderTests-1805919051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:02:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3db54067-3d67-43ac-a794-60d3c246ec2c tempest-ProjectReaderTests-1805919051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:02:00 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3db54067-3d67-43ac-a794-60d3c246ec2c tempest-ProjectReaderTests-1805919051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:02:00 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:00 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3db54067-3d67-43ac-a794-60d3c246ec2c tempest-ProjectReaderTests-1805919051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:02:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3db54067-3d67-43ac-a794-60d3c246ec2c tempest-ProjectReaderTests-1805919051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:02:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3db54067-3d67-43ac-a794-60d3c246ec2c tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ca31bce4-066a-4484-84bd-c4d7610a7b37 tempest-SnapshotDependencyTests-1971894314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359.ec477256-bcf8-4007-b6a6-c4eb64b6bb65 1G" returned: 0 in 1.039s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ca31bce4-066a-4484-84bd-c4d7610a7b37 tempest-SnapshotDependencyTests-1971894314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359.ec477256-bcf8-4007-b6a6-c4eb64b6bb65 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:00 devstack sudo[106824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:02:00 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:00 devstack sudo[106825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359.ec477256-bcf8-4007-b6a6-c4eb64b6bb65
Jul 10 13:02:00 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:00 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-dc72fcdd-499a-4ab5-a94d-a9766e42fdf0 tempest-CreateVolumesFromSnapshotTest-150382642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d.c91ad715-c3db-4d99-bfeb-1e9bb83ecac8" returned: 0 in 0.829s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:00 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-dc72fcdd-499a-4ab5-a94d-a9766e42fdf0 tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "cinder-quobyte-c91ad715-c3db-4d99-bfeb-1e9bb83ecac8" released by "_delete_snapshot" :: held 3.923s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:02:00 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-dc72fcdd-499a-4ab5-a94d-a9766e42fdf0 tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "cinder-quobyte-e1cad374-d781-49ce-826f-8f2ce5c6e08d" released by "delete_snapshot" :: held 3.973s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:02:00 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-dc72fcdd-499a-4ab5-a94d-a9766e42fdf0 tempest-CreateVolumesFromSnapshotTest-150382642 None] Created reservations ['685feeeb-48b7-45bb-afc1-417827e1c32a', '87778f5b-dbf0-44f8-9746-bf26ee1639ae', '17319b1c-36eb-4d57-9d65-6150359eedcd', '08c54516-0d2f-4699-a2b0-27ed5d00305e'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:02:00 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-dc72fcdd-499a-4ab5-a94d-a9766e42fdf0 tempest-CreateVolumesFromSnapshotTest-150382642 None] Delete snapshot completed successfully.
Jul 10 13:02:00 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-dc72fcdd-499a-4ab5-a94d-a9766e42fdf0 tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "cinder-c91ad715-c3db-4d99-bfeb-1e9bb83ecac8-delete_snapshot" released by "delete_snapshot" :: held 4.194s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:02:00 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-10b57388-bd6e-413d-930d-4c92e1b8904a tempest-CreateVolumesFromSnapshotTest-150382642 None] Acquiring lock "cinder-e1cad374-d781-49ce-826f-8f2ce5c6e08d-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:02:00 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-10b57388-bd6e-413d-930d-4c92e1b8904a tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "cinder-e1cad374-d781-49ce-826f-8f2ce5c6e08d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:02:00 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-10b57388-bd6e-413d-930d-4c92e1b8904a tempest-CreateVolumesFromSnapshotTest-150382642 None] Acquiring lock "cinder-quobyte-e1cad374-d781-49ce-826f-8f2ce5c6e08d" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:02:01 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-10b57388-bd6e-413d-930d-4c92e1b8904a tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "cinder-quobyte-e1cad374-d781-49ce-826f-8f2ce5c6e08d" acquired by "delete_volume" :: waited 0.025s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:02:01 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-a80d3d7a-aa8c-472e-a20b-594be49e1707 tempest-ProjectReaderTests-1805919051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 13:02:01 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:01 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a80d3d7a-aa8c-472e-a20b-594be49e1707 tempest-ProjectReaderTests-1805919051 None] Flow 'volume_create_manager' (d62dd2f7-52ef-4d8f-95d4-00d332ed13fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:02:01 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a80d3d7a-aa8c-472e-a20b-594be49e1707 tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c70026ab-7a71-4fc1-9b05-174ed9b8a9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:01 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec7a471-6e15-4ba0-b750-45aef7199da8]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:02:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-10b57388-bd6e-413d-930d-4c92e1b8904a tempest-CreateVolumesFromSnapshotTest-150382642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3db54067-3d67-43ac-a794-60d3c246ec2c tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.941s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:01 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-3db54067-3d67-43ac-a794-60d3c246ec2c tempest-ProjectReaderTests-1805919051 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:02:01 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-3db54067-3d67-43ac-a794-60d3c246ec2c tempest-ProjectReaderTests-1805919051 None] Deleted volume successfully.
Jul 10 13:02:01 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a80d3d7a-aa8c-472e-a20b-594be49e1707 tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c70026ab-7a71-4fc1-9b05-174ed9b8a9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:02:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-191236700',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eba2bac9ba8240e4b6c7825aeee0bdc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:02:01Z,use_quota=True,user_id='5c9819a9765743f798b8c839da755b20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:01 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a80d3d7a-aa8c-472e-a20b-594be49e1707 tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d78f07d3-91cb-4b20-b18e-8c7a7205a0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:01 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a80d3d7a-aa8c-472e-a20b-594be49e1707 tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d78f07d3-91cb-4b20-b18e-8c7a7205a0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:01 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:01 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a80d3d7a-aa8c-472e-a20b-594be49e1707 tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cca19f1a-1f18-4062-a3ca-08c29061a92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:01 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a80d3d7a-aa8c-472e-a20b-594be49e1707 tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cca19f1a-1f18-4062-a3ca-08c29061a92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75', 'volume_name': 'volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:01 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a80d3d7a-aa8c-472e-a20b-594be49e1707 tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56882f82-8b3c-4199-a361-8e7d85e1e80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:01 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a80d3d7a-aa8c-472e-a20b-594be49e1707 tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56882f82-8b3c-4199-a361-8e7d85e1e80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:01 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a80d3d7a-aa8c-472e-a20b-594be49e1707 tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0d9c81d-a1ef-48dd-8d86-03b20353a83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:01 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-a80d3d7a-aa8c-472e-a20b-594be49e1707 tempest-ProjectReaderTests-1805919051 None] Volume e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75', 'volume_size': 1}
Jul 10 13:02:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a80d3d7a-aa8c-472e-a20b-594be49e1707 tempest-ProjectReaderTests-1805919051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:02:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ca31bce4-066a-4484-84bd-c4d7610a7b37 tempest-SnapshotDependencyTests-1971894314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359.ec477256-bcf8-4007-b6a6-c4eb64b6bb65" returned: 0 in 1.001s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:01 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-ca31bce4-066a-4484-84bd-c4d7610a7b37 tempest-SnapshotDependencyTests-1971894314 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359.ec477256-bcf8-4007-b6a6-c4eb64b6bb65 is being set with open permissions: ugo+rw
Jul 10 13:02:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ca31bce4-066a-4484-84bd-c4d7610a7b37 tempest-SnapshotDependencyTests-1971894314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359.ec477256-bcf8-4007-b6a6-c4eb64b6bb65 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:01 devstack sudo[106835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359.ec477256-bcf8-4007-b6a6-c4eb64b6bb65
Jul 10 13:02:01 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:01 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-3db54067-3d67-43ac-a794-60d3c246ec2c tempest-ProjectReaderTests-1805919051 None] Lock "cinder-2876be77-15ef-4731-a7d4-b2812ee2764f-delete_volume" released by "delete_volume" :: held 3.148s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:02:01 devstack sudo[106834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d
Jul 10 13:02:01 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:01 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ca31bce4-066a-4484-84bd-c4d7610a7b37 tempest-SnapshotDependencyTests-1971894314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359.ec477256-bcf8-4007-b6a6-c4eb64b6bb65" returned: 0 in 0.707s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:01 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-10b57388-bd6e-413d-930d-4c92e1b8904a tempest-CreateVolumesFromSnapshotTest-150382642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d" returned: 0 in 0.826s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-10b57388-bd6e-413d-930d-4c92e1b8904a tempest-CreateVolumesFromSnapshotTest-150382642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ca31bce4-066a-4484-84bd-c4d7610a7b37 tempest-SnapshotDependencyTests-1971894314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:01 devstack sudo[106842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d
Jul 10 13:02:01 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:01 devstack sudo[106844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359.info
Jul 10 13:02:01 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:02 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:02 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-10b57388-bd6e-413d-930d-4c92e1b8904a tempest-CreateVolumesFromSnapshotTest-150382642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e1cad374-d781-49ce-826f-8f2ce5c6e08d" returned: 0 in 0.716s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ca31bce4-066a-4484-84bd-c4d7610a7b37 tempest-SnapshotDependencyTests-1971894314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359.info" returned: 0 in 0.700s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:02 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-ca31bce4-066a-4484-84bd-c4d7610a7b37 tempest-SnapshotDependencyTests-1971894314 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359.info is being set with open permissions: ugo+rw
Jul 10 13:02:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ca31bce4-066a-4484-84bd-c4d7610a7b37 tempest-SnapshotDependencyTests-1971894314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:02 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-10b57388-bd6e-413d-930d-4c92e1b8904a tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "cinder-quobyte-e1cad374-d781-49ce-826f-8f2ce5c6e08d" released by "delete_volume" :: held 1.677s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:02:02 devstack sudo[106848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359.info
Jul 10 13:02:02 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:02 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-7772f7a4-afe9-4104-b9ac-c78cfc84ef6b tempest-ProjectReaderTests-1955870770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 13:02:02 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7772f7a4-afe9-4104-b9ac-c78cfc84ef6b tempest-ProjectReaderTests-1955870770 None] Flow 'volume_create_manager' (23ee108b-9cb0-4943-a11d-8f51c6183e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:02:02 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7772f7a4-afe9-4104-b9ac-c78cfc84ef6b tempest-ProjectReaderTests-1955870770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cd5a3fb-dddc-4655-a462-ec8ea222ab22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:02 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7772f7a4-afe9-4104-b9ac-c78cfc84ef6b tempest-ProjectReaderTests-1955870770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cd5a3fb-dddc-4655-a462-ec8ea222ab22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-332337769',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1351b1c8-1d09-48b5-b0b8-a4289e2648b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbf2f22893f0436aaf2b492048ee771a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:02:03Z,use_quota=True,user_id='7297474b49d844dca1ea14972fb95c7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:02 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7772f7a4-afe9-4104-b9ac-c78cfc84ef6b tempest-ProjectReaderTests-1955870770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b8b1f65-43af-4b0d-aac0-6e39c6eb2de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:02 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7772f7a4-afe9-4104-b9ac-c78cfc84ef6b tempest-ProjectReaderTests-1955870770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b8b1f65-43af-4b0d-aac0-6e39c6eb2de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:02 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7772f7a4-afe9-4104-b9ac-c78cfc84ef6b tempest-ProjectReaderTests-1955870770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24f0a8d9-df82-42c3-b8eb-8a36604b622d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:02 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7772f7a4-afe9-4104-b9ac-c78cfc84ef6b tempest-ProjectReaderTests-1955870770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24f0a8d9-df82-42c3-b8eb-8a36604b622d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1351b1c8-1d09-48b5-b0b8-a4289e2648b0', 'volume_name': 'volume-1351b1c8-1d09-48b5-b0b8-a4289e2648b0', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:02 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7772f7a4-afe9-4104-b9ac-c78cfc84ef6b tempest-ProjectReaderTests-1955870770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d3d87d3-3347-46c3-97dc-5551b9f5de17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:02 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7772f7a4-afe9-4104-b9ac-c78cfc84ef6b tempest-ProjectReaderTests-1955870770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d3d87d3-3347-46c3-97dc-5551b9f5de17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:02 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7772f7a4-afe9-4104-b9ac-c78cfc84ef6b tempest-ProjectReaderTests-1955870770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8abb1630-2b8c-4b5b-8d99-8295fff77046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:02 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-7772f7a4-afe9-4104-b9ac-c78cfc84ef6b tempest-ProjectReaderTests-1955870770 None] Volume 1351b1c8-1d09-48b5-b0b8-a4289e2648b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1351b1c8-1d09-48b5-b0b8-a4289e2648b0', 'volume_size': 1}
Jul 10 13:02:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-7772f7a4-afe9-4104-b9ac-c78cfc84ef6b tempest-ProjectReaderTests-1955870770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:02:02 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-10b57388-bd6e-413d-930d-4c92e1b8904a tempest-CreateVolumesFromSnapshotTest-150382642 None] Created reservations ['44a016d0-40d1-47b9-9ca8-cb92be1bbc5e', 'c6809cd7-ec50-4351-95f4-80efd81b9c16', '4139d4d0-0175-400a-9f62-4dc4e9b1b430', 'b4ce45f3-2fa1-4589-a1c0-9189e405a4fa'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:02:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-10b57388-bd6e-413d-930d-4c92e1b8904a tempest-CreateVolumesFromSnapshotTest-150382642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:02:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-10b57388-bd6e-413d-930d-4c92e1b8904a tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:02:02 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-10b57388-bd6e-413d-930d-4c92e1b8904a tempest-CreateVolumesFromSnapshotTest-150382642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:02:02 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-10b57388-bd6e-413d-930d-4c92e1b8904a tempest-CreateVolumesFromSnapshotTest-150382642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:02:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-10b57388-bd6e-413d-930d-4c92e1b8904a tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:02:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-10b57388-bd6e-413d-930d-4c92e1b8904a tempest-CreateVolumesFromSnapshotTest-150382642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:02 devstack sudo[106850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:02:02 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:03 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ca31bce4-066a-4484-84bd-c4d7610a7b37 tempest-SnapshotDependencyTests-1971894314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359.info" returned: 0 in 0.671s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-ca31bce4-066a-4484-84bd-c4d7610a7b37 tempest-SnapshotDependencyTests-1971894314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.361s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:02:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a80d3d7a-aa8c-472e-a20b-594be49e1707 tempest-ProjectReaderTests-1805919051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.173s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:02:03 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-a80d3d7a-aa8c-472e-a20b-594be49e1707 tempest-ProjectReaderTests-1805919051 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:02:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-191236700',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eba2bac9ba8240e4b6c7825aeee0bdc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:02:01Z,use_quota=True,user_id='5c9819a9765743f798b8c839da755b20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 13:02:03 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-a80d3d7a-aa8c-472e-a20b-594be49e1707 tempest-ProjectReaderTests-1805919051 None] Creating volume e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 13:02:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a80d3d7a-aa8c-472e-a20b-594be49e1707 tempest-ProjectReaderTests-1805919051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:02:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a80d3d7a-aa8c-472e-a20b-594be49e1707 tempest-ProjectReaderTests-1805919051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:02:03 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-a80d3d7a-aa8c-472e-a20b-594be49e1707 tempest-ProjectReaderTests-1805919051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:02:03 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-a80d3d7a-aa8c-472e-a20b-594be49e1707 tempest-ProjectReaderTests-1805919051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:02:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a80d3d7a-aa8c-472e-a20b-594be49e1707 tempest-ProjectReaderTests-1805919051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:02:03 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-a80d3d7a-aa8c-472e-a20b-594be49e1707 tempest-ProjectReaderTests-1805919051 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 13:02:03 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-a80d3d7a-aa8c-472e-a20b-594be49e1707 tempest-ProjectReaderTests-1805919051 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 13:02:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a80d3d7a-aa8c-472e-a20b-594be49e1707 tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:03 devstack sudo[106853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75 1073741824
Jul 10 13:02:03 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:03 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-ca31bce4-066a-4484-84bd-c4d7610a7b37 tempest-SnapshotDependencyTests-1971894314 None] Create snapshot completed successfully
Jul 10 13:02:03 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-10b57388-bd6e-413d-930d-4c92e1b8904a tempest-CreateVolumesFromSnapshotTest-150382642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.679s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:03 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-10b57388-bd6e-413d-930d-4c92e1b8904a tempest-CreateVolumesFromSnapshotTest-150382642 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:02:03 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-10b57388-bd6e-413d-930d-4c92e1b8904a tempest-CreateVolumesFromSnapshotTest-150382642 None] Deleted volume successfully.
Jul 10 13:02:03 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-10b57388-bd6e-413d-930d-4c92e1b8904a tempest-CreateVolumesFromSnapshotTest-150382642 None] Lock "cinder-e1cad374-d781-49ce-826f-8f2ce5c6e08d-delete_volume" released by "delete_volume" :: held 2.686s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:02:04 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a80d3d7a-aa8c-472e-a20b-594be49e1707 tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75 1073741824" returned: 0 in 0.934s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a80d3d7a-aa8c-472e-a20b-594be49e1707 tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:04 devstack sudo[106860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75
Jul 10 13:02:04 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:04 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 13:02:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] Flow 'volume_create_manager' (bafdd865-915a-4aea-9450-32c507064aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:02:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc1477fe-c32c-41d3-9f53-4b0615ded50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc1477fe-c32c-41d3-9f53-4b0615ded50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b2b85af-0899-45e8-9164-0b3a9efe7194,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db01860b01fe4dfdabd1d2a0adf0646e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ec477256-bcf8-4007-b6a6-c4eb64b6bb65,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:02:05Z,use_quota=True,user_id='9a5bb7fcfbc44fe69cbf870c1d28fb1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27a95847-540d-4a4b-8cf3-934584e5199d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27a95847-540d-4a4b-8cf3-934584e5199d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (628a42d9-ae36-4220-b8cf-a2c4b5106f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (628a42d9-ae36-4220-b8cf-a2c4b5106f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4b2b85af-0899-45e8-9164-0b3a9efe7194', 'volume_name': 'volume-4b2b85af-0899-45e8-9164-0b3a9efe7194', 'volume_size': 1, 'snapshot_id': 'ec477256-bcf8-4007-b6a6-c4eb64b6bb65'}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84d58ce9-5f74-449f-ae55-ce17bcfde28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84d58ce9-5f74-449f-ae55-ce17bcfde28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed08062a-0f4c-4cec-a208-f2218502aa49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:04 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] Volume 4b2b85af-0899-45e8-9164-0b3a9efe7194: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4b2b85af-0899-45e8-9164-0b3a9efe7194', 'volume_size': 1, 'snapshot_id': 'ec477256-bcf8-4007-b6a6-c4eb64b6bb65'}
Jul 10 13:02:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:02:05 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a80d3d7a-aa8c-472e-a20b-594be49e1707 tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75" returned: 0 in 0.794s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:05 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-a80d3d7a-aa8c-472e-a20b-594be49e1707 tempest-ProjectReaderTests-1805919051 None] <== create_volume: return (1767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 13:02:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a80d3d7a-aa8c-472e-a20b-594be49e1707 tempest-ProjectReaderTests-1805919051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.772s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:02:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-7772f7a4-afe9-4104-b9ac-c78cfc84ef6b tempest-ProjectReaderTests-1955870770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.364s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:02:05 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-7772f7a4-afe9-4104-b9ac-c78cfc84ef6b tempest-ProjectReaderTests-1955870770 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-332337769',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1351b1c8-1d09-48b5-b0b8-a4289e2648b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbf2f22893f0436aaf2b492048ee771a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:02:03Z,use_quota=True,user_id='7297474b49d844dca1ea14972fb95c7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 13:02:05 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-7772f7a4-afe9-4104-b9ac-c78cfc84ef6b tempest-ProjectReaderTests-1955870770 None] Creating volume 1351b1c8-1d09-48b5-b0b8-a4289e2648b0 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 13:02:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-7772f7a4-afe9-4104-b9ac-c78cfc84ef6b tempest-ProjectReaderTests-1955870770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:02:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-7772f7a4-afe9-4104-b9ac-c78cfc84ef6b tempest-ProjectReaderTests-1955870770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:02:05 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-7772f7a4-afe9-4104-b9ac-c78cfc84ef6b tempest-ProjectReaderTests-1955870770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:02:05 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-7772f7a4-afe9-4104-b9ac-c78cfc84ef6b tempest-ProjectReaderTests-1955870770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:02:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-7772f7a4-afe9-4104-b9ac-c78cfc84ef6b tempest-ProjectReaderTests-1955870770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:02:05 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-7772f7a4-afe9-4104-b9ac-c78cfc84ef6b tempest-ProjectReaderTests-1955870770 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 13:02:05 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-7772f7a4-afe9-4104-b9ac-c78cfc84ef6b tempest-ProjectReaderTests-1955870770 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 13:02:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7772f7a4-afe9-4104-b9ac-c78cfc84ef6b tempest-ProjectReaderTests-1955870770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1351b1c8-1d09-48b5-b0b8-a4289e2648b0 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:05 devstack sudo[106863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1351b1c8-1d09-48b5-b0b8-a4289e2648b0 1073741824
Jul 10 13:02:05 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a80d3d7a-aa8c-472e-a20b-594be49e1707 tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0d9c81d-a1ef-48dd-8d86-03b20353a83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a80d3d7a-aa8c-472e-a20b-594be49e1707 tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d180dfc3-cd0d-4174-b90b-bb2e230ed8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:05 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-a80d3d7a-aa8c-472e-a20b-594be49e1707 tempest-ProjectReaderTests-1805919051 None] Volume volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75 (e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75): created successfully
Jul 10 13:02:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a80d3d7a-aa8c-472e-a20b-594be49e1707 tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d180dfc3-cd0d-4174-b90b-bb2e230ed8b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:05 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a80d3d7a-aa8c-472e-a20b-594be49e1707 tempest-ProjectReaderTests-1805919051 None] Flow 'volume_create_manager' (d62dd2f7-52ef-4d8f-95d4-00d332ed13fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:02:05 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-a80d3d7a-aa8c-472e-a20b-594be49e1707 tempest-ProjectReaderTests-1805919051 None] Created volume successfully.
Jul 10 13:02:06 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7772f7a4-afe9-4104-b9ac-c78cfc84ef6b tempest-ProjectReaderTests-1955870770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1351b1c8-1d09-48b5-b0b8-a4289e2648b0 1073741824" returned: 0 in 0.908s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7772f7a4-afe9-4104-b9ac-c78cfc84ef6b tempest-ProjectReaderTests-1955870770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1351b1c8-1d09-48b5-b0b8-a4289e2648b0 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:06 devstack sudo[106868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1351b1c8-1d09-48b5-b0b8-a4289e2648b0
Jul 10 13:02:06 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:06 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f49fe42-240d-4fec-b012-7cac911243f2 tempest-CinderUnicodeTest-1866586889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 13:02:06 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5f49fe42-240d-4fec-b012-7cac911243f2 tempest-CinderUnicodeTest-1866586889 None] Flow 'volume_create_manager' (948b6673-6725-440d-87f2-29f372bd8baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:02:06 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5f49fe42-240d-4fec-b012-7cac911243f2 tempest-CinderUnicodeTest-1866586889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44a9758c-b62f-4f3c-bdc9-02b5a84f25c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:06 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5f49fe42-240d-4fec-b012-7cac911243f2 tempest-CinderUnicodeTest-1866586889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44a9758c-b62f-4f3c-bdc9-02b5a84f25c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10043955-3352-49c3-8364-a27ae509d552,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ed1164aaff43fbaf693baf9ada1b9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:02:06Z,use_quota=True,user_id='3cc9a657248a43b3b89f60ca13e55443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:06 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5f49fe42-240d-4fec-b012-7cac911243f2 tempest-CinderUnicodeTest-1866586889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (929dd9e5-9328-438e-ae94-0f1f35cc980a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:06 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5f49fe42-240d-4fec-b012-7cac911243f2 tempest-CinderUnicodeTest-1866586889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (929dd9e5-9328-438e-ae94-0f1f35cc980a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:06 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5f49fe42-240d-4fec-b012-7cac911243f2 tempest-CinderUnicodeTest-1866586889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2b51ec3-fe30-47e8-8e2a-f49be9823623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:06 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5f49fe42-240d-4fec-b012-7cac911243f2 tempest-CinderUnicodeTest-1866586889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2b51ec3-fe30-47e8-8e2a-f49be9823623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10043955-3352-49c3-8364-a27ae509d552', 'volume_name': 'volume-10043955-3352-49c3-8364-a27ae509d552', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:06 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5f49fe42-240d-4fec-b012-7cac911243f2 tempest-CinderUnicodeTest-1866586889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caf98bf5-9140-48e0-b106-4e7187ebc2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:06 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5f49fe42-240d-4fec-b012-7cac911243f2 tempest-CinderUnicodeTest-1866586889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caf98bf5-9140-48e0-b106-4e7187ebc2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:06 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5f49fe42-240d-4fec-b012-7cac911243f2 tempest-CinderUnicodeTest-1866586889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbc6e7e3-c1bc-438f-b1a4-f7f3b19102d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:06 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-5f49fe42-240d-4fec-b012-7cac911243f2 tempest-CinderUnicodeTest-1866586889 None] Volume 10043955-3352-49c3-8364-a27ae509d552: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10043955-3352-49c3-8364-a27ae509d552', 'volume_size': 1}
Jul 10 13:02:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5f49fe42-240d-4fec-b012-7cac911243f2 tempest-CinderUnicodeTest-1866586889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:02:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-054d2a94-8093-444f-9a52-010c816af27d tempest-ProjectReaderTests-1805919051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:02:06 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7772f7a4-afe9-4104-b9ac-c78cfc84ef6b tempest-ProjectReaderTests-1955870770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1351b1c8-1d09-48b5-b0b8-a4289e2648b0" returned: 0 in 0.690s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:06 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-7772f7a4-afe9-4104-b9ac-c78cfc84ef6b tempest-ProjectReaderTests-1955870770 None] <== create_volume: return (1639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 13:02:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-7772f7a4-afe9-4104-b9ac-c78cfc84ef6b tempest-ProjectReaderTests-1955870770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.642s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:02:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.782s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:02:06 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] Acquiring lock "cinder-quobyte-ec477256-bcf8-4007-b6a6-c4eb64b6bb65-4b2b85af-0899-45e8-9164-0b3a9efe7194" by "_create_volume_from_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:02:06 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7772f7a4-afe9-4104-b9ac-c78cfc84ef6b tempest-ProjectReaderTests-1955870770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8abb1630-2b8c-4b5b-8d99-8295fff77046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1351b1c8-1d09-48b5-b0b8-a4289e2648b0', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:06 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7772f7a4-afe9-4104-b9ac-c78cfc84ef6b tempest-ProjectReaderTests-1955870770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa1a8363-0b76-458d-bf20-2b3d4df4fbef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:06 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] Lock "cinder-quobyte-ec477256-bcf8-4007-b6a6-c4eb64b6bb65-4b2b85af-0899-45e8-9164-0b3a9efe7194" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:02:06 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] Creating volume 4b2b85af-0899-45e8-9164-0b3a9efe7194 from snapshot ec477256-bcf8-4007-b6a6-c4eb64b6bb65 {{(pid=87378) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 10 13:02:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:02:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:02:06 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:02:06 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:02:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:02:06 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 13:02:06 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] Acquiring lock "cinder-quobyte-4b2b85af-0899-45e8-9164-0b3a9efe7194" by "_copy_volume_from_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:02:06 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-7772f7a4-afe9-4104-b9ac-c78cfc84ef6b tempest-ProjectReaderTests-1955870770 None] Volume volume-1351b1c8-1d09-48b5-b0b8-a4289e2648b0 (1351b1c8-1d09-48b5-b0b8-a4289e2648b0): created successfully
Jul 10 13:02:06 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7772f7a4-afe9-4104-b9ac-c78cfc84ef6b tempest-ProjectReaderTests-1955870770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa1a8363-0b76-458d-bf20-2b3d4df4fbef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:06 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7772f7a4-afe9-4104-b9ac-c78cfc84ef6b tempest-ProjectReaderTests-1955870770 None] Flow 'volume_create_manager' (23ee108b-9cb0-4943-a11d-8f51c6183e02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:02:06 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] Lock "cinder-quobyte-4b2b85af-0899-45e8-9164-0b3a9efe7194" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:02:06 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] snapshot: ec477256-bcf8-4007-b6a6-c4eb64b6bb65, volume: 4b2b85af-0899-45e8-9164-0b3a9efe7194,  {{(pid=87378) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 10 13:02:06 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-7772f7a4-afe9-4104-b9ac-c78cfc84ef6b tempest-ProjectReaderTests-1955870770 None] Created volume successfully.
Jul 10 13:02:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:02:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:02:06 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:02:06 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:02:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:02:06 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce4aa4c-6644-41ac-bfbf-6916543d0f55]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:02:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359.ec477256-bcf8-4007-b6a6-c4eb64b6bb65 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:07 devstack sudo[106871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359.ec477256-bcf8-4007-b6a6-c4eb64b6bb65
Jul 10 13:02:07 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:07 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359.ec477256-bcf8-4007-b6a6-c4eb64b6bb65" returned: 0 in 0.754s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:07 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 13:02:07 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] will copy from snapshot at /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359 {{(pid=87378) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 10 13:02:07 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] Creating direct copy from snapshot {{(pid=87378) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 10 13:02:07 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee4a47d-6133-4e7b-8b08-ff572c11614b]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:02:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:07 devstack sudo[106876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359
Jul 10 13:02:07 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:08 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-693d3bf3-dda0-47e3-963a-f2b7dedbb43e tempest-ProjectReaderTests-1955870770 None] Acquiring lock "cinder-1351b1c8-1d09-48b5-b0b8-a4289e2648b0-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:02:08 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-693d3bf3-dda0-47e3-963a-f2b7dedbb43e tempest-ProjectReaderTests-1955870770 None] Lock "cinder-1351b1c8-1d09-48b5-b0b8-a4289e2648b0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:02:08 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-693d3bf3-dda0-47e3-963a-f2b7dedbb43e tempest-ProjectReaderTests-1955870770 None] Acquiring lock "cinder-quobyte-1351b1c8-1d09-48b5-b0b8-a4289e2648b0" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:02:08 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-693d3bf3-dda0-47e3-963a-f2b7dedbb43e tempest-ProjectReaderTests-1955870770 None] Lock "cinder-quobyte-1351b1c8-1d09-48b5-b0b8-a4289e2648b0" acquired by "delete_volume" :: waited 0.015s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:02:08 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a76749-1e30-4529-b720-cdd899233fa5]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:02:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-693d3bf3-dda0-47e3-963a-f2b7dedbb43e tempest-ProjectReaderTests-1955870770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1351b1c8-1d09-48b5-b0b8-a4289e2648b0 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:08 devstack sudo[106878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1351b1c8-1d09-48b5-b0b8-a4289e2648b0
Jul 10 13:02:08 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:08 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359" returned: 0 in 0.776s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:08 devstack cinder-volume[87378]: DEBUG cinder.utils [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] Path /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4b2b85af-0899-45e8-9164-0b3a9efe7194 not found in is_blk_device check {{(pid=87378) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 10 13:02:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4b2b85af-0899-45e8-9164-0b3a9efe7194 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:08 devstack sudo[106884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4b2b85af-0899-45e8-9164-0b3a9efe7194
Jul 10 13:02:08 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:09 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-693d3bf3-dda0-47e3-963a-f2b7dedbb43e tempest-ProjectReaderTests-1955870770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1351b1c8-1d09-48b5-b0b8-a4289e2648b0" returned: 0 in 0.790s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-693d3bf3-dda0-47e3-963a-f2b7dedbb43e tempest-ProjectReaderTests-1955870770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1351b1c8-1d09-48b5-b0b8-a4289e2648b0 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:09 devstack sudo[106892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1351b1c8-1d09-48b5-b0b8-a4289e2648b0
Jul 10 13:02:09 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:09 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-693d3bf3-dda0-47e3-963a-f2b7dedbb43e tempest-ProjectReaderTests-1955870770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-1351b1c8-1d09-48b5-b0b8-a4289e2648b0" returned: 0 in 0.927s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:10 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-693d3bf3-dda0-47e3-963a-f2b7dedbb43e tempest-ProjectReaderTests-1955870770 None] Lock "cinder-quobyte-1351b1c8-1d09-48b5-b0b8-a4289e2648b0" released by "delete_volume" :: held 1.768s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:02:10 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-693d3bf3-dda0-47e3-963a-f2b7dedbb43e tempest-ProjectReaderTests-1955870770 None] Created reservations ['e82a5c18-002f-4ef3-97cb-861c559b3825', 'c27f2230-4c66-46f1-ab35-7ee5ace45f7f', '73abeb4f-f9d8-4d56-928d-4cb0ee0afaef', '68190854-7e72-4a9e-86bb-7509ee0d5819'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:02:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-693d3bf3-dda0-47e3-963a-f2b7dedbb43e tempest-ProjectReaderTests-1955870770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:02:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-693d3bf3-dda0-47e3-963a-f2b7dedbb43e tempest-ProjectReaderTests-1955870770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:02:10 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-693d3bf3-dda0-47e3-963a-f2b7dedbb43e tempest-ProjectReaderTests-1955870770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:02:10 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-693d3bf3-dda0-47e3-963a-f2b7dedbb43e tempest-ProjectReaderTests-1955870770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:02:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-693d3bf3-dda0-47e3-963a-f2b7dedbb43e tempest-ProjectReaderTests-1955870770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:02:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-693d3bf3-dda0-47e3-963a-f2b7dedbb43e tempest-ProjectReaderTests-1955870770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:10 devstack sudo[106904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:02:10 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:11 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4c60c5e-bf7d-40c2-866d-e3f59e09b10c tempest-ProjectReaderTests-1955870770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 13:02:11 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a4c60c5e-bf7d-40c2-866d-e3f59e09b10c tempest-ProjectReaderTests-1955870770 None] Flow 'volume_create_manager' (55b620ea-2609-41b5-9a7d-0d846281b77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:02:11 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a4c60c5e-bf7d-40c2-866d-e3f59e09b10c tempest-ProjectReaderTests-1955870770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9835395f-166c-448a-9538-c959bff87723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:11 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a4c60c5e-bf7d-40c2-866d-e3f59e09b10c tempest-ProjectReaderTests-1955870770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9835395f-166c-448a-9538-c959bff87723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1486967489',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4225e13b-7323-4aef-9876-fed6c65a825d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbf2f22893f0436aaf2b492048ee771a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:02:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:02:12Z,use_quota=True,user_id='7297474b49d844dca1ea14972fb95c7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:11 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a4c60c5e-bf7d-40c2-866d-e3f59e09b10c tempest-ProjectReaderTests-1955870770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e2be5e5-4c46-437a-8f21-8de87add5ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:11 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a4c60c5e-bf7d-40c2-866d-e3f59e09b10c tempest-ProjectReaderTests-1955870770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e2be5e5-4c46-437a-8f21-8de87add5ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:11 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a4c60c5e-bf7d-40c2-866d-e3f59e09b10c tempest-ProjectReaderTests-1955870770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c55db39d-1599-4365-b6d0-8fa153c908c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:11 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a4c60c5e-bf7d-40c2-866d-e3f59e09b10c tempest-ProjectReaderTests-1955870770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c55db39d-1599-4365-b6d0-8fa153c908c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4225e13b-7323-4aef-9876-fed6c65a825d', 'volume_name': 'volume-4225e13b-7323-4aef-9876-fed6c65a825d', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:11 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a4c60c5e-bf7d-40c2-866d-e3f59e09b10c tempest-ProjectReaderTests-1955870770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9b9356d-cad9-443e-a25c-1698b3eeaf56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:11 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a4c60c5e-bf7d-40c2-866d-e3f59e09b10c tempest-ProjectReaderTests-1955870770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9b9356d-cad9-443e-a25c-1698b3eeaf56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:11 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a4c60c5e-bf7d-40c2-866d-e3f59e09b10c tempest-ProjectReaderTests-1955870770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c434ca01-5d38-46dd-8b39-a9456096df90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:11 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-a4c60c5e-bf7d-40c2-866d-e3f59e09b10c tempest-ProjectReaderTests-1955870770 None] Volume 4225e13b-7323-4aef-9876-fed6c65a825d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4225e13b-7323-4aef-9876-fed6c65a825d', 'volume_size': 1}
Jul 10 13:02:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a4c60c5e-bf7d-40c2-866d-e3f59e09b10c tempest-ProjectReaderTests-1955870770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:02:11 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-693d3bf3-dda0-47e3-963a-f2b7dedbb43e tempest-ProjectReaderTests-1955870770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 1.691s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:11 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-693d3bf3-dda0-47e3-963a-f2b7dedbb43e tempest-ProjectReaderTests-1955870770 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:02:11 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-693d3bf3-dda0-47e3-963a-f2b7dedbb43e tempest-ProjectReaderTests-1955870770 None] Deleted volume successfully.
Jul 10 13:02:12 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-693d3bf3-dda0-47e3-963a-f2b7dedbb43e tempest-ProjectReaderTests-1955870770 None] Lock "cinder-1351b1c8-1d09-48b5-b0b8-a4289e2648b0-delete_volume" released by "delete_volume" :: held 3.819s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:02:12 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 13:02:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:02:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:02:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:02:13 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:02:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:02:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:13 devstack sudo[106907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:02:13 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:13 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4b2b85af-0899-45e8-9164-0b3a9efe7194" returned: 0 in 5.294s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:13 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad5e3cb-4a7d-4ab2-82e6-af43a466139d]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:02:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:13 devstack sudo[106910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359
Jul 10 13:02:13 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:13 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.920s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:13 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:02:13 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager._thread_info {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 13:02:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread count: 28 {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 10 13:02:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread info: [<_MainThread(MainThread, started 128233544536192)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128233445424704)>, <Thread(Thread-3 (stat_writer), started daemon 128233435118528)>, <Thread(Rabbit-heartbeat, started daemon 128233435718016)>, <Thread(Thread-5 (_runner), started daemon 128233432624448)>, <Thread(Thread-7 (_runner), started daemon 128233432674688)>, <Thread(fd_logger, started daemon 128233428569472)>, <Thread(privsep_reader, started daemon 128233429417088)>, <Thread(tpool_thread_0, started daemon 128233421182656)>, <Thread(tpool_thread_1, started daemon 128233412789952)>, <Thread(tpool_thread_2, started daemon 128233404397248)>, <Thread(tpool_thread_3, started daemon 128233396004544)>, <Thread(tpool_thread_4, started daemon 128233387611840)>, <Thread(tpool_thread_5, started daemon 128233379219136)>, <Thread(tpool_thread_6, started daemon 128233370826432)>, <Thread(tpool_thread_7, started daemon 128233362433728)>, <Thread(tpool_thread_8, started daemon 128233354041024)>, <Thread(tpool_thread_9, started daemon 128233345631936)>, <Thread(tpool_thread_10, started daemon 128233337222848)>, <Thread(tpool_thread_11, started daemon 128233328813760)>, <Thread(tpool_thread_12, started daemon 128233320404672)>, <Thread(tpool_thread_13, started daemon 128233311995584)>, <Thread(tpool_thread_14, started daemon 128233303586496)>, <Thread(tpool_thread_15, started daemon 128233295177408)>, <Thread(tpool_thread_16, started daemon 128233286768320)>, <Thread(tpool_thread_17, started daemon 128233278359232)>, <Thread(tpool_thread_18, started daemon 128233269950144)>, <Thread(tpool_thread_19, started daemon 128233261541056)>] {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 10 13:02:14 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359" returned: 0 in 0.919s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:14 devstack cinder-volume[87378]: DEBUG cinder.image.image_utils [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] Image conversion details: src /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359, size 1024.00 MB, duration 5.30 sec, destination /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4b2b85af-0899-45e8-9164-0b3a9efe7194 {{(pid=87378) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 10 13:02:14 devstack cinder-volume[87378]: INFO cinder.image.image_utils [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] Converted 1024.00 MB image at 193.37 MB/s
Jul 10 13:02:14 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4b2b85af-0899-45e8-9164-0b3a9efe7194 is being set with open permissions: ugo+rw
Jul 10 13:02:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4b2b85af-0899-45e8-9164-0b3a9efe7194 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:14 devstack sudo[106915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4b2b85af-0899-45e8-9164-0b3a9efe7194
Jul 10 13:02:14 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:15 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4b2b85af-0899-45e8-9164-0b3a9efe7194" returned: 0 in 0.633s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:15 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] Lock "cinder-quobyte-4b2b85af-0899-45e8-9164-0b3a9efe7194" released by "_copy_volume_from_snapshot" :: held 8.495s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:02:15 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] Lock "cinder-quobyte-ec477256-bcf8-4007-b6a6-c4eb64b6bb65-4b2b85af-0899-45e8-9164-0b3a9efe7194" released by "_create_volume_from_snapshot" :: held 8.549s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:02:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.584s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:02:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5f49fe42-240d-4fec-b012-7cac911243f2 tempest-CinderUnicodeTest-1866586889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.094s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:02:15 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5f49fe42-240d-4fec-b012-7cac911243f2 tempest-CinderUnicodeTest-1866586889 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10043955-3352-49c3-8364-a27ae509d552,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ed1164aaff43fbaf693baf9ada1b9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:02:06Z,use_quota=True,user_id='3cc9a657248a43b3b89f60ca13e55443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 13:02:15 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-5f49fe42-240d-4fec-b012-7cac911243f2 tempest-CinderUnicodeTest-1866586889 None] Creating volume 10043955-3352-49c3-8364-a27ae509d552 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 13:02:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5f49fe42-240d-4fec-b012-7cac911243f2 tempest-CinderUnicodeTest-1866586889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:02:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5f49fe42-240d-4fec-b012-7cac911243f2 tempest-CinderUnicodeTest-1866586889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:02:15 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5f49fe42-240d-4fec-b012-7cac911243f2 tempest-CinderUnicodeTest-1866586889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:02:15 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5f49fe42-240d-4fec-b012-7cac911243f2 tempest-CinderUnicodeTest-1866586889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:02:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5f49fe42-240d-4fec-b012-7cac911243f2 tempest-CinderUnicodeTest-1866586889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:02:15 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5f49fe42-240d-4fec-b012-7cac911243f2 tempest-CinderUnicodeTest-1866586889 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 13:02:15 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-5f49fe42-240d-4fec-b012-7cac911243f2 tempest-CinderUnicodeTest-1866586889 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 13:02:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5f49fe42-240d-4fec-b012-7cac911243f2 tempest-CinderUnicodeTest-1866586889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-10043955-3352-49c3-8364-a27ae509d552 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:15 devstack sudo[106918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-10043955-3352-49c3-8364-a27ae509d552 1073741824
Jul 10 13:02:15 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:15 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed08062a-0f4c-4cec-a208-f2218502aa49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b2b85af-0899-45e8-9164-0b3a9efe7194', 'volume_size': 1, 'snapshot_id': 'ec477256-bcf8-4007-b6a6-c4eb64b6bb65'}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:15 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60876e8a-be05-4df0-b85f-4b84ad346bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:15 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] Volume volume-4b2b85af-0899-45e8-9164-0b3a9efe7194 (4b2b85af-0899-45e8-9164-0b3a9efe7194): created successfully
Jul 10 13:02:15 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60876e8a-be05-4df0-b85f-4b84ad346bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:15 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] Flow 'volume_create_manager' (bafdd865-915a-4aea-9450-32c507064aec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:02:15 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-aafe28b1-f06e-4e54-8707-7549dc28724e tempest-SnapshotDependencyTests-1971894314 None] Created volume successfully.
Jul 10 13:02:15 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-ce8b0394-08db-4b76-bb94-be20dbd84e82 tempest-SnapshotDependencyTests-1971894314 None] Acquiring lock "cinder-ec477256-bcf8-4007-b6a6-c4eb64b6bb65-delete_snapshot" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:02:15 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-ce8b0394-08db-4b76-bb94-be20dbd84e82 tempest-SnapshotDependencyTests-1971894314 None] Lock "cinder-ec477256-bcf8-4007-b6a6-c4eb64b6bb65-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:02:15 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-ce8b0394-08db-4b76-bb94-be20dbd84e82 tempest-SnapshotDependencyTests-1971894314 None] Acquiring lock "cinder-quobyte-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:02:15 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-ce8b0394-08db-4b76-bb94-be20dbd84e82 tempest-SnapshotDependencyTests-1971894314 None] Lock "cinder-quobyte-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:02:15 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-ce8b0394-08db-4b76-bb94-be20dbd84e82 tempest-SnapshotDependencyTests-1971894314 None] Acquiring lock "cinder-quobyte-ec477256-bcf8-4007-b6a6-c4eb64b6bb65" by "_delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:02:16 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-ce8b0394-08db-4b76-bb94-be20dbd84e82 tempest-SnapshotDependencyTests-1971894314 None] Lock "cinder-quobyte-ec477256-bcf8-4007-b6a6-c4eb64b6bb65" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:02:16 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-ce8b0394-08db-4b76-bb94-be20dbd84e82 tempest-SnapshotDependencyTests-1971894314 None] Deleting offline snapshot ec477256-bcf8-4007-b6a6-c4eb64b6bb65 of volume f85f4dbe-42fa-4fc9-85a9-2a3f3f362359 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 10 13:02:16 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-ce8b0394-08db-4b76-bb94-be20dbd84e82 tempest-SnapshotDependencyTests-1971894314 None] snapshot_file for this snap is: volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359.ec477256-bcf8-4007-b6a6-c4eb64b6bb65 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 10 13:02:16 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[477c84c0-00fb-4d54-b0b0-c2b996b07b45]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:02:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ce8b0394-08db-4b76-bb94-be20dbd84e82 tempest-SnapshotDependencyTests-1971894314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359.ec477256-bcf8-4007-b6a6-c4eb64b6bb65 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:16 devstack sudo[106923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359.ec477256-bcf8-4007-b6a6-c4eb64b6bb65
Jul 10 13:02:16 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:16 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5f49fe42-240d-4fec-b012-7cac911243f2 tempest-CinderUnicodeTest-1866586889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-10043955-3352-49c3-8364-a27ae509d552 1073741824" returned: 0 in 0.854s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5f49fe42-240d-4fec-b012-7cac911243f2 tempest-CinderUnicodeTest-1866586889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-10043955-3352-49c3-8364-a27ae509d552 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:16 devstack sudo[106925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-10043955-3352-49c3-8364-a27ae509d552
Jul 10 13:02:16 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:16 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ce8b0394-08db-4b76-bb94-be20dbd84e82 tempest-SnapshotDependencyTests-1971894314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359.ec477256-bcf8-4007-b6a6-c4eb64b6bb65" returned: 0 in 0.748s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:16 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-ce8b0394-08db-4b76-bb94-be20dbd84e82 tempest-SnapshotDependencyTests-1971894314 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 13:02:16 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14a3e9a-374b-402b-9468-7db12542acc7]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:02:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ce8b0394-08db-4b76-bb94-be20dbd84e82 tempest-SnapshotDependencyTests-1971894314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:16 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5f49fe42-240d-4fec-b012-7cac911243f2 tempest-CinderUnicodeTest-1866586889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-10043955-3352-49c3-8364-a27ae509d552" returned: 0 in 0.651s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:16 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5f49fe42-240d-4fec-b012-7cac911243f2 tempest-CinderUnicodeTest-1866586889 None] <== create_volume: return (1548ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 13:02:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5f49fe42-240d-4fec-b012-7cac911243f2 tempest-CinderUnicodeTest-1866586889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.552s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:02:16 devstack sudo[106931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359
Jul 10 13:02:16 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-054d2a94-8093-444f-9a52-010c816af27d tempest-ProjectReaderTests-1805919051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.547s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:02:16 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5f49fe42-240d-4fec-b012-7cac911243f2 tempest-CinderUnicodeTest-1866586889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbc6e7e3-c1bc-438f-b1a4-f7f3b19102d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10043955-3352-49c3-8364-a27ae509d552', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:16 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5f49fe42-240d-4fec-b012-7cac911243f2 tempest-CinderUnicodeTest-1866586889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8d60b14-0395-4a75-83bf-44e9a9bfb7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:16 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-054d2a94-8093-444f-9a52-010c816af27d tempest-ProjectReaderTests-1805919051 None] Creating offline snapshot ee70d649-839d-4530-b82a-e61a53cb726f of volume e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75 {{(pid=87378) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 10 13:02:16 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-5f49fe42-240d-4fec-b012-7cac911243f2 tempest-CinderUnicodeTest-1866586889 None] Volume volume-10043955-3352-49c3-8364-a27ae509d552 (10043955-3352-49c3-8364-a27ae509d552): created successfully
Jul 10 13:02:16 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5f49fe42-240d-4fec-b012-7cac911243f2 tempest-CinderUnicodeTest-1866586889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8d60b14-0395-4a75-83bf-44e9a9bfb7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:17 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-5f49fe42-240d-4fec-b012-7cac911243f2 tempest-CinderUnicodeTest-1866586889 None] Flow 'volume_create_manager' (948b6673-6725-440d-87f2-29f372bd8baa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:02:17 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f28163-c4e6-48ba-8302-2ee7389aaf7a]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:02:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-054d2a94-8093-444f-9a52-010c816af27d tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:17 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-5f49fe42-240d-4fec-b012-7cac911243f2 tempest-CinderUnicodeTest-1866586889 None] Created volume successfully.
Jul 10 13:02:17 devstack sudo[106933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75
Jul 10 13:02:17 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:17 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ce8b0394-08db-4b76-bb94-be20dbd84e82 tempest-SnapshotDependencyTests-1971894314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359" returned: 0 in 0.783s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ce8b0394-08db-4b76-bb94-be20dbd84e82 tempest-SnapshotDependencyTests-1971894314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359.ec477256-bcf8-4007-b6a6-c4eb64b6bb65 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:17 devstack sudo[106938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359.ec477256-bcf8-4007-b6a6-c4eb64b6bb65
Jul 10 13:02:17 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:17 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-054d2a94-8093-444f-9a52-010c816af27d tempest-ProjectReaderTests-1805919051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75" returned: 0 in 0.749s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-054d2a94-8093-444f-9a52-010c816af27d tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75.ee70d649-839d-4530-b82a-e61a53cb726f 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:17 devstack sudo[106943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75.ee70d649-839d-4530-b82a-e61a53cb726f 1G
Jul 10 13:02:17 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:18 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ce8b0394-08db-4b76-bb94-be20dbd84e82 tempest-SnapshotDependencyTests-1971894314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359.ec477256-bcf8-4007-b6a6-c4eb64b6bb65" returned: 0 in 0.765s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ce8b0394-08db-4b76-bb94-be20dbd84e82 tempest-SnapshotDependencyTests-1971894314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359.ec477256-bcf8-4007-b6a6-c4eb64b6bb65 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:18 devstack sudo[106951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359.ec477256-bcf8-4007-b6a6-c4eb64b6bb65
Jul 10 13:02:18 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:18 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-054d2a94-8093-444f-9a52-010c816af27d tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75.ee70d649-839d-4530-b82a-e61a53cb726f 1G" returned: 0 in 0.838s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-054d2a94-8093-444f-9a52-010c816af27d tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75.ee70d649-839d-4530-b82a-e61a53cb726f {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:18 devstack sudo[106954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75.ee70d649-839d-4530-b82a-e61a53cb726f
Jul 10 13:02:18 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:18 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-12374dc6-c68c-4e92-ad60-d6200abb7cd6 tempest-CinderUnicodeTest-1866586889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 13:02:18 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-12374dc6-c68c-4e92-ad60-d6200abb7cd6 tempest-CinderUnicodeTest-1866586889 None] Flow 'volume_create_manager' (ca84ff57-54fd-44c3-8326-338dcda4aef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:02:18 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-12374dc6-c68c-4e92-ad60-d6200abb7cd6 tempest-CinderUnicodeTest-1866586889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93b94f90-e601-430a-b585-b6760914dfd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:18 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-12374dc6-c68c-4e92-ad60-d6200abb7cd6 tempest-CinderUnicodeTest-1866586889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93b94f90-e601-430a-b585-b6760914dfd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:02:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1103218591',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e578c67-c256-4ab2-8bd9-7bbde45e896a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ed1164aaff43fbaf693baf9ada1b9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:02:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:02:19Z,use_quota=True,user_id='3cc9a657248a43b3b89f60ca13e55443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:18 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-12374dc6-c68c-4e92-ad60-d6200abb7cd6 tempest-CinderUnicodeTest-1866586889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e603042d-c2b5-4136-858f-64b16cea188c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:18 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-12374dc6-c68c-4e92-ad60-d6200abb7cd6 tempest-CinderUnicodeTest-1866586889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e603042d-c2b5-4136-858f-64b16cea188c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:18 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-12374dc6-c68c-4e92-ad60-d6200abb7cd6 tempest-CinderUnicodeTest-1866586889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91bb7405-85e8-4ccb-8c61-02adca397095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:18 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-12374dc6-c68c-4e92-ad60-d6200abb7cd6 tempest-CinderUnicodeTest-1866586889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91bb7405-85e8-4ccb-8c61-02adca397095) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e578c67-c256-4ab2-8bd9-7bbde45e896a', 'volume_name': 'volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:18 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-12374dc6-c68c-4e92-ad60-d6200abb7cd6 tempest-CinderUnicodeTest-1866586889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71124d58-b337-430b-9544-93657a8e5ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:18 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-12374dc6-c68c-4e92-ad60-d6200abb7cd6 tempest-CinderUnicodeTest-1866586889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71124d58-b337-430b-9544-93657a8e5ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:18 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-12374dc6-c68c-4e92-ad60-d6200abb7cd6 tempest-CinderUnicodeTest-1866586889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2718cf0e-c1d4-43ce-ad76-91280ab07917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:18 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-12374dc6-c68c-4e92-ad60-d6200abb7cd6 tempest-CinderUnicodeTest-1866586889 None] Volume 2e578c67-c256-4ab2-8bd9-7bbde45e896a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a', 'volume_size': 1}
Jul 10 13:02:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-12374dc6-c68c-4e92-ad60-d6200abb7cd6 tempest-CinderUnicodeTest-1866586889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:02:19 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-ce8b0394-08db-4b76-bb94-be20dbd84e82 tempest-SnapshotDependencyTests-1971894314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359.ec477256-bcf8-4007-b6a6-c4eb64b6bb65" returned: 0 in 0.702s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:19 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-ce8b0394-08db-4b76-bb94-be20dbd84e82 tempest-SnapshotDependencyTests-1971894314 None] Lock "cinder-quobyte-ec477256-bcf8-4007-b6a6-c4eb64b6bb65" released by "_delete_snapshot" :: held 3.101s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:02:19 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-ce8b0394-08db-4b76-bb94-be20dbd84e82 tempest-SnapshotDependencyTests-1971894314 None] Lock "cinder-quobyte-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359" released by "delete_snapshot" :: held 3.126s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:02:19 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-ce8b0394-08db-4b76-bb94-be20dbd84e82 tempest-SnapshotDependencyTests-1971894314 None] Created reservations ['9ad44481-6164-4a6e-83d2-4ef0fae04aa5', '391fb4cf-3b13-474c-beb1-b15cede8a2da', 'ea919493-252c-4d7d-8497-b1fb4c514ccd', '3a016e8a-ca0d-4f31-850e-39831394c419'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:02:19 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-ce8b0394-08db-4b76-bb94-be20dbd84e82 tempest-SnapshotDependencyTests-1971894314 None] Delete snapshot completed successfully.
Jul 10 13:02:19 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-ce8b0394-08db-4b76-bb94-be20dbd84e82 tempest-SnapshotDependencyTests-1971894314 None] Lock "cinder-ec477256-bcf8-4007-b6a6-c4eb64b6bb65-delete_snapshot" released by "delete_snapshot" :: held 3.270s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:02:19 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-054d2a94-8093-444f-9a52-010c816af27d tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75.ee70d649-839d-4530-b82a-e61a53cb726f" returned: 0 in 0.735s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:19 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-054d2a94-8093-444f-9a52-010c816af27d tempest-ProjectReaderTests-1805919051 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75.ee70d649-839d-4530-b82a-e61a53cb726f is being set with open permissions: ugo+rw
Jul 10 13:02:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-054d2a94-8093-444f-9a52-010c816af27d tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75.ee70d649-839d-4530-b82a-e61a53cb726f {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:19 devstack sudo[106960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75.ee70d649-839d-4530-b82a-e61a53cb726f
Jul 10 13:02:19 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:19 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-054d2a94-8093-444f-9a52-010c816af27d tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75.ee70d649-839d-4530-b82a-e61a53cb726f" returned: 0 in 0.650s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-054d2a94-8093-444f-9a52-010c816af27d tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:20 devstack sudo[106964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75.info
Jul 10 13:02:20 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:20 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e7cf370f-9c57-4b26-90de-4787e9068ddc tempest-SnapshotDependencyTests-1971894314 None] Acquiring lock "cinder-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:02:20 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e7cf370f-9c57-4b26-90de-4787e9068ddc tempest-SnapshotDependencyTests-1971894314 None] Lock "cinder-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:02:20 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e7cf370f-9c57-4b26-90de-4787e9068ddc tempest-SnapshotDependencyTests-1971894314 None] Acquiring lock "cinder-quobyte-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:02:20 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e7cf370f-9c57-4b26-90de-4787e9068ddc tempest-SnapshotDependencyTests-1971894314 None] Lock "cinder-quobyte-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359" acquired by "delete_volume" :: waited 0.017s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:02:20 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[baad6e80-2159-4b74-a613-55db2a3cc8ab]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:02:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e7cf370f-9c57-4b26-90de-4787e9068ddc tempest-SnapshotDependencyTests-1971894314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:20 devstack sudo[106966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359
Jul 10 13:02:20 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:20 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-054d2a94-8093-444f-9a52-010c816af27d tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75.info" returned: 0 in 0.666s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:20 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-054d2a94-8093-444f-9a52-010c816af27d tempest-ProjectReaderTests-1805919051 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75.info is being set with open permissions: ugo+rw
Jul 10 13:02:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-054d2a94-8093-444f-9a52-010c816af27d tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:20 devstack sudo[106969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75.info
Jul 10 13:02:20 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:21 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e7cf370f-9c57-4b26-90de-4787e9068ddc tempest-SnapshotDependencyTests-1971894314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359" returned: 0 in 0.769s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e7cf370f-9c57-4b26-90de-4787e9068ddc tempest-SnapshotDependencyTests-1971894314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:21 devstack sudo[106974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359
Jul 10 13:02:21 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:21 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-054d2a94-8093-444f-9a52-010c816af27d tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75.info" returned: 0 in 0.658s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-054d2a94-8093-444f-9a52-010c816af27d tempest-ProjectReaderTests-1805919051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.419s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:02:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a4c60c5e-bf7d-40c2-866d-e3f59e09b10c tempest-ProjectReaderTests-1955870770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.498s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:02:21 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-a4c60c5e-bf7d-40c2-866d-e3f59e09b10c tempest-ProjectReaderTests-1955870770 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1486967489',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4225e13b-7323-4aef-9876-fed6c65a825d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbf2f22893f0436aaf2b492048ee771a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:02:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:02:12Z,use_quota=True,user_id='7297474b49d844dca1ea14972fb95c7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 13:02:21 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-a4c60c5e-bf7d-40c2-866d-e3f59e09b10c tempest-ProjectReaderTests-1955870770 None] Creating volume 4225e13b-7323-4aef-9876-fed6c65a825d {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 13:02:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a4c60c5e-bf7d-40c2-866d-e3f59e09b10c tempest-ProjectReaderTests-1955870770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:02:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a4c60c5e-bf7d-40c2-866d-e3f59e09b10c tempest-ProjectReaderTests-1955870770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:02:21 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-a4c60c5e-bf7d-40c2-866d-e3f59e09b10c tempest-ProjectReaderTests-1955870770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:02:21 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-a4c60c5e-bf7d-40c2-866d-e3f59e09b10c tempest-ProjectReaderTests-1955870770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:02:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a4c60c5e-bf7d-40c2-866d-e3f59e09b10c tempest-ProjectReaderTests-1955870770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:02:21 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-a4c60c5e-bf7d-40c2-866d-e3f59e09b10c tempest-ProjectReaderTests-1955870770 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 13:02:21 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-a4c60c5e-bf7d-40c2-866d-e3f59e09b10c tempest-ProjectReaderTests-1955870770 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 13:02:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a4c60c5e-bf7d-40c2-866d-e3f59e09b10c tempest-ProjectReaderTests-1955870770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4225e13b-7323-4aef-9876-fed6c65a825d 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:21 devstack sudo[106977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4225e13b-7323-4aef-9876-fed6c65a825d 1073741824
Jul 10 13:02:21 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:21 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-054d2a94-8093-444f-9a52-010c816af27d tempest-ProjectReaderTests-1805919051 None] Create snapshot completed successfully
Jul 10 13:02:21 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e7cf370f-9c57-4b26-90de-4787e9068ddc tempest-SnapshotDependencyTests-1971894314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359" returned: 0 in 0.683s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:21 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e7cf370f-9c57-4b26-90de-4787e9068ddc tempest-SnapshotDependencyTests-1971894314 None] Lock "cinder-quobyte-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359" released by "delete_volume" :: held 1.519s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:02:21 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-e7cf370f-9c57-4b26-90de-4787e9068ddc tempest-SnapshotDependencyTests-1971894314 None] Created reservations ['e23d9d8b-1db3-408c-b418-e81f7bdae025', 'f8efc536-a66d-44e2-89cc-1a4e9d7bc8cd', '452f8ed2-289c-47ad-8b64-73df66f6c895', 'ebc009b9-1154-4ac8-8705-798461d8bac0'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:02:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e7cf370f-9c57-4b26-90de-4787e9068ddc tempest-SnapshotDependencyTests-1971894314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:02:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e7cf370f-9c57-4b26-90de-4787e9068ddc tempest-SnapshotDependencyTests-1971894314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:02:21 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-e7cf370f-9c57-4b26-90de-4787e9068ddc tempest-SnapshotDependencyTests-1971894314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:02:21 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-e7cf370f-9c57-4b26-90de-4787e9068ddc tempest-SnapshotDependencyTests-1971894314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:02:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e7cf370f-9c57-4b26-90de-4787e9068ddc tempest-SnapshotDependencyTests-1971894314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:02:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e7cf370f-9c57-4b26-90de-4787e9068ddc tempest-SnapshotDependencyTests-1971894314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:21 devstack sudo[106980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:02:21 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:22 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-0031f96f-f39c-4701-80aa-dd8749fe3a9b tempest-ProjectReaderTests-1805919051 None] Acquiring lock "cinder-ee70d649-839d-4530-b82a-e61a53cb726f-delete_snapshot" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:02:22 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-0031f96f-f39c-4701-80aa-dd8749fe3a9b tempest-ProjectReaderTests-1805919051 None] Lock "cinder-ee70d649-839d-4530-b82a-e61a53cb726f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:02:22 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-0031f96f-f39c-4701-80aa-dd8749fe3a9b tempest-ProjectReaderTests-1805919051 None] Acquiring lock "cinder-quobyte-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:02:22 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-0031f96f-f39c-4701-80aa-dd8749fe3a9b tempest-ProjectReaderTests-1805919051 None] Lock "cinder-quobyte-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:02:22 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-0031f96f-f39c-4701-80aa-dd8749fe3a9b tempest-ProjectReaderTests-1805919051 None] Acquiring lock "cinder-quobyte-ee70d649-839d-4530-b82a-e61a53cb726f" by "_delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:02:22 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-0031f96f-f39c-4701-80aa-dd8749fe3a9b tempest-ProjectReaderTests-1805919051 None] Lock "cinder-quobyte-ee70d649-839d-4530-b82a-e61a53cb726f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:02:22 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-0031f96f-f39c-4701-80aa-dd8749fe3a9b tempest-ProjectReaderTests-1805919051 None] Deleting offline snapshot ee70d649-839d-4530-b82a-e61a53cb726f of volume e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 10 13:02:22 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-0031f96f-f39c-4701-80aa-dd8749fe3a9b tempest-ProjectReaderTests-1805919051 None] snapshot_file for this snap is: volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75.ee70d649-839d-4530-b82a-e61a53cb726f {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 10 13:02:22 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c03c36-bb14-4fae-a75a-0903d3061ba0]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:02:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0031f96f-f39c-4701-80aa-dd8749fe3a9b tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75.ee70d649-839d-4530-b82a-e61a53cb726f {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:22 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a4c60c5e-bf7d-40c2-866d-e3f59e09b10c tempest-ProjectReaderTests-1955870770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4225e13b-7323-4aef-9876-fed6c65a825d 1073741824" returned: 0 in 0.935s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a4c60c5e-bf7d-40c2-866d-e3f59e09b10c tempest-ProjectReaderTests-1955870770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4225e13b-7323-4aef-9876-fed6c65a825d {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:22 devstack sudo[106986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4225e13b-7323-4aef-9876-fed6c65a825d
Jul 10 13:02:22 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:22 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-4a391a16-bc89-41c6-8c28-5ab5f523fbe1 tempest-SnapshotDependencyTests-1971894314 None] Acquiring lock "cinder-4b2b85af-0899-45e8-9164-0b3a9efe7194-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:02:22 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-4a391a16-bc89-41c6-8c28-5ab5f523fbe1 tempest-SnapshotDependencyTests-1971894314 None] Lock "cinder-4b2b85af-0899-45e8-9164-0b3a9efe7194-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:02:22 devstack sudo[106985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75.ee70d649-839d-4530-b82a-e61a53cb726f
Jul 10 13:02:22 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:22 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-4a391a16-bc89-41c6-8c28-5ab5f523fbe1 tempest-SnapshotDependencyTests-1971894314 None] Acquiring lock "cinder-quobyte-4b2b85af-0899-45e8-9164-0b3a9efe7194" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:02:22 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-4a391a16-bc89-41c6-8c28-5ab5f523fbe1 tempest-SnapshotDependencyTests-1971894314 None] Lock "cinder-quobyte-4b2b85af-0899-45e8-9164-0b3a9efe7194" acquired by "delete_volume" :: waited 0.019s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:02:22 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[11effe8b-5bd1-48ef-a1c3-e35410ce40bb]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:02:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4a391a16-bc89-41c6-8c28-5ab5f523fbe1 tempest-SnapshotDependencyTests-1971894314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4b2b85af-0899-45e8-9164-0b3a9efe7194 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:22 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e7cf370f-9c57-4b26-90de-4787e9068ddc tempest-SnapshotDependencyTests-1971894314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.755s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:22 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-e7cf370f-9c57-4b26-90de-4787e9068ddc tempest-SnapshotDependencyTests-1971894314 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:02:22 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-e7cf370f-9c57-4b26-90de-4787e9068ddc tempest-SnapshotDependencyTests-1971894314 None] Deleted volume successfully.
Jul 10 13:02:22 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e7cf370f-9c57-4b26-90de-4787e9068ddc tempest-SnapshotDependencyTests-1971894314 None] Lock "cinder-f85f4dbe-42fa-4fc9-85a9-2a3f3f362359-delete_volume" released by "delete_volume" :: held 2.467s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:02:22 devstack sudo[106990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4b2b85af-0899-45e8-9164-0b3a9efe7194
Jul 10 13:02:22 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:23 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a4c60c5e-bf7d-40c2-866d-e3f59e09b10c tempest-ProjectReaderTests-1955870770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4225e13b-7323-4aef-9876-fed6c65a825d" returned: 0 in 0.728s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:23 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-a4c60c5e-bf7d-40c2-866d-e3f59e09b10c tempest-ProjectReaderTests-1955870770 None] <== create_volume: return (1712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 13:02:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a4c60c5e-bf7d-40c2-866d-e3f59e09b10c tempest-ProjectReaderTests-1955870770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.716s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:02:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-12374dc6-c68c-4e92-ad60-d6200abb7cd6 tempest-CinderUnicodeTest-1866586889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.292s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:02:23 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-12374dc6-c68c-4e92-ad60-d6200abb7cd6 tempest-CinderUnicodeTest-1866586889 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:02:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1103218591',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e578c67-c256-4ab2-8bd9-7bbde45e896a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ed1164aaff43fbaf693baf9ada1b9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:02:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:02:19Z,use_quota=True,user_id='3cc9a657248a43b3b89f60ca13e55443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 13:02:23 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-12374dc6-c68c-4e92-ad60-d6200abb7cd6 tempest-CinderUnicodeTest-1866586889 None] Creating volume 2e578c67-c256-4ab2-8bd9-7bbde45e896a {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 13:02:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-12374dc6-c68c-4e92-ad60-d6200abb7cd6 tempest-CinderUnicodeTest-1866586889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:02:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-12374dc6-c68c-4e92-ad60-d6200abb7cd6 tempest-CinderUnicodeTest-1866586889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:02:23 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-12374dc6-c68c-4e92-ad60-d6200abb7cd6 tempest-CinderUnicodeTest-1866586889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:02:23 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-12374dc6-c68c-4e92-ad60-d6200abb7cd6 tempest-CinderUnicodeTest-1866586889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:02:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-12374dc6-c68c-4e92-ad60-d6200abb7cd6 tempest-CinderUnicodeTest-1866586889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:02:23 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-12374dc6-c68c-4e92-ad60-d6200abb7cd6 tempest-CinderUnicodeTest-1866586889 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 13:02:23 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-12374dc6-c68c-4e92-ad60-d6200abb7cd6 tempest-CinderUnicodeTest-1866586889 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 13:02:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-12374dc6-c68c-4e92-ad60-d6200abb7cd6 tempest-CinderUnicodeTest-1866586889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:23 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0031f96f-f39c-4701-80aa-dd8749fe3a9b tempest-ProjectReaderTests-1805919051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75.ee70d649-839d-4530-b82a-e61a53cb726f" returned: 0 in 0.819s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:23 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-0031f96f-f39c-4701-80aa-dd8749fe3a9b tempest-ProjectReaderTests-1805919051 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 13:02:23 devstack sudo[106996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a 1073741824
Jul 10 13:02:23 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:23 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa13777a-6b4e-4025-98db-c070d6668021]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:02:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0031f96f-f39c-4701-80aa-dd8749fe3a9b tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:23 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a4c60c5e-bf7d-40c2-866d-e3f59e09b10c tempest-ProjectReaderTests-1955870770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c434ca01-5d38-46dd-8b39-a9456096df90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4225e13b-7323-4aef-9876-fed6c65a825d', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:23 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a4c60c5e-bf7d-40c2-866d-e3f59e09b10c tempest-ProjectReaderTests-1955870770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd8ef4a9-de2c-4b84-a817-f18346c6610e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:23 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-a4c60c5e-bf7d-40c2-866d-e3f59e09b10c tempest-ProjectReaderTests-1955870770 None] Volume volume-4225e13b-7323-4aef-9876-fed6c65a825d (4225e13b-7323-4aef-9876-fed6c65a825d): created successfully
Jul 10 13:02:23 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a4c60c5e-bf7d-40c2-866d-e3f59e09b10c tempest-ProjectReaderTests-1955870770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd8ef4a9-de2c-4b84-a817-f18346c6610e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:23 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-a4c60c5e-bf7d-40c2-866d-e3f59e09b10c tempest-ProjectReaderTests-1955870770 None] Flow 'volume_create_manager' (55b620ea-2609-41b5-9a7d-0d846281b77c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:02:23 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-a4c60c5e-bf7d-40c2-866d-e3f59e09b10c tempest-ProjectReaderTests-1955870770 None] Created volume successfully.
Jul 10 13:02:23 devstack sudo[106998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75
Jul 10 13:02:23 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:23 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4a391a16-bc89-41c6-8c28-5ab5f523fbe1 tempest-SnapshotDependencyTests-1971894314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4b2b85af-0899-45e8-9164-0b3a9efe7194" returned: 0 in 0.898s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4a391a16-bc89-41c6-8c28-5ab5f523fbe1 tempest-SnapshotDependencyTests-1971894314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4b2b85af-0899-45e8-9164-0b3a9efe7194 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:23 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-7c7afd58-2013-4d28-9fc3-af02949d8a27 tempest-ProjectReaderTests-1955870770 None] Acquiring lock "cinder-4225e13b-7323-4aef-9876-fed6c65a825d-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:02:23 devstack sudo[107003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4b2b85af-0899-45e8-9164-0b3a9efe7194
Jul 10 13:02:23 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:23 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-7c7afd58-2013-4d28-9fc3-af02949d8a27 tempest-ProjectReaderTests-1955870770 None] Lock "cinder-4225e13b-7323-4aef-9876-fed6c65a825d-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:02:23 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-7c7afd58-2013-4d28-9fc3-af02949d8a27 tempest-ProjectReaderTests-1955870770 None] Acquiring lock "cinder-quobyte-4225e13b-7323-4aef-9876-fed6c65a825d" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:02:23 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-7c7afd58-2013-4d28-9fc3-af02949d8a27 tempest-ProjectReaderTests-1955870770 None] Lock "cinder-quobyte-4225e13b-7323-4aef-9876-fed6c65a825d" acquired by "delete_volume" :: waited 0.026s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:02:23 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a5905a-1862-40f6-90e5-13a84677c568]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:02:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7c7afd58-2013-4d28-9fc3-af02949d8a27 tempest-ProjectReaderTests-1955870770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4225e13b-7323-4aef-9876-fed6c65a825d {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:23 devstack sudo[107005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4225e13b-7323-4aef-9876-fed6c65a825d
Jul 10 13:02:23 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:23 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0031f96f-f39c-4701-80aa-dd8749fe3a9b tempest-ProjectReaderTests-1805919051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75" returned: 0 in 0.832s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0031f96f-f39c-4701-80aa-dd8749fe3a9b tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75.ee70d649-839d-4530-b82a-e61a53cb726f {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:24 devstack sudo[107015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75.ee70d649-839d-4530-b82a-e61a53cb726f
Jul 10 13:02:24 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:24 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-12374dc6-c68c-4e92-ad60-d6200abb7cd6 tempest-CinderUnicodeTest-1866586889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a 1073741824" returned: 0 in 0.968s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-12374dc6-c68c-4e92-ad60-d6200abb7cd6 tempest-CinderUnicodeTest-1866586889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:24 devstack sudo[107018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a
Jul 10 13:02:24 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:24 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4a391a16-bc89-41c6-8c28-5ab5f523fbe1 tempest-SnapshotDependencyTests-1971894314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4b2b85af-0899-45e8-9164-0b3a9efe7194" returned: 0 in 0.801s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:24 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-4a391a16-bc89-41c6-8c28-5ab5f523fbe1 tempest-SnapshotDependencyTests-1971894314 None] Lock "cinder-quobyte-4b2b85af-0899-45e8-9164-0b3a9efe7194" released by "delete_volume" :: held 1.762s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:02:24 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-4a391a16-bc89-41c6-8c28-5ab5f523fbe1 tempest-SnapshotDependencyTests-1971894314 None] Created reservations ['ebeb517e-933b-4767-9e47-3ad6dc8a6c9f', 'b6404fad-ebaf-44a7-804c-98a57da1776e', '22e0658f-a586-43aa-865c-3139331b3ddb', '64ac09f9-ef34-4c53-b611-028592cefd56'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:02:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-4a391a16-bc89-41c6-8c28-5ab5f523fbe1 tempest-SnapshotDependencyTests-1971894314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:02:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-4a391a16-bc89-41c6-8c28-5ab5f523fbe1 tempest-SnapshotDependencyTests-1971894314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:02:24 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-4a391a16-bc89-41c6-8c28-5ab5f523fbe1 tempest-SnapshotDependencyTests-1971894314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:02:24 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-4a391a16-bc89-41c6-8c28-5ab5f523fbe1 tempest-SnapshotDependencyTests-1971894314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:02:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-4a391a16-bc89-41c6-8c28-5ab5f523fbe1 tempest-SnapshotDependencyTests-1971894314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:02:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4a391a16-bc89-41c6-8c28-5ab5f523fbe1 tempest-SnapshotDependencyTests-1971894314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:24 devstack sudo[107023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:02:24 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:24 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7c7afd58-2013-4d28-9fc3-af02949d8a27 tempest-ProjectReaderTests-1955870770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4225e13b-7323-4aef-9876-fed6c65a825d" returned: 0 in 0.909s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7c7afd58-2013-4d28-9fc3-af02949d8a27 tempest-ProjectReaderTests-1955870770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4225e13b-7323-4aef-9876-fed6c65a825d {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:24 devstack sudo[107025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4225e13b-7323-4aef-9876-fed6c65a825d
Jul 10 13:02:24 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:24 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-12374dc6-c68c-4e92-ad60-d6200abb7cd6 tempest-CinderUnicodeTest-1866586889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a" returned: 0 in 0.783s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:24 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-12374dc6-c68c-4e92-ad60-d6200abb7cd6 tempest-CinderUnicodeTest-1866586889 None] <== create_volume: return (1804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 13:02:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-12374dc6-c68c-4e92-ad60-d6200abb7cd6 tempest-CinderUnicodeTest-1866586889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.808s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:02:24 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-12374dc6-c68c-4e92-ad60-d6200abb7cd6 tempest-CinderUnicodeTest-1866586889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2718cf0e-c1d4-43ce-ad76-91280ab07917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:24 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-12374dc6-c68c-4e92-ad60-d6200abb7cd6 tempest-CinderUnicodeTest-1866586889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d02c361-1811-4995-b27c-8b37ccfeab59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:24 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-12374dc6-c68c-4e92-ad60-d6200abb7cd6 tempest-CinderUnicodeTest-1866586889 None] Volume volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a (2e578c67-c256-4ab2-8bd9-7bbde45e896a): created successfully
Jul 10 13:02:24 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-12374dc6-c68c-4e92-ad60-d6200abb7cd6 tempest-CinderUnicodeTest-1866586889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d02c361-1811-4995-b27c-8b37ccfeab59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:24 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-12374dc6-c68c-4e92-ad60-d6200abb7cd6 tempest-CinderUnicodeTest-1866586889 None] Flow 'volume_create_manager' (ca84ff57-54fd-44c3-8326-338dcda4aef0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:02:24 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-12374dc6-c68c-4e92-ad60-d6200abb7cd6 tempest-CinderUnicodeTest-1866586889 None] Created volume successfully.
Jul 10 13:02:25 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0031f96f-f39c-4701-80aa-dd8749fe3a9b tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75.ee70d649-839d-4530-b82a-e61a53cb726f" returned: 0 in 1.108s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0031f96f-f39c-4701-80aa-dd8749fe3a9b tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75.ee70d649-839d-4530-b82a-e61a53cb726f {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:25 devstack sudo[107031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75.ee70d649-839d-4530-b82a-e61a53cb726f
Jul 10 13:02:25 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:25 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-4a391a16-bc89-41c6-8c28-5ab5f523fbe1 tempest-SnapshotDependencyTests-1971894314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.756s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:25 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-4a391a16-bc89-41c6-8c28-5ab5f523fbe1 tempest-SnapshotDependencyTests-1971894314 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:02:25 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-4a391a16-bc89-41c6-8c28-5ab5f523fbe1 tempest-SnapshotDependencyTests-1971894314 None] Deleted volume successfully.
Jul 10 13:02:25 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-4a391a16-bc89-41c6-8c28-5ab5f523fbe1 tempest-SnapshotDependencyTests-1971894314 None] Lock "cinder-4b2b85af-0899-45e8-9164-0b3a9efe7194-delete_volume" released by "delete_volume" :: held 2.813s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:02:25 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7c7afd58-2013-4d28-9fc3-af02949d8a27 tempest-ProjectReaderTests-1955870770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4225e13b-7323-4aef-9876-fed6c65a825d" returned: 0 in 0.826s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:25 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-7c7afd58-2013-4d28-9fc3-af02949d8a27 tempest-ProjectReaderTests-1955870770 None] Lock "cinder-quobyte-4225e13b-7323-4aef-9876-fed6c65a825d" released by "delete_volume" :: held 1.780s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:02:25 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-7c7afd58-2013-4d28-9fc3-af02949d8a27 tempest-ProjectReaderTests-1955870770 None] Created reservations ['c9b0903c-e735-4459-8f9a-fc10b06bed96', 'c5e55b36-4b2e-4e07-bc93-7cbed5f912c3', 'd19c4800-7664-464d-9484-2024673c40ea', 'be3148f7-cba4-4ddc-a58c-15339081a43f'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:02:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-7c7afd58-2013-4d28-9fc3-af02949d8a27 tempest-ProjectReaderTests-1955870770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:02:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-7c7afd58-2013-4d28-9fc3-af02949d8a27 tempest-ProjectReaderTests-1955870770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:02:25 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-7c7afd58-2013-4d28-9fc3-af02949d8a27 tempest-ProjectReaderTests-1955870770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:02:25 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-7c7afd58-2013-4d28-9fc3-af02949d8a27 tempest-ProjectReaderTests-1955870770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:02:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-7c7afd58-2013-4d28-9fc3-af02949d8a27 tempest-ProjectReaderTests-1955870770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:02:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7c7afd58-2013-4d28-9fc3-af02949d8a27 tempest-ProjectReaderTests-1955870770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:25 devstack sudo[107035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:02:25 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:25 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0031f96f-f39c-4701-80aa-dd8749fe3a9b tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75.ee70d649-839d-4530-b82a-e61a53cb726f" returned: 0 in 0.774s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:25 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-0031f96f-f39c-4701-80aa-dd8749fe3a9b tempest-ProjectReaderTests-1805919051 None] Lock "cinder-quobyte-ee70d649-839d-4530-b82a-e61a53cb726f" released by "_delete_snapshot" :: held 3.656s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:02:25 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-0031f96f-f39c-4701-80aa-dd8749fe3a9b tempest-ProjectReaderTests-1805919051 None] Lock "cinder-quobyte-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75" released by "delete_snapshot" :: held 3.683s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:02:25 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-0031f96f-f39c-4701-80aa-dd8749fe3a9b tempest-ProjectReaderTests-1805919051 None] Created reservations ['ec1b6641-51f7-4e7b-b0c9-1b053bf17505', 'e89fae7d-7d05-4133-a5e4-d3b977adce3d', 'a2f382d3-37d0-4a03-b120-6d22b0458ee4', '5201efc4-ec9c-49da-abd8-944a61643f32'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:02:26 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-0031f96f-f39c-4701-80aa-dd8749fe3a9b tempest-ProjectReaderTests-1805919051 None] Delete snapshot completed successfully.
Jul 10 13:02:26 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-0031f96f-f39c-4701-80aa-dd8749fe3a9b tempest-ProjectReaderTests-1805919051 None] Lock "cinder-ee70d649-839d-4530-b82a-e61a53cb726f-delete_snapshot" released by "delete_snapshot" :: held 3.856s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:02:26 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7c7afd58-2013-4d28-9fc3-af02949d8a27 tempest-ProjectReaderTests-1955870770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.885s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:26 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-7c7afd58-2013-4d28-9fc3-af02949d8a27 tempest-ProjectReaderTests-1955870770 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:02:26 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-7c7afd58-2013-4d28-9fc3-af02949d8a27 tempest-ProjectReaderTests-1955870770 None] Deleted volume successfully.
Jul 10 13:02:26 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-7c7afd58-2013-4d28-9fc3-af02949d8a27 tempest-ProjectReaderTests-1955870770 None] Lock "cinder-4225e13b-7323-4aef-9876-fed6c65a825d-delete_volume" released by "delete_volume" :: held 2.944s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:02:26 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a5a4fb0-70fb-4b4e-908a-b2e1fbe0b6e2 tempest-ProjectReaderTests-1955870770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 13:02:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7a5a4fb0-70fb-4b4e-908a-b2e1fbe0b6e2 tempest-ProjectReaderTests-1955870770 None] Flow 'volume_create_manager' (3feaa6f2-22c0-415e-a249-234eda11383e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:02:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7a5a4fb0-70fb-4b4e-908a-b2e1fbe0b6e2 tempest-ProjectReaderTests-1955870770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08abaf13-4040-4c80-b199-f38e55a19752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:26 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1ce2c97d-5757-4302-878c-58ba71e6790f tempest-ProjectReaderTests-1805919051 None] Acquiring lock "cinder-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:02:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7a5a4fb0-70fb-4b4e-908a-b2e1fbe0b6e2 tempest-ProjectReaderTests-1955870770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08abaf13-4040-4c80-b199-f38e55a19752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-34910587',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d49ce8b5-0b9a-4649-9c13-baff1f08478c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbf2f22893f0436aaf2b492048ee771a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:02:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:02:26Z,use_quota=True,user_id='7297474b49d844dca1ea14972fb95c7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7a5a4fb0-70fb-4b4e-908a-b2e1fbe0b6e2 tempest-ProjectReaderTests-1955870770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4362f720-7352-4e5a-b900-99f40710d4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7a5a4fb0-70fb-4b4e-908a-b2e1fbe0b6e2 tempest-ProjectReaderTests-1955870770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4362f720-7352-4e5a-b900-99f40710d4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7a5a4fb0-70fb-4b4e-908a-b2e1fbe0b6e2 tempest-ProjectReaderTests-1955870770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (328184df-180f-46a0-9a88-1a5d3294902a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7a5a4fb0-70fb-4b4e-908a-b2e1fbe0b6e2 tempest-ProjectReaderTests-1955870770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (328184df-180f-46a0-9a88-1a5d3294902a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd49ce8b5-0b9a-4649-9c13-baff1f08478c', 'volume_name': 'volume-d49ce8b5-0b9a-4649-9c13-baff1f08478c', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7a5a4fb0-70fb-4b4e-908a-b2e1fbe0b6e2 tempest-ProjectReaderTests-1955870770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c305bea-4ef7-4997-a59a-516337b83830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7a5a4fb0-70fb-4b4e-908a-b2e1fbe0b6e2 tempest-ProjectReaderTests-1955870770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c305bea-4ef7-4997-a59a-516337b83830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:26 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7a5a4fb0-70fb-4b4e-908a-b2e1fbe0b6e2 tempest-ProjectReaderTests-1955870770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06d89e5b-6f49-4333-bf7c-043423825937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:26 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-7a5a4fb0-70fb-4b4e-908a-b2e1fbe0b6e2 tempest-ProjectReaderTests-1955870770 None] Volume d49ce8b5-0b9a-4649-9c13-baff1f08478c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d49ce8b5-0b9a-4649-9c13-baff1f08478c', 'volume_size': 1}
Jul 10 13:02:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-7a5a4fb0-70fb-4b4e-908a-b2e1fbe0b6e2 tempest-ProjectReaderTests-1955870770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:02:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-7a5a4fb0-70fb-4b4e-908a-b2e1fbe0b6e2 tempest-ProjectReaderTests-1955870770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:02:26 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-7a5a4fb0-70fb-4b4e-908a-b2e1fbe0b6e2 tempest-ProjectReaderTests-1955870770 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-34910587',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d49ce8b5-0b9a-4649-9c13-baff1f08478c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbf2f22893f0436aaf2b492048ee771a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:02:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:02:26Z,use_quota=True,user_id='7297474b49d844dca1ea14972fb95c7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 13:02:26 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-7a5a4fb0-70fb-4b4e-908a-b2e1fbe0b6e2 tempest-ProjectReaderTests-1955870770 None] Creating volume d49ce8b5-0b9a-4649-9c13-baff1f08478c {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 13:02:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-7a5a4fb0-70fb-4b4e-908a-b2e1fbe0b6e2 tempest-ProjectReaderTests-1955870770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:02:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-7a5a4fb0-70fb-4b4e-908a-b2e1fbe0b6e2 tempest-ProjectReaderTests-1955870770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:02:26 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-7a5a4fb0-70fb-4b4e-908a-b2e1fbe0b6e2 tempest-ProjectReaderTests-1955870770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:02:26 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-7a5a4fb0-70fb-4b4e-908a-b2e1fbe0b6e2 tempest-ProjectReaderTests-1955870770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:02:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-7a5a4fb0-70fb-4b4e-908a-b2e1fbe0b6e2 tempest-ProjectReaderTests-1955870770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:02:26 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-7a5a4fb0-70fb-4b4e-908a-b2e1fbe0b6e2 tempest-ProjectReaderTests-1955870770 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 13:02:26 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-7a5a4fb0-70fb-4b4e-908a-b2e1fbe0b6e2 tempest-ProjectReaderTests-1955870770 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 13:02:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7a5a4fb0-70fb-4b4e-908a-b2e1fbe0b6e2 tempest-ProjectReaderTests-1955870770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-d49ce8b5-0b9a-4649-9c13-baff1f08478c 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:26 devstack sudo[107041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-d49ce8b5-0b9a-4649-9c13-baff1f08478c 1073741824
Jul 10 13:02:26 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:26 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1ce2c97d-5757-4302-878c-58ba71e6790f tempest-ProjectReaderTests-1805919051 None] Lock "cinder-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75-delete_volume" acquired by "delete_volume" :: waited 0.129s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:02:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c8b46a9b-2283-4a1d-a9fd-6b422f34da43 tempest-CinderUnicodeTest-1866586889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:02:26 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1ce2c97d-5757-4302-878c-58ba71e6790f tempest-ProjectReaderTests-1805919051 None] Acquiring lock "cinder-quobyte-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:02:26 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1ce2c97d-5757-4302-878c-58ba71e6790f tempest-ProjectReaderTests-1805919051 None] Lock "cinder-quobyte-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75" acquired by "delete_volume" :: waited 0.016s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:02:26 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[05402caa-ecea-464f-a8df-6c917987576f]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:02:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1ce2c97d-5757-4302-878c-58ba71e6790f tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:26 devstack sudo[107043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75
Jul 10 13:02:26 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:27 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7a5a4fb0-70fb-4b4e-908a-b2e1fbe0b6e2 tempest-ProjectReaderTests-1955870770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-d49ce8b5-0b9a-4649-9c13-baff1f08478c 1073741824" returned: 0 in 0.954s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7a5a4fb0-70fb-4b4e-908a-b2e1fbe0b6e2 tempest-ProjectReaderTests-1955870770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-d49ce8b5-0b9a-4649-9c13-baff1f08478c {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:27 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1ce2c97d-5757-4302-878c-58ba71e6790f tempest-ProjectReaderTests-1805919051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75" returned: 0 in 0.853s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1ce2c97d-5757-4302-878c-58ba71e6790f tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:27 devstack sudo[107052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-d49ce8b5-0b9a-4649-9c13-baff1f08478c
Jul 10 13:02:27 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:27 devstack sudo[107053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75
Jul 10 13:02:27 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:28 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-7a5a4fb0-70fb-4b4e-908a-b2e1fbe0b6e2 tempest-ProjectReaderTests-1955870770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-d49ce8b5-0b9a-4649-9c13-baff1f08478c" returned: 0 in 0.731s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:28 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-7a5a4fb0-70fb-4b4e-908a-b2e1fbe0b6e2 tempest-ProjectReaderTests-1955870770 None] <== create_volume: return (1739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 13:02:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-7a5a4fb0-70fb-4b4e-908a-b2e1fbe0b6e2 tempest-ProjectReaderTests-1955870770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.744s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:02:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c8b46a9b-2283-4a1d-a9fd-6b422f34da43 tempest-CinderUnicodeTest-1866586889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.675s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:02:28 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1ce2c97d-5757-4302-878c-58ba71e6790f tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75" returned: 0 in 0.731s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:28 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-c8b46a9b-2283-4a1d-a9fd-6b422f34da43 tempest-CinderUnicodeTest-1866586889 None] Creating offline snapshot a5555a16-ce1d-47f4-9caf-754495e7b5d5 of volume 2e578c67-c256-4ab2-8bd9-7bbde45e896a {{(pid=87378) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 10 13:02:28 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7a5a4fb0-70fb-4b4e-908a-b2e1fbe0b6e2 tempest-ProjectReaderTests-1955870770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06d89e5b-6f49-4333-bf7c-043423825937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d49ce8b5-0b9a-4649-9c13-baff1f08478c', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:28 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7a5a4fb0-70fb-4b4e-908a-b2e1fbe0b6e2 tempest-ProjectReaderTests-1955870770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11e956d1-a786-4f2b-afa5-bb3637f499a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:28 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1ce2c97d-5757-4302-878c-58ba71e6790f tempest-ProjectReaderTests-1805919051 None] Lock "cinder-quobyte-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75" released by "delete_volume" :: held 1.694s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:02:28 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c946295-f8bf-4f1c-8760-1b7393e7524d]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:02:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c8b46a9b-2283-4a1d-a9fd-6b422f34da43 tempest-CinderUnicodeTest-1866586889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:28 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-7a5a4fb0-70fb-4b4e-908a-b2e1fbe0b6e2 tempest-ProjectReaderTests-1955870770 None] Volume volume-d49ce8b5-0b9a-4649-9c13-baff1f08478c (d49ce8b5-0b9a-4649-9c13-baff1f08478c): created successfully
Jul 10 13:02:28 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7a5a4fb0-70fb-4b4e-908a-b2e1fbe0b6e2 tempest-ProjectReaderTests-1955870770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11e956d1-a786-4f2b-afa5-bb3637f499a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:28 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-7a5a4fb0-70fb-4b4e-908a-b2e1fbe0b6e2 tempest-ProjectReaderTests-1955870770 None] Flow 'volume_create_manager' (3feaa6f2-22c0-415e-a249-234eda11383e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:02:28 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-7a5a4fb0-70fb-4b4e-908a-b2e1fbe0b6e2 tempest-ProjectReaderTests-1955870770 None] Created volume successfully.
Jul 10 13:02:28 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-1ce2c97d-5757-4302-878c-58ba71e6790f tempest-ProjectReaderTests-1805919051 None] Created reservations ['d94a753e-afbb-4539-b9b2-83e4def16d37', '3293f283-d7af-4c9f-aca5-35a5a29f2158', '556e55e3-885e-407f-9f36-cd46abff3337', '27bc02c0-c22a-4568-abb5-2bcfb81a0440'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:02:28 devstack sudo[107058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a
Jul 10 13:02:28 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1ce2c97d-5757-4302-878c-58ba71e6790f tempest-ProjectReaderTests-1805919051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:02:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1ce2c97d-5757-4302-878c-58ba71e6790f tempest-ProjectReaderTests-1805919051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:02:28 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-1ce2c97d-5757-4302-878c-58ba71e6790f tempest-ProjectReaderTests-1805919051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:02:28 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-1ce2c97d-5757-4302-878c-58ba71e6790f tempest-ProjectReaderTests-1805919051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:02:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1ce2c97d-5757-4302-878c-58ba71e6790f tempest-ProjectReaderTests-1805919051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:02:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1ce2c97d-5757-4302-878c-58ba71e6790f tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:28 devstack sudo[107060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:02:28 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:29 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c8b46a9b-2283-4a1d-a9fd-6b422f34da43 tempest-CinderUnicodeTest-1866586889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a" returned: 0 in 1.021s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c8b46a9b-2283-4a1d-a9fd-6b422f34da43 tempest-CinderUnicodeTest-1866586889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a.a5555a16-ce1d-47f4-9caf-754495e7b5d5 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:29 devstack sudo[107103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a.a5555a16-ce1d-47f4-9caf-754495e7b5d5 1G
Jul 10 13:02:29 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:29 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1ce2c97d-5757-4302-878c-58ba71e6790f tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.986s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:29 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-1ce2c97d-5757-4302-878c-58ba71e6790f tempest-ProjectReaderTests-1805919051 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:02:29 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-1ce2c97d-5757-4302-878c-58ba71e6790f tempest-ProjectReaderTests-1805919051 None] Deleted volume successfully.
Jul 10 13:02:29 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1ce2c97d-5757-4302-878c-58ba71e6790f tempest-ProjectReaderTests-1805919051 None] Lock "cinder-e2c61fd7-ee8b-4d82-98c6-b1a51ba9eb75-delete_volume" released by "delete_volume" :: held 2.989s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:02:29 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-f12726d3-b491-48dc-ae43-039536760701 tempest-ProjectReaderTests-1805919051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 13:02:29 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f12726d3-b491-48dc-ae43-039536760701 tempest-ProjectReaderTests-1805919051 None] Flow 'volume_create_manager' (c89d77e1-c88c-46f7-8a57-51e669bd36f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:02:29 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f12726d3-b491-48dc-ae43-039536760701 tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (294f3eb3-c577-47f9-bb1c-ae24b4a4276b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:29 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e284f9e6-e5a2-4fa0-817b-dcf938dd6d9a tempest-ProjectReaderTests-1955870770 None] Acquiring lock "cinder-d49ce8b5-0b9a-4649-9c13-baff1f08478c-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:02:29 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f12726d3-b491-48dc-ae43-039536760701 tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (294f3eb3-c577-47f9-bb1c-ae24b4a4276b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:02:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-831266119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59d9f393-8b52-4d8d-952b-658a2b3f536e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eba2bac9ba8240e4b6c7825aeee0bdc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:02:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:02:30Z,use_quota=True,user_id='5c9819a9765743f798b8c839da755b20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:29 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f12726d3-b491-48dc-ae43-039536760701 tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b12c2da0-975c-48e1-86ff-8ffe4743237a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:29 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f12726d3-b491-48dc-ae43-039536760701 tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b12c2da0-975c-48e1-86ff-8ffe4743237a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:29 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f12726d3-b491-48dc-ae43-039536760701 tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4e103fa-ea58-4cac-9707-d6900322dbc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:29 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f12726d3-b491-48dc-ae43-039536760701 tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4e103fa-ea58-4cac-9707-d6900322dbc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59d9f393-8b52-4d8d-952b-658a2b3f536e', 'volume_name': 'volume-59d9f393-8b52-4d8d-952b-658a2b3f536e', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:29 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f12726d3-b491-48dc-ae43-039536760701 tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58a4757c-3221-45d7-80fd-b3d86e91d3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:29 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f12726d3-b491-48dc-ae43-039536760701 tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58a4757c-3221-45d7-80fd-b3d86e91d3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:29 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f12726d3-b491-48dc-ae43-039536760701 tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ae8922-3689-4697-aa46-a4ec9533947e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:29 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-f12726d3-b491-48dc-ae43-039536760701 tempest-ProjectReaderTests-1805919051 None] Volume 59d9f393-8b52-4d8d-952b-658a2b3f536e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59d9f393-8b52-4d8d-952b-658a2b3f536e', 'volume_size': 1}
Jul 10 13:02:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f12726d3-b491-48dc-ae43-039536760701 tempest-ProjectReaderTests-1805919051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:02:29 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e284f9e6-e5a2-4fa0-817b-dcf938dd6d9a tempest-ProjectReaderTests-1955870770 None] Lock "cinder-d49ce8b5-0b9a-4649-9c13-baff1f08478c-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:02:29 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e284f9e6-e5a2-4fa0-817b-dcf938dd6d9a tempest-ProjectReaderTests-1955870770 None] Acquiring lock "cinder-quobyte-d49ce8b5-0b9a-4649-9c13-baff1f08478c" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:02:29 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e284f9e6-e5a2-4fa0-817b-dcf938dd6d9a tempest-ProjectReaderTests-1955870770 None] Lock "cinder-quobyte-d49ce8b5-0b9a-4649-9c13-baff1f08478c" acquired by "delete_volume" :: waited 0.015s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:02:29 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7909e4-4f6e-4812-9c6c-2ebdee0f55b6]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:02:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e284f9e6-e5a2-4fa0-817b-dcf938dd6d9a tempest-ProjectReaderTests-1955870770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-d49ce8b5-0b9a-4649-9c13-baff1f08478c {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:30 devstack sudo[107106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-d49ce8b5-0b9a-4649-9c13-baff1f08478c
Jul 10 13:02:30 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:30 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:30 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c8b46a9b-2283-4a1d-a9fd-6b422f34da43 tempest-CinderUnicodeTest-1866586889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a.a5555a16-ce1d-47f4-9caf-754495e7b5d5 1G" returned: 0 in 1.041s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:30 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c8b46a9b-2283-4a1d-a9fd-6b422f34da43 tempest-CinderUnicodeTest-1866586889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a.a5555a16-ce1d-47f4-9caf-754495e7b5d5 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:30 devstack sudo[107112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a.a5555a16-ce1d-47f4-9caf-754495e7b5d5
Jul 10 13:02:30 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:30 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:30 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e284f9e6-e5a2-4fa0-817b-dcf938dd6d9a tempest-ProjectReaderTests-1955870770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-d49ce8b5-0b9a-4649-9c13-baff1f08478c" returned: 0 in 0.834s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:30 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e284f9e6-e5a2-4fa0-817b-dcf938dd6d9a tempest-ProjectReaderTests-1955870770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-d49ce8b5-0b9a-4649-9c13-baff1f08478c {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:30 devstack sudo[107118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-d49ce8b5-0b9a-4649-9c13-baff1f08478c
Jul 10 13:02:30 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:31 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c8b46a9b-2283-4a1d-a9fd-6b422f34da43 tempest-CinderUnicodeTest-1866586889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a.a5555a16-ce1d-47f4-9caf-754495e7b5d5" returned: 0 in 0.766s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:31 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-c8b46a9b-2283-4a1d-a9fd-6b422f34da43 tempest-CinderUnicodeTest-1866586889 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a.a5555a16-ce1d-47f4-9caf-754495e7b5d5 is being set with open permissions: ugo+rw
Jul 10 13:02:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c8b46a9b-2283-4a1d-a9fd-6b422f34da43 tempest-CinderUnicodeTest-1866586889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a.a5555a16-ce1d-47f4-9caf-754495e7b5d5 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:31 devstack sudo[107125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a.a5555a16-ce1d-47f4-9caf-754495e7b5d5
Jul 10 13:02:31 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:31 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e284f9e6-e5a2-4fa0-817b-dcf938dd6d9a tempest-ProjectReaderTests-1955870770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-d49ce8b5-0b9a-4649-9c13-baff1f08478c" returned: 0 in 0.741s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:31 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e284f9e6-e5a2-4fa0-817b-dcf938dd6d9a tempest-ProjectReaderTests-1955870770 None] Lock "cinder-quobyte-d49ce8b5-0b9a-4649-9c13-baff1f08478c" released by "delete_volume" :: held 1.620s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:02:31 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-e284f9e6-e5a2-4fa0-817b-dcf938dd6d9a tempest-ProjectReaderTests-1955870770 None] Created reservations ['022946b0-2c08-467e-8441-405bf708b2dc', 'ec9bd4af-f07c-48fc-8c40-e79a86d80d16', '88d3e9be-dc64-4d57-932e-3f5cb0138fcd', '99c1fe78-bc27-474c-95e2-3e5559b373ac'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:02:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e284f9e6-e5a2-4fa0-817b-dcf938dd6d9a tempest-ProjectReaderTests-1955870770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:02:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e284f9e6-e5a2-4fa0-817b-dcf938dd6d9a tempest-ProjectReaderTests-1955870770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:02:31 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-e284f9e6-e5a2-4fa0-817b-dcf938dd6d9a tempest-ProjectReaderTests-1955870770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:02:31 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-e284f9e6-e5a2-4fa0-817b-dcf938dd6d9a tempest-ProjectReaderTests-1955870770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:02:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-e284f9e6-e5a2-4fa0-817b-dcf938dd6d9a tempest-ProjectReaderTests-1955870770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:02:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e284f9e6-e5a2-4fa0-817b-dcf938dd6d9a tempest-ProjectReaderTests-1955870770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:31 devstack sudo[107128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:02:31 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:32 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c8b46a9b-2283-4a1d-a9fd-6b422f34da43 tempest-CinderUnicodeTest-1866586889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a.a5555a16-ce1d-47f4-9caf-754495e7b5d5" returned: 0 in 0.769s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c8b46a9b-2283-4a1d-a9fd-6b422f34da43 tempest-CinderUnicodeTest-1866586889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:32 devstack sudo[107131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a.info
Jul 10 13:02:32 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:32 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e284f9e6-e5a2-4fa0-817b-dcf938dd6d9a tempest-ProjectReaderTests-1955870770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.854s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:32 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-e284f9e6-e5a2-4fa0-817b-dcf938dd6d9a tempest-ProjectReaderTests-1955870770 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:02:32 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-e284f9e6-e5a2-4fa0-817b-dcf938dd6d9a tempest-ProjectReaderTests-1955870770 None] Deleted volume successfully.
Jul 10 13:02:32 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:SELECT=148,cinder:UPDATE=202,cinder:INSERT=55,cinder:DELETE=15 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 13:02:32 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e284f9e6-e5a2-4fa0-817b-dcf938dd6d9a tempest-ProjectReaderTests-1955870770 None] Lock "cinder-d49ce8b5-0b9a-4649-9c13-baff1f08478c-delete_volume" released by "delete_volume" :: held 2.750s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:02:32 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:SELECT=133,cinder:UPDATE=188,cinder:INSERT=40,cinder:DELETE=19 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 13:02:32 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-29434a35-4fc0-48f2-b4ba-c4e202a7f645 tempest-ProjectReaderTests-1955870770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 13:02:32 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-29434a35-4fc0-48f2-b4ba-c4e202a7f645 tempest-ProjectReaderTests-1955870770 None] Flow 'volume_create_manager' (2b95477d-e7a6-402d-870d-07af3c0948ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:02:32 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-29434a35-4fc0-48f2-b4ba-c4e202a7f645 tempest-ProjectReaderTests-1955870770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43f44628-c804-4f73-beaf-b5c0e4cc1db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:32 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-29434a35-4fc0-48f2-b4ba-c4e202a7f645 tempest-ProjectReaderTests-1955870770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43f44628-c804-4f73-beaf-b5c0e4cc1db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:02:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2120829713',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f1cec5e-6e24-4f95-9bb4-df50c5113eb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbf2f22893f0436aaf2b492048ee771a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:02:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:02:33Z,use_quota=True,user_id='7297474b49d844dca1ea14972fb95c7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:32 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-29434a35-4fc0-48f2-b4ba-c4e202a7f645 tempest-ProjectReaderTests-1955870770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (893efe8b-80d1-47e0-a7ef-bfae878dcc46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:32 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-29434a35-4fc0-48f2-b4ba-c4e202a7f645 tempest-ProjectReaderTests-1955870770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (893efe8b-80d1-47e0-a7ef-bfae878dcc46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:32 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-29434a35-4fc0-48f2-b4ba-c4e202a7f645 tempest-ProjectReaderTests-1955870770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6719cd65-bdc4-494a-abc0-4cb3734c11b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:32 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-29434a35-4fc0-48f2-b4ba-c4e202a7f645 tempest-ProjectReaderTests-1955870770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6719cd65-bdc4-494a-abc0-4cb3734c11b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f1cec5e-6e24-4f95-9bb4-df50c5113eb3', 'volume_name': 'volume-9f1cec5e-6e24-4f95-9bb4-df50c5113eb3', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:32 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-29434a35-4fc0-48f2-b4ba-c4e202a7f645 tempest-ProjectReaderTests-1955870770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f69e028-0f0a-4f6f-a113-f1a0f9729028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:32 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-29434a35-4fc0-48f2-b4ba-c4e202a7f645 tempest-ProjectReaderTests-1955870770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f69e028-0f0a-4f6f-a113-f1a0f9729028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:32 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-29434a35-4fc0-48f2-b4ba-c4e202a7f645 tempest-ProjectReaderTests-1955870770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65992e73-3bcf-4916-b2c5-b112176dc4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:32 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-29434a35-4fc0-48f2-b4ba-c4e202a7f645 tempest-ProjectReaderTests-1955870770 None] Volume 9f1cec5e-6e24-4f95-9bb4-df50c5113eb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f1cec5e-6e24-4f95-9bb4-df50c5113eb3', 'volume_size': 1}
Jul 10 13:02:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-29434a35-4fc0-48f2-b4ba-c4e202a7f645 tempest-ProjectReaderTests-1955870770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:02:33 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c8b46a9b-2283-4a1d-a9fd-6b422f34da43 tempest-CinderUnicodeTest-1866586889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a.info" returned: 0 in 0.960s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:33 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-c8b46a9b-2283-4a1d-a9fd-6b422f34da43 tempest-CinderUnicodeTest-1866586889 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a.info is being set with open permissions: ugo+rw
Jul 10 13:02:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c8b46a9b-2283-4a1d-a9fd-6b422f34da43 tempest-CinderUnicodeTest-1866586889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:33 devstack sudo[107135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a.info
Jul 10 13:02:33 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:33 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c8b46a9b-2283-4a1d-a9fd-6b422f34da43 tempest-CinderUnicodeTest-1866586889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a.info" returned: 0 in 0.709s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c8b46a9b-2283-4a1d-a9fd-6b422f34da43 tempest-CinderUnicodeTest-1866586889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.419s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:02:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f12726d3-b491-48dc-ae43-039536760701 tempest-ProjectReaderTests-1805919051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.972s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:02:33 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-f12726d3-b491-48dc-ae43-039536760701 tempest-ProjectReaderTests-1805919051 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:02:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-831266119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59d9f393-8b52-4d8d-952b-658a2b3f536e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eba2bac9ba8240e4b6c7825aeee0bdc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:02:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:02:30Z,use_quota=True,user_id='5c9819a9765743f798b8c839da755b20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 13:02:33 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-f12726d3-b491-48dc-ae43-039536760701 tempest-ProjectReaderTests-1805919051 None] Creating volume 59d9f393-8b52-4d8d-952b-658a2b3f536e {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 13:02:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f12726d3-b491-48dc-ae43-039536760701 tempest-ProjectReaderTests-1805919051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:02:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f12726d3-b491-48dc-ae43-039536760701 tempest-ProjectReaderTests-1805919051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:02:33 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-f12726d3-b491-48dc-ae43-039536760701 tempest-ProjectReaderTests-1805919051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:02:33 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-f12726d3-b491-48dc-ae43-039536760701 tempest-ProjectReaderTests-1805919051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:02:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f12726d3-b491-48dc-ae43-039536760701 tempest-ProjectReaderTests-1805919051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:02:33 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-f12726d3-b491-48dc-ae43-039536760701 tempest-ProjectReaderTests-1805919051 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 13:02:33 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-f12726d3-b491-48dc-ae43-039536760701 tempest-ProjectReaderTests-1805919051 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 13:02:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f12726d3-b491-48dc-ae43-039536760701 tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-59d9f393-8b52-4d8d-952b-658a2b3f536e 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:33 devstack sudo[107139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-59d9f393-8b52-4d8d-952b-658a2b3f536e 1073741824
Jul 10 13:02:33 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:33 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-c8b46a9b-2283-4a1d-a9fd-6b422f34da43 tempest-CinderUnicodeTest-1866586889 None] Create snapshot completed successfully
Jul 10 13:02:34 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f12726d3-b491-48dc-ae43-039536760701 tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-59d9f393-8b52-4d8d-952b-658a2b3f536e 1073741824" returned: 0 in 0.895s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f12726d3-b491-48dc-ae43-039536760701 tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-59d9f393-8b52-4d8d-952b-658a2b3f536e {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:34 devstack sudo[107145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-59d9f393-8b52-4d8d-952b-658a2b3f536e
Jul 10 13:02:34 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:34 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-a4b9a75e-3c70-4c0b-8377-b0253669ef99 tempest-CinderUnicodeTest-1866586889 None] Acquiring lock "cinder-a5555a16-ce1d-47f4-9caf-754495e7b5d5-delete_snapshot" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:02:34 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-a4b9a75e-3c70-4c0b-8377-b0253669ef99 tempest-CinderUnicodeTest-1866586889 None] Lock "cinder-a5555a16-ce1d-47f4-9caf-754495e7b5d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:02:34 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-a4b9a75e-3c70-4c0b-8377-b0253669ef99 tempest-CinderUnicodeTest-1866586889 None] Acquiring lock "cinder-quobyte-2e578c67-c256-4ab2-8bd9-7bbde45e896a" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:02:35 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-a4b9a75e-3c70-4c0b-8377-b0253669ef99 tempest-CinderUnicodeTest-1866586889 None] Lock "cinder-quobyte-2e578c67-c256-4ab2-8bd9-7bbde45e896a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:02:35 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-a4b9a75e-3c70-4c0b-8377-b0253669ef99 tempest-CinderUnicodeTest-1866586889 None] Acquiring lock "cinder-quobyte-a5555a16-ce1d-47f4-9caf-754495e7b5d5" by "_delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:02:35 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-a4b9a75e-3c70-4c0b-8377-b0253669ef99 tempest-CinderUnicodeTest-1866586889 None] Lock "cinder-quobyte-a5555a16-ce1d-47f4-9caf-754495e7b5d5" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:02:35 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-a4b9a75e-3c70-4c0b-8377-b0253669ef99 tempest-CinderUnicodeTest-1866586889 None] Deleting offline snapshot a5555a16-ce1d-47f4-9caf-754495e7b5d5 of volume 2e578c67-c256-4ab2-8bd9-7bbde45e896a {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 10 13:02:35 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-a4b9a75e-3c70-4c0b-8377-b0253669ef99 tempest-CinderUnicodeTest-1866586889 None] snapshot_file for this snap is: volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a.a5555a16-ce1d-47f4-9caf-754495e7b5d5 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 10 13:02:35 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4484cb-6de3-43b7-9a3c-72b0e4090158]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:02:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a4b9a75e-3c70-4c0b-8377-b0253669ef99 tempest-CinderUnicodeTest-1866586889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a.a5555a16-ce1d-47f4-9caf-754495e7b5d5 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:35 devstack sudo[107147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a.a5555a16-ce1d-47f4-9caf-754495e7b5d5
Jul 10 13:02:35 devstack sudo[107147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:35 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f12726d3-b491-48dc-ae43-039536760701 tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-59d9f393-8b52-4d8d-952b-658a2b3f536e" returned: 0 in 0.731s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:35 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-f12726d3-b491-48dc-ae43-039536760701 tempest-ProjectReaderTests-1805919051 None] <== create_volume: return (1674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 13:02:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f12726d3-b491-48dc-ae43-039536760701 tempest-ProjectReaderTests-1805919051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.678s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:02:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-29434a35-4fc0-48f2-b4ba-c4e202a7f645 tempest-ProjectReaderTests-1955870770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.765s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:02:35 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-29434a35-4fc0-48f2-b4ba-c4e202a7f645 tempest-ProjectReaderTests-1955870770 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:02:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2120829713',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f1cec5e-6e24-4f95-9bb4-df50c5113eb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbf2f22893f0436aaf2b492048ee771a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:02:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:02:33Z,use_quota=True,user_id='7297474b49d844dca1ea14972fb95c7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 13:02:35 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-29434a35-4fc0-48f2-b4ba-c4e202a7f645 tempest-ProjectReaderTests-1955870770 None] Creating volume 9f1cec5e-6e24-4f95-9bb4-df50c5113eb3 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 13:02:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-29434a35-4fc0-48f2-b4ba-c4e202a7f645 tempest-ProjectReaderTests-1955870770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:02:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-29434a35-4fc0-48f2-b4ba-c4e202a7f645 tempest-ProjectReaderTests-1955870770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:02:35 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-29434a35-4fc0-48f2-b4ba-c4e202a7f645 tempest-ProjectReaderTests-1955870770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:02:35 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-29434a35-4fc0-48f2-b4ba-c4e202a7f645 tempest-ProjectReaderTests-1955870770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:02:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-29434a35-4fc0-48f2-b4ba-c4e202a7f645 tempest-ProjectReaderTests-1955870770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:02:35 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-29434a35-4fc0-48f2-b4ba-c4e202a7f645 tempest-ProjectReaderTests-1955870770 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 13:02:35 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-29434a35-4fc0-48f2-b4ba-c4e202a7f645 tempest-ProjectReaderTests-1955870770 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 13:02:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-29434a35-4fc0-48f2-b4ba-c4e202a7f645 tempest-ProjectReaderTests-1955870770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9f1cec5e-6e24-4f95-9bb4-df50c5113eb3 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f12726d3-b491-48dc-ae43-039536760701 tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ae8922-3689-4697-aa46-a4ec9533947e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59d9f393-8b52-4d8d-952b-658a2b3f536e', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:35 devstack sudo[107150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9f1cec5e-6e24-4f95-9bb4-df50c5113eb3 1073741824
Jul 10 13:02:35 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f12726d3-b491-48dc-ae43-039536760701 tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1859e681-25f7-444a-adc4-983bc416a241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:35 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-f12726d3-b491-48dc-ae43-039536760701 tempest-ProjectReaderTests-1805919051 None] Volume volume-59d9f393-8b52-4d8d-952b-658a2b3f536e (59d9f393-8b52-4d8d-952b-658a2b3f536e): created successfully
Jul 10 13:02:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f12726d3-b491-48dc-ae43-039536760701 tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1859e681-25f7-444a-adc4-983bc416a241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:35 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f12726d3-b491-48dc-ae43-039536760701 tempest-ProjectReaderTests-1805919051 None] Flow 'volume_create_manager' (c89d77e1-c88c-46f7-8a57-51e669bd36f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:02:35 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-f12726d3-b491-48dc-ae43-039536760701 tempest-ProjectReaderTests-1805919051 None] Created volume successfully.
Jul 10 13:02:35 devstack sudo[107147]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a4b9a75e-3c70-4c0b-8377-b0253669ef99 tempest-CinderUnicodeTest-1866586889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a.a5555a16-ce1d-47f4-9caf-754495e7b5d5" returned: 0 in 0.812s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:35 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-a4b9a75e-3c70-4c0b-8377-b0253669ef99 tempest-CinderUnicodeTest-1866586889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 13:02:35 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5ed6a0-812f-436d-b75b-adea7ca4c179]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:02:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a4b9a75e-3c70-4c0b-8377-b0253669ef99 tempest-CinderUnicodeTest-1866586889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:36 devstack sudo[107161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a
Jul 10 13:02:36 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d8f0d37e-2cd4-4813-ba30-6ea2e100a40f tempest-ProjectReaderTests-1805919051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:02:36 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-29434a35-4fc0-48f2-b4ba-c4e202a7f645 tempest-ProjectReaderTests-1955870770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9f1cec5e-6e24-4f95-9bb4-df50c5113eb3 1073741824" returned: 0 in 0.876s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-29434a35-4fc0-48f2-b4ba-c4e202a7f645 tempest-ProjectReaderTests-1955870770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9f1cec5e-6e24-4f95-9bb4-df50c5113eb3 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:36 devstack sudo[107167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9f1cec5e-6e24-4f95-9bb4-df50c5113eb3
Jul 10 13:02:36 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:36 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a4b9a75e-3c70-4c0b-8377-b0253669ef99 tempest-CinderUnicodeTest-1866586889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a" returned: 0 in 0.827s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a4b9a75e-3c70-4c0b-8377-b0253669ef99 tempest-CinderUnicodeTest-1866586889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a.a5555a16-ce1d-47f4-9caf-754495e7b5d5 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:36 devstack sudo[107172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a.a5555a16-ce1d-47f4-9caf-754495e7b5d5
Jul 10 13:02:36 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:37 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-29434a35-4fc0-48f2-b4ba-c4e202a7f645 tempest-ProjectReaderTests-1955870770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9f1cec5e-6e24-4f95-9bb4-df50c5113eb3" returned: 0 in 0.672s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:37 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-29434a35-4fc0-48f2-b4ba-c4e202a7f645 tempest-ProjectReaderTests-1955870770 None] <== create_volume: return (1588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 13:02:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-29434a35-4fc0-48f2-b4ba-c4e202a7f645 tempest-ProjectReaderTests-1955870770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.591s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:02:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d8f0d37e-2cd4-4813-ba30-6ea2e100a40f tempest-ProjectReaderTests-1805919051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.948s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:02:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-29434a35-4fc0-48f2-b4ba-c4e202a7f645 tempest-ProjectReaderTests-1955870770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65992e73-3bcf-4916-b2c5-b112176dc4b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f1cec5e-6e24-4f95-9bb4-df50c5113eb3', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-29434a35-4fc0-48f2-b4ba-c4e202a7f645 tempest-ProjectReaderTests-1955870770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5aa3956-5aa4-48e1-ad46-2a3777c2d3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:37 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-d8f0d37e-2cd4-4813-ba30-6ea2e100a40f tempest-ProjectReaderTests-1805919051 None] Creating offline snapshot da011c82-f744-4e69-a4d7-f2e90e618fbc of volume 59d9f393-8b52-4d8d-952b-658a2b3f536e {{(pid=87378) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 10 13:02:37 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-29434a35-4fc0-48f2-b4ba-c4e202a7f645 tempest-ProjectReaderTests-1955870770 None] Volume volume-9f1cec5e-6e24-4f95-9bb4-df50c5113eb3 (9f1cec5e-6e24-4f95-9bb4-df50c5113eb3): created successfully
Jul 10 13:02:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-29434a35-4fc0-48f2-b4ba-c4e202a7f645 tempest-ProjectReaderTests-1955870770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5aa3956-5aa4-48e1-ad46-2a3777c2d3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:37 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-29434a35-4fc0-48f2-b4ba-c4e202a7f645 tempest-ProjectReaderTests-1955870770 None] Flow 'volume_create_manager' (2b95477d-e7a6-402d-870d-07af3c0948ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:02:37 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6958a73c-d797-4643-a70c-6e0ef9d15fbf]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:02:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d8f0d37e-2cd4-4813-ba30-6ea2e100a40f tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-59d9f393-8b52-4d8d-952b-658a2b3f536e {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:37 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-29434a35-4fc0-48f2-b4ba-c4e202a7f645 tempest-ProjectReaderTests-1955870770 None] Created volume successfully.
Jul 10 13:02:37 devstack sudo[107175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-59d9f393-8b52-4d8d-952b-658a2b3f536e
Jul 10 13:02:37 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:37 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a4b9a75e-3c70-4c0b-8377-b0253669ef99 tempest-CinderUnicodeTest-1866586889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a.a5555a16-ce1d-47f4-9caf-754495e7b5d5" returned: 0 in 0.760s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a4b9a75e-3c70-4c0b-8377-b0253669ef99 tempest-CinderUnicodeTest-1866586889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a.a5555a16-ce1d-47f4-9caf-754495e7b5d5 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:37 devstack sudo[107180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a.a5555a16-ce1d-47f4-9caf-754495e7b5d5
Jul 10 13:02:37 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:37 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-58e2d940-7c2e-458e-bed4-3f60e0cac6dd tempest-ProjectReaderTests-1955870770 None] Acquiring lock "cinder-9f1cec5e-6e24-4f95-9bb4-df50c5113eb3-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:02:37 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-58e2d940-7c2e-458e-bed4-3f60e0cac6dd tempest-ProjectReaderTests-1955870770 None] Lock "cinder-9f1cec5e-6e24-4f95-9bb4-df50c5113eb3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:02:37 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-58e2d940-7c2e-458e-bed4-3f60e0cac6dd tempest-ProjectReaderTests-1955870770 None] Acquiring lock "cinder-quobyte-9f1cec5e-6e24-4f95-9bb4-df50c5113eb3" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:02:37 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-58e2d940-7c2e-458e-bed4-3f60e0cac6dd tempest-ProjectReaderTests-1955870770 None] Lock "cinder-quobyte-9f1cec5e-6e24-4f95-9bb4-df50c5113eb3" acquired by "delete_volume" :: waited 0.016s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:02:37 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e426dbc7-977a-4d25-99e9-1a9e42412e7a]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:02:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-58e2d940-7c2e-458e-bed4-3f60e0cac6dd tempest-ProjectReaderTests-1955870770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9f1cec5e-6e24-4f95-9bb4-df50c5113eb3 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:37 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d8f0d37e-2cd4-4813-ba30-6ea2e100a40f tempest-ProjectReaderTests-1805919051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-59d9f393-8b52-4d8d-952b-658a2b3f536e" returned: 0 in 0.813s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d8f0d37e-2cd4-4813-ba30-6ea2e100a40f tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-59d9f393-8b52-4d8d-952b-658a2b3f536e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-59d9f393-8b52-4d8d-952b-658a2b3f536e.da011c82-f744-4e69-a4d7-f2e90e618fbc 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:37 devstack sudo[107186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-59d9f393-8b52-4d8d-952b-658a2b3f536e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-59d9f393-8b52-4d8d-952b-658a2b3f536e.da011c82-f744-4e69-a4d7-f2e90e618fbc 1G
Jul 10 13:02:37 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:37 devstack sudo[107185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9f1cec5e-6e24-4f95-9bb4-df50c5113eb3
Jul 10 13:02:37 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:38 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a4b9a75e-3c70-4c0b-8377-b0253669ef99 tempest-CinderUnicodeTest-1866586889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a.a5555a16-ce1d-47f4-9caf-754495e7b5d5" returned: 0 in 0.704s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:38 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-a4b9a75e-3c70-4c0b-8377-b0253669ef99 tempest-CinderUnicodeTest-1866586889 None] Lock "cinder-quobyte-a5555a16-ce1d-47f4-9caf-754495e7b5d5" released by "_delete_snapshot" :: held 3.225s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:02:38 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-a4b9a75e-3c70-4c0b-8377-b0253669ef99 tempest-CinderUnicodeTest-1866586889 None] Lock "cinder-quobyte-2e578c67-c256-4ab2-8bd9-7bbde45e896a" released by "delete_snapshot" :: held 3.247s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:02:38 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-a4b9a75e-3c70-4c0b-8377-b0253669ef99 tempest-CinderUnicodeTest-1866586889 None] Created reservations ['494b97ec-9c46-4aba-b5f2-cdebe22a5f99', '792d6a7d-4a54-48bb-b6a8-24d451871612', '523fc8e8-7300-4f23-abdd-bac08dc31b4e', '74381457-ae25-4420-b4b8-f4aca0e441cb'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:02:38 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-a4b9a75e-3c70-4c0b-8377-b0253669ef99 tempest-CinderUnicodeTest-1866586889 None] Delete snapshot completed successfully.
Jul 10 13:02:38 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-a4b9a75e-3c70-4c0b-8377-b0253669ef99 tempest-CinderUnicodeTest-1866586889 None] Lock "cinder-a5555a16-ce1d-47f4-9caf-754495e7b5d5-delete_snapshot" released by "delete_snapshot" :: held 3.392s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:02:38 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-58e2d940-7c2e-458e-bed4-3f60e0cac6dd tempest-ProjectReaderTests-1955870770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9f1cec5e-6e24-4f95-9bb4-df50c5113eb3" returned: 0 in 0.815s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-58e2d940-7c2e-458e-bed4-3f60e0cac6dd tempest-ProjectReaderTests-1955870770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9f1cec5e-6e24-4f95-9bb4-df50c5113eb3 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:38 devstack sudo[107197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9f1cec5e-6e24-4f95-9bb4-df50c5113eb3
Jul 10 13:02:38 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:38 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d8f0d37e-2cd4-4813-ba30-6ea2e100a40f tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-59d9f393-8b52-4d8d-952b-658a2b3f536e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-59d9f393-8b52-4d8d-952b-658a2b3f536e.da011c82-f744-4e69-a4d7-f2e90e618fbc 1G" returned: 0 in 0.815s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d8f0d37e-2cd4-4813-ba30-6ea2e100a40f tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59d9f393-8b52-4d8d-952b-658a2b3f536e -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-59d9f393-8b52-4d8d-952b-658a2b3f536e.da011c82-f744-4e69-a4d7-f2e90e618fbc {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:38 devstack sudo[107199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59d9f393-8b52-4d8d-952b-658a2b3f536e -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-59d9f393-8b52-4d8d-952b-658a2b3f536e.da011c82-f744-4e69-a4d7-f2e90e618fbc
Jul 10 13:02:38 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:39 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-5aad737d-0649-4bd8-9e95-1aa7c004e106 tempest-CinderUnicodeTest-1866586889 None] Acquiring lock "cinder-2e578c67-c256-4ab2-8bd9-7bbde45e896a-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:02:39 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-5aad737d-0649-4bd8-9e95-1aa7c004e106 tempest-CinderUnicodeTest-1866586889 None] Lock "cinder-2e578c67-c256-4ab2-8bd9-7bbde45e896a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:02:39 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-5aad737d-0649-4bd8-9e95-1aa7c004e106 tempest-CinderUnicodeTest-1866586889 None] Acquiring lock "cinder-quobyte-2e578c67-c256-4ab2-8bd9-7bbde45e896a" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:02:39 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-5aad737d-0649-4bd8-9e95-1aa7c004e106 tempest-CinderUnicodeTest-1866586889 None] Lock "cinder-quobyte-2e578c67-c256-4ab2-8bd9-7bbde45e896a" acquired by "delete_volume" :: waited 0.021s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:02:39 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-58e2d940-7c2e-458e-bed4-3f60e0cac6dd tempest-ProjectReaderTests-1955870770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9f1cec5e-6e24-4f95-9bb4-df50c5113eb3" returned: 0 in 0.675s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:39 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5dfe482-3c30-4894-b0e1-5c6ec69096d7]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:02:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5aad737d-0649-4bd8-9e95-1aa7c004e106 tempest-CinderUnicodeTest-1866586889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:39 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-58e2d940-7c2e-458e-bed4-3f60e0cac6dd tempest-ProjectReaderTests-1955870770 None] Lock "cinder-quobyte-9f1cec5e-6e24-4f95-9bb4-df50c5113eb3" released by "delete_volume" :: held 1.547s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:02:39 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-58e2d940-7c2e-458e-bed4-3f60e0cac6dd tempest-ProjectReaderTests-1955870770 None] Created reservations ['9018828d-0a4a-4182-b788-55fba43d76b7', 'f57e7093-0e1d-45d1-944c-c133f98d1839', '49ff770b-629c-42b6-9510-ea29f086d8bf', 'e07a26dd-c96d-4c2e-89f4-3c77a68cd682'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:02:39 devstack sudo[107204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a
Jul 10 13:02:39 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-58e2d940-7c2e-458e-bed4-3f60e0cac6dd tempest-ProjectReaderTests-1955870770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:02:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-58e2d940-7c2e-458e-bed4-3f60e0cac6dd tempest-ProjectReaderTests-1955870770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:02:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-58e2d940-7c2e-458e-bed4-3f60e0cac6dd tempest-ProjectReaderTests-1955870770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:02:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-58e2d940-7c2e-458e-bed4-3f60e0cac6dd tempest-ProjectReaderTests-1955870770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:02:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-58e2d940-7c2e-458e-bed4-3f60e0cac6dd tempest-ProjectReaderTests-1955870770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:02:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-58e2d940-7c2e-458e-bed4-3f60e0cac6dd tempest-ProjectReaderTests-1955870770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:39 devstack sudo[107207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:02:39 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:39 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d8f0d37e-2cd4-4813-ba30-6ea2e100a40f tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59d9f393-8b52-4d8d-952b-658a2b3f536e -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-59d9f393-8b52-4d8d-952b-658a2b3f536e.da011c82-f744-4e69-a4d7-f2e90e618fbc" returned: 0 in 0.790s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:39 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-d8f0d37e-2cd4-4813-ba30-6ea2e100a40f tempest-ProjectReaderTests-1805919051 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-59d9f393-8b52-4d8d-952b-658a2b3f536e.da011c82-f744-4e69-a4d7-f2e90e618fbc is being set with open permissions: ugo+rw
Jul 10 13:02:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d8f0d37e-2cd4-4813-ba30-6ea2e100a40f tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-59d9f393-8b52-4d8d-952b-658a2b3f536e.da011c82-f744-4e69-a4d7-f2e90e618fbc {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:39 devstack sudo[107210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-59d9f393-8b52-4d8d-952b-658a2b3f536e.da011c82-f744-4e69-a4d7-f2e90e618fbc
Jul 10 13:02:39 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:40 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5aad737d-0649-4bd8-9e95-1aa7c004e106 tempest-CinderUnicodeTest-1866586889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a" returned: 0 in 0.876s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5aad737d-0649-4bd8-9e95-1aa7c004e106 tempest-CinderUnicodeTest-1866586889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:40 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-58e2d940-7c2e-458e-bed4-3f60e0cac6dd tempest-ProjectReaderTests-1955870770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.750s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:40 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-58e2d940-7c2e-458e-bed4-3f60e0cac6dd tempest-ProjectReaderTests-1955870770 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:02:40 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-58e2d940-7c2e-458e-bed4-3f60e0cac6dd tempest-ProjectReaderTests-1955870770 None] Deleted volume successfully.
Jul 10 13:02:40 devstack sudo[107219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a
Jul 10 13:02:40 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:40 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-58e2d940-7c2e-458e-bed4-3f60e0cac6dd tempest-ProjectReaderTests-1955870770 None] Lock "cinder-9f1cec5e-6e24-4f95-9bb4-df50c5113eb3-delete_volume" released by "delete_volume" :: held 2.545s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:02:40 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d8f0d37e-2cd4-4813-ba30-6ea2e100a40f tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-59d9f393-8b52-4d8d-952b-658a2b3f536e.da011c82-f744-4e69-a4d7-f2e90e618fbc" returned: 0 in 0.784s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d8f0d37e-2cd4-4813-ba30-6ea2e100a40f tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-59d9f393-8b52-4d8d-952b-658a2b3f536e.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:40 devstack sudo[107221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-59d9f393-8b52-4d8d-952b-658a2b3f536e.info
Jul 10 13:02:40 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:40 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5aad737d-0649-4bd8-9e95-1aa7c004e106 tempest-CinderUnicodeTest-1866586889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-2e578c67-c256-4ab2-8bd9-7bbde45e896a" returned: 0 in 0.736s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:41 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-5aad737d-0649-4bd8-9e95-1aa7c004e106 tempest-CinderUnicodeTest-1866586889 None] Lock "cinder-quobyte-2e578c67-c256-4ab2-8bd9-7bbde45e896a" released by "delete_volume" :: held 1.705s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:02:41 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-5aad737d-0649-4bd8-9e95-1aa7c004e106 tempest-CinderUnicodeTest-1866586889 None] Created reservations ['47a02c01-2fc7-40f0-be70-dfe3d673a81a', 'd0dcb0e4-22aa-4bb5-a92c-30354e4957ca', '8bd07aee-0894-4d0b-bb2c-ad82dba02535', 'a9a76990-3198-4905-8f01-2cc7f8a53abb'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:02:41 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d8f0d37e-2cd4-4813-ba30-6ea2e100a40f tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-59d9f393-8b52-4d8d-952b-658a2b3f536e.info" returned: 0 in 0.729s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:41 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-d8f0d37e-2cd4-4813-ba30-6ea2e100a40f tempest-ProjectReaderTests-1805919051 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-59d9f393-8b52-4d8d-952b-658a2b3f536e.info is being set with open permissions: ugo+rw
Jul 10 13:02:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d8f0d37e-2cd4-4813-ba30-6ea2e100a40f tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-59d9f393-8b52-4d8d-952b-658a2b3f536e.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:41 devstack sudo[107225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-59d9f393-8b52-4d8d-952b-658a2b3f536e.info
Jul 10 13:02:41 devstack sudo[107225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5aad737d-0649-4bd8-9e95-1aa7c004e106 tempest-CinderUnicodeTest-1866586889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:02:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5aad737d-0649-4bd8-9e95-1aa7c004e106 tempest-CinderUnicodeTest-1866586889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:02:41 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5aad737d-0649-4bd8-9e95-1aa7c004e106 tempest-CinderUnicodeTest-1866586889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:02:41 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-5aad737d-0649-4bd8-9e95-1aa7c004e106 tempest-CinderUnicodeTest-1866586889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:02:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5aad737d-0649-4bd8-9e95-1aa7c004e106 tempest-CinderUnicodeTest-1866586889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:02:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5aad737d-0649-4bd8-9e95-1aa7c004e106 tempest-CinderUnicodeTest-1866586889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:41 devstack sudo[107227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:02:41 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:41 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f3c568d2-905d-4ce9-a5de-ccc6aff40a20 tempest-CinderUnicodeTest-1866586889 None] Acquiring lock "cinder-10043955-3352-49c3-8364-a27ae509d552-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:02:41 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f3c568d2-905d-4ce9-a5de-ccc6aff40a20 tempest-CinderUnicodeTest-1866586889 None] Lock "cinder-10043955-3352-49c3-8364-a27ae509d552-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:02:41 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f3c568d2-905d-4ce9-a5de-ccc6aff40a20 tempest-CinderUnicodeTest-1866586889 None] Acquiring lock "cinder-quobyte-10043955-3352-49c3-8364-a27ae509d552" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:02:41 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f3c568d2-905d-4ce9-a5de-ccc6aff40a20 tempest-CinderUnicodeTest-1866586889 None] Lock "cinder-quobyte-10043955-3352-49c3-8364-a27ae509d552" acquired by "delete_volume" :: waited 0.015s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:02:41 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb51ec5c-6d4a-4636-9ad3-5dfa90089f27]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:02:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f3c568d2-905d-4ce9-a5de-ccc6aff40a20 tempest-CinderUnicodeTest-1866586889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-10043955-3352-49c3-8364-a27ae509d552 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:41 devstack sudo[107229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-10043955-3352-49c3-8364-a27ae509d552
Jul 10 13:02:41 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:41 devstack sudo[107225]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-d8f0d37e-2cd4-4813-ba30-6ea2e100a40f tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-59d9f393-8b52-4d8d-952b-658a2b3f536e.info" returned: 0 in 0.803s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-d8f0d37e-2cd4-4813-ba30-6ea2e100a40f tempest-ProjectReaderTests-1805919051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.866s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:02:41 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-d8f0d37e-2cd4-4813-ba30-6ea2e100a40f tempest-ProjectReaderTests-1805919051 None] Create snapshot completed successfully
Jul 10 13:02:41 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5aad737d-0649-4bd8-9e95-1aa7c004e106 tempest-CinderUnicodeTest-1866586889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.800s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:41 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-5aad737d-0649-4bd8-9e95-1aa7c004e106 tempest-CinderUnicodeTest-1866586889 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:02:41 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-5aad737d-0649-4bd8-9e95-1aa7c004e106 tempest-CinderUnicodeTest-1866586889 None] Deleted volume successfully.
Jul 10 13:02:42 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-5aad737d-0649-4bd8-9e95-1aa7c004e106 tempest-CinderUnicodeTest-1866586889 None] Lock "cinder-2e578c67-c256-4ab2-8bd9-7bbde45e896a-delete_volume" released by "delete_volume" :: held 2.770s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:02:42 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-43438a13-1746-4c8a-b680-2c75a7288eab tempest-ProjectReaderTests-1805919051 None] Acquiring lock "cinder-da011c82-f744-4e69-a4d7-f2e90e618fbc-delete_snapshot" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:02:42 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-43438a13-1746-4c8a-b680-2c75a7288eab tempest-ProjectReaderTests-1805919051 None] Lock "cinder-da011c82-f744-4e69-a4d7-f2e90e618fbc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:02:42 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-43438a13-1746-4c8a-b680-2c75a7288eab tempest-ProjectReaderTests-1805919051 None] Acquiring lock "cinder-quobyte-59d9f393-8b52-4d8d-952b-658a2b3f536e" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:02:42 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-43438a13-1746-4c8a-b680-2c75a7288eab tempest-ProjectReaderTests-1805919051 None] Lock "cinder-quobyte-59d9f393-8b52-4d8d-952b-658a2b3f536e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:02:42 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-43438a13-1746-4c8a-b680-2c75a7288eab tempest-ProjectReaderTests-1805919051 None] Acquiring lock "cinder-quobyte-da011c82-f744-4e69-a4d7-f2e90e618fbc" by "_delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:02:42 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-43438a13-1746-4c8a-b680-2c75a7288eab tempest-ProjectReaderTests-1805919051 None] Lock "cinder-quobyte-da011c82-f744-4e69-a4d7-f2e90e618fbc" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:02:42 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-43438a13-1746-4c8a-b680-2c75a7288eab tempest-ProjectReaderTests-1805919051 None] Deleting offline snapshot da011c82-f744-4e69-a4d7-f2e90e618fbc of volume 59d9f393-8b52-4d8d-952b-658a2b3f536e {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 10 13:02:42 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:42 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-43438a13-1746-4c8a-b680-2c75a7288eab tempest-ProjectReaderTests-1805919051 None] snapshot_file for this snap is: volume-59d9f393-8b52-4d8d-952b-658a2b3f536e.da011c82-f744-4e69-a4d7-f2e90e618fbc {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 10 13:02:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f3c568d2-905d-4ce9-a5de-ccc6aff40a20 tempest-CinderUnicodeTest-1866586889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-10043955-3352-49c3-8364-a27ae509d552" returned: 0 in 0.830s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f3c568d2-905d-4ce9-a5de-ccc6aff40a20 tempest-CinderUnicodeTest-1866586889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-10043955-3352-49c3-8364-a27ae509d552 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:42 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2b3141-6a36-4a09-b1f8-a307fb62e595]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:02:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-43438a13-1746-4c8a-b680-2c75a7288eab tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-59d9f393-8b52-4d8d-952b-658a2b3f536e.da011c82-f744-4e69-a4d7-f2e90e618fbc {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:42 devstack sudo[107236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-10043955-3352-49c3-8364-a27ae509d552
Jul 10 13:02:42 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:42 devstack sudo[107237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-59d9f393-8b52-4d8d-952b-658a2b3f536e.da011c82-f744-4e69-a4d7-f2e90e618fbc
Jul 10 13:02:42 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:43 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f3c568d2-905d-4ce9-a5de-ccc6aff40a20 tempest-CinderUnicodeTest-1866586889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-10043955-3352-49c3-8364-a27ae509d552" returned: 0 in 0.641s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:43 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f3c568d2-905d-4ce9-a5de-ccc6aff40a20 tempest-CinderUnicodeTest-1866586889 None] Lock "cinder-quobyte-10043955-3352-49c3-8364-a27ae509d552" released by "delete_volume" :: held 1.518s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:02:43 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-f3c568d2-905d-4ce9-a5de-ccc6aff40a20 tempest-CinderUnicodeTest-1866586889 None] Created reservations ['3d13fbf8-423f-4892-a321-6864fb9ff257', '14b89662-3727-4652-9b3c-ab9ef5754194', '9e910c77-1b78-4808-86e7-1228c75ca7d8', 'e08b761b-a161-40fb-b5d1-61dcb6beec17'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:02:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f3c568d2-905d-4ce9-a5de-ccc6aff40a20 tempest-CinderUnicodeTest-1866586889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:02:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f3c568d2-905d-4ce9-a5de-ccc6aff40a20 tempest-CinderUnicodeTest-1866586889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:02:43 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-f3c568d2-905d-4ce9-a5de-ccc6aff40a20 tempest-CinderUnicodeTest-1866586889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:02:43 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-f3c568d2-905d-4ce9-a5de-ccc6aff40a20 tempest-CinderUnicodeTest-1866586889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:02:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f3c568d2-905d-4ce9-a5de-ccc6aff40a20 tempest-CinderUnicodeTest-1866586889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:02:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f3c568d2-905d-4ce9-a5de-ccc6aff40a20 tempest-CinderUnicodeTest-1866586889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:43 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-43438a13-1746-4c8a-b680-2c75a7288eab tempest-ProjectReaderTests-1805919051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-59d9f393-8b52-4d8d-952b-658a2b3f536e.da011c82-f744-4e69-a4d7-f2e90e618fbc" returned: 0 in 0.798s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:43 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-43438a13-1746-4c8a-b680-2c75a7288eab tempest-ProjectReaderTests-1805919051 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59d9f393-8b52-4d8d-952b-658a2b3f536e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 13:02:43 devstack sudo[107245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:02:43 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:43 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[946cf906-88dc-4a64-879f-a9d9f3fc88e4]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:02:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-43438a13-1746-4c8a-b680-2c75a7288eab tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-59d9f393-8b52-4d8d-952b-658a2b3f536e {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:43 devstack sudo[107247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-59d9f393-8b52-4d8d-952b-658a2b3f536e
Jul 10 13:02:43 devstack sudo[107247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:43 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f3c568d2-905d-4ce9-a5de-ccc6aff40a20 tempest-CinderUnicodeTest-1866586889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.659s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:43 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-f3c568d2-905d-4ce9-a5de-ccc6aff40a20 tempest-CinderUnicodeTest-1866586889 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:02:43 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-f3c568d2-905d-4ce9-a5de-ccc6aff40a20 tempest-CinderUnicodeTest-1866586889 None] Deleted volume successfully.
Jul 10 13:02:43 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f3c568d2-905d-4ce9-a5de-ccc6aff40a20 tempest-CinderUnicodeTest-1866586889 None] Lock "cinder-10043955-3352-49c3-8364-a27ae509d552-delete_volume" released by "delete_volume" :: held 2.426s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:02:44 devstack sudo[107247]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-43438a13-1746-4c8a-b680-2c75a7288eab tempest-ProjectReaderTests-1805919051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-59d9f393-8b52-4d8d-952b-658a2b3f536e" returned: 0 in 0.799s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-43438a13-1746-4c8a-b680-2c75a7288eab tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-59d9f393-8b52-4d8d-952b-658a2b3f536e.da011c82-f744-4e69-a4d7-f2e90e618fbc {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:44 devstack sudo[107253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-59d9f393-8b52-4d8d-952b-658a2b3f536e.da011c82-f744-4e69-a4d7-f2e90e618fbc
Jul 10 13:02:44 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:44 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-43438a13-1746-4c8a-b680-2c75a7288eab tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-59d9f393-8b52-4d8d-952b-658a2b3f536e.da011c82-f744-4e69-a4d7-f2e90e618fbc" returned: 0 in 0.773s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-43438a13-1746-4c8a-b680-2c75a7288eab tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-59d9f393-8b52-4d8d-952b-658a2b3f536e.da011c82-f744-4e69-a4d7-f2e90e618fbc {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:44 devstack sudo[107258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-59d9f393-8b52-4d8d-952b-658a2b3f536e.da011c82-f744-4e69-a4d7-f2e90e618fbc
Jul 10 13:02:44 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:45 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-43438a13-1746-4c8a-b680-2c75a7288eab tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-59d9f393-8b52-4d8d-952b-658a2b3f536e.da011c82-f744-4e69-a4d7-f2e90e618fbc" returned: 0 in 0.680s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:45 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-43438a13-1746-4c8a-b680-2c75a7288eab tempest-ProjectReaderTests-1805919051 None] Lock "cinder-quobyte-da011c82-f744-4e69-a4d7-f2e90e618fbc" released by "_delete_snapshot" :: held 3.146s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:02:45 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-43438a13-1746-4c8a-b680-2c75a7288eab tempest-ProjectReaderTests-1805919051 None] Lock "cinder-quobyte-59d9f393-8b52-4d8d-952b-658a2b3f536e" released by "delete_snapshot" :: held 3.170s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:02:45 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-43438a13-1746-4c8a-b680-2c75a7288eab tempest-ProjectReaderTests-1805919051 None] Created reservations ['d7d7ddc7-80d5-4bb1-afc9-cde77fd43825', '21b29923-07f9-46aa-abb2-7471e45ab975', 'b23500d4-d9b9-4681-a565-3ef6677fd900', '84d110fd-9b9a-439e-8582-166f525f2e48'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:02:45 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-43438a13-1746-4c8a-b680-2c75a7288eab tempest-ProjectReaderTests-1805919051 None] Delete snapshot completed successfully.
Jul 10 13:02:45 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-43438a13-1746-4c8a-b680-2c75a7288eab tempest-ProjectReaderTests-1805919051 None] Lock "cinder-da011c82-f744-4e69-a4d7-f2e90e618fbc-delete_snapshot" released by "delete_snapshot" :: held 3.320s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:02:46 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f55ec1b0-b103-47ee-b87a-c832ca6bb1ad tempest-ProjectReaderTests-1805919051 None] Acquiring lock "cinder-59d9f393-8b52-4d8d-952b-658a2b3f536e-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:02:46 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f55ec1b0-b103-47ee-b87a-c832ca6bb1ad tempest-ProjectReaderTests-1805919051 None] Lock "cinder-59d9f393-8b52-4d8d-952b-658a2b3f536e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:02:46 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f55ec1b0-b103-47ee-b87a-c832ca6bb1ad tempest-ProjectReaderTests-1805919051 None] Acquiring lock "cinder-quobyte-59d9f393-8b52-4d8d-952b-658a2b3f536e" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:02:46 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f55ec1b0-b103-47ee-b87a-c832ca6bb1ad tempest-ProjectReaderTests-1805919051 None] Lock "cinder-quobyte-59d9f393-8b52-4d8d-952b-658a2b3f536e" acquired by "delete_volume" :: waited 0.015s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:02:46 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7359b6-7692-4e7f-a9bb-ca85c8673235]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:02:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f55ec1b0-b103-47ee-b87a-c832ca6bb1ad tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-59d9f393-8b52-4d8d-952b-658a2b3f536e {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:46 devstack sudo[107261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-59d9f393-8b52-4d8d-952b-658a2b3f536e
Jul 10 13:02:46 devstack sudo[107261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:47 devstack sudo[107261]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f55ec1b0-b103-47ee-b87a-c832ca6bb1ad tempest-ProjectReaderTests-1805919051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-59d9f393-8b52-4d8d-952b-658a2b3f536e" returned: 0 in 0.748s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f55ec1b0-b103-47ee-b87a-c832ca6bb1ad tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-59d9f393-8b52-4d8d-952b-658a2b3f536e {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:47 devstack sudo[107266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-59d9f393-8b52-4d8d-952b-658a2b3f536e
Jul 10 13:02:47 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:48 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f55ec1b0-b103-47ee-b87a-c832ca6bb1ad tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-59d9f393-8b52-4d8d-952b-658a2b3f536e" returned: 0 in 0.651s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:48 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f55ec1b0-b103-47ee-b87a-c832ca6bb1ad tempest-ProjectReaderTests-1805919051 None] Lock "cinder-quobyte-59d9f393-8b52-4d8d-952b-658a2b3f536e" released by "delete_volume" :: held 1.460s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:02:48 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-f55ec1b0-b103-47ee-b87a-c832ca6bb1ad tempest-ProjectReaderTests-1805919051 None] Created reservations ['9c06fec0-4419-4d19-8126-63581e515f69', '094f6e9f-d5d3-4be9-8366-b1c3ac481ce1', '79719c24-49ff-4f36-acac-4ca0d8a1718c', '729c1f45-7500-46e8-ae6b-0740f2f45aec'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:02:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f55ec1b0-b103-47ee-b87a-c832ca6bb1ad tempest-ProjectReaderTests-1805919051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:02:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f55ec1b0-b103-47ee-b87a-c832ca6bb1ad tempest-ProjectReaderTests-1805919051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:02:48 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-f55ec1b0-b103-47ee-b87a-c832ca6bb1ad tempest-ProjectReaderTests-1805919051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:02:48 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-f55ec1b0-b103-47ee-b87a-c832ca6bb1ad tempest-ProjectReaderTests-1805919051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:02:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f55ec1b0-b103-47ee-b87a-c832ca6bb1ad tempest-ProjectReaderTests-1805919051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:02:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f55ec1b0-b103-47ee-b87a-c832ca6bb1ad tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:48 devstack sudo[107269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:02:48 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:49 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f55ec1b0-b103-47ee-b87a-c832ca6bb1ad tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.708s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:49 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-f55ec1b0-b103-47ee-b87a-c832ca6bb1ad tempest-ProjectReaderTests-1805919051 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:02:49 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-f55ec1b0-b103-47ee-b87a-c832ca6bb1ad tempest-ProjectReaderTests-1805919051 None] Deleted volume successfully.
Jul 10 13:02:49 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f55ec1b0-b103-47ee-b87a-c832ca6bb1ad tempest-ProjectReaderTests-1805919051 None] Lock "cinder-59d9f393-8b52-4d8d-952b-658a2b3f536e-delete_volume" released by "delete_volume" :: held 2.388s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:02:49 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-87bcb79e-190d-4a86-bd3c-a734ba260537 tempest-ProjectReaderTests-1805919051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 13:02:49 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-87bcb79e-190d-4a86-bd3c-a734ba260537 tempest-ProjectReaderTests-1805919051 None] Flow 'volume_create_manager' (54907d1d-07b1-4408-b73c-82494baa616c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:02:49 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-87bcb79e-190d-4a86-bd3c-a734ba260537 tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c8d1af1-ad25-439d-9b1f-6806e52cc9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:49 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-87bcb79e-190d-4a86-bd3c-a734ba260537 tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c8d1af1-ad25-439d-9b1f-6806e52cc9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1784265838',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eba2bac9ba8240e4b6c7825aeee0bdc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:02:49Z,use_quota=True,user_id='5c9819a9765743f798b8c839da755b20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:49 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-87bcb79e-190d-4a86-bd3c-a734ba260537 tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceb7461f-b928-4270-951e-d068791f2819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:49 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-87bcb79e-190d-4a86-bd3c-a734ba260537 tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceb7461f-b928-4270-951e-d068791f2819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:49 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-87bcb79e-190d-4a86-bd3c-a734ba260537 tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c21e84d3-add1-4ae8-ace1-454b92e550aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:49 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-87bcb79e-190d-4a86-bd3c-a734ba260537 tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c21e84d3-add1-4ae8-ace1-454b92e550aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c', 'volume_name': 'volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:49 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-87bcb79e-190d-4a86-bd3c-a734ba260537 tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ffcdc5e-4293-4618-832a-87e810b636bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:49 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-87bcb79e-190d-4a86-bd3c-a734ba260537 tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ffcdc5e-4293-4618-832a-87e810b636bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:49 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-87bcb79e-190d-4a86-bd3c-a734ba260537 tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (891de18a-acb5-4e89-83a9-451e0b287e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:49 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-87bcb79e-190d-4a86-bd3c-a734ba260537 tempest-ProjectReaderTests-1805919051 None] Volume 9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c', 'volume_size': 1}
Jul 10 13:02:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-87bcb79e-190d-4a86-bd3c-a734ba260537 tempest-ProjectReaderTests-1805919051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:02:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-87bcb79e-190d-4a86-bd3c-a734ba260537 tempest-ProjectReaderTests-1805919051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:02:49 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-87bcb79e-190d-4a86-bd3c-a734ba260537 tempest-ProjectReaderTests-1805919051 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1784265838',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eba2bac9ba8240e4b6c7825aeee0bdc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:02:49Z,use_quota=True,user_id='5c9819a9765743f798b8c839da755b20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 13:02:49 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-87bcb79e-190d-4a86-bd3c-a734ba260537 tempest-ProjectReaderTests-1805919051 None] Creating volume 9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 13:02:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-87bcb79e-190d-4a86-bd3c-a734ba260537 tempest-ProjectReaderTests-1805919051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:02:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-87bcb79e-190d-4a86-bd3c-a734ba260537 tempest-ProjectReaderTests-1805919051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:02:49 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-87bcb79e-190d-4a86-bd3c-a734ba260537 tempest-ProjectReaderTests-1805919051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:02:49 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-87bcb79e-190d-4a86-bd3c-a734ba260537 tempest-ProjectReaderTests-1805919051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:02:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-87bcb79e-190d-4a86-bd3c-a734ba260537 tempest-ProjectReaderTests-1805919051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:02:49 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-87bcb79e-190d-4a86-bd3c-a734ba260537 tempest-ProjectReaderTests-1805919051 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 13:02:49 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-87bcb79e-190d-4a86-bd3c-a734ba260537 tempest-ProjectReaderTests-1805919051 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 13:02:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-87bcb79e-190d-4a86-bd3c-a734ba260537 tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:49 devstack sudo[107272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c 1073741824
Jul 10 13:02:49 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:50 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-87bcb79e-190d-4a86-bd3c-a734ba260537 tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c 1073741824" returned: 0 in 0.848s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-87bcb79e-190d-4a86-bd3c-a734ba260537 tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:50 devstack sudo[107279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c
Jul 10 13:02:50 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:51 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-87bcb79e-190d-4a86-bd3c-a734ba260537 tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c" returned: 0 in 0.655s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:51 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-87bcb79e-190d-4a86-bd3c-a734ba260537 tempest-ProjectReaderTests-1805919051 None] <== create_volume: return (1549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 13:02:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-87bcb79e-190d-4a86-bd3c-a734ba260537 tempest-ProjectReaderTests-1805919051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.553s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:02:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-87bcb79e-190d-4a86-bd3c-a734ba260537 tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (891de18a-acb5-4e89-83a9-451e0b287e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-87bcb79e-190d-4a86-bd3c-a734ba260537 tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05779913-6296-45fd-a4ff-095a028ed729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:51 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-87bcb79e-190d-4a86-bd3c-a734ba260537 tempest-ProjectReaderTests-1805919051 None] Volume volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c (9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c): created successfully
Jul 10 13:02:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-87bcb79e-190d-4a86-bd3c-a734ba260537 tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05779913-6296-45fd-a4ff-095a028ed729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-87bcb79e-190d-4a86-bd3c-a734ba260537 tempest-ProjectReaderTests-1805919051 None] Flow 'volume_create_manager' (54907d1d-07b1-4408-b73c-82494baa616c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:02:51 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-87bcb79e-190d-4a86-bd3c-a734ba260537 tempest-ProjectReaderTests-1805919051 None] Created volume successfully.
Jul 10 13:02:51 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbb5694e-2d69-428b-8885-5ffb4354d17f tempest-ProjectMemberTests-1574481172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 13:02:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fbb5694e-2d69-428b-8885-5ffb4354d17f tempest-ProjectMemberTests-1574481172 None] Flow 'volume_create_manager' (f3b891d7-18b4-42b1-a209-430635c9ff52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:02:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fbb5694e-2d69-428b-8885-5ffb4354d17f tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d82ab54-28f8-49de-9c33-dd450c96aae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fbb5694e-2d69-428b-8885-5ffb4354d17f tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d82ab54-28f8-49de-9c33-dd450c96aae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:02:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2112194327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ab5735dd8284364bf17f2c244fabbf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:02:52Z,use_quota=True,user_id='7ead579763934814b4b50051ee0ea3a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fbb5694e-2d69-428b-8885-5ffb4354d17f tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4351fcc5-86d6-4b0b-9850-0ff6a3c2d7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fbb5694e-2d69-428b-8885-5ffb4354d17f tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4351fcc5-86d6-4b0b-9850-0ff6a3c2d7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fbb5694e-2d69-428b-8885-5ffb4354d17f tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (865fb4f0-6aeb-4e6a-9f55-fc4264e4b17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fbb5694e-2d69-428b-8885-5ffb4354d17f tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (865fb4f0-6aeb-4e6a-9f55-fc4264e4b17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7', 'volume_name': 'volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fbb5694e-2d69-428b-8885-5ffb4354d17f tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e86fcd49-542a-4f8a-b84e-4ce8aaf4fc5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fbb5694e-2d69-428b-8885-5ffb4354d17f tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e86fcd49-542a-4f8a-b84e-4ce8aaf4fc5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:51 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fbb5694e-2d69-428b-8885-5ffb4354d17f tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e170f04-e424-4700-8ec7-b1965efa0bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:51 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-fbb5694e-2d69-428b-8885-5ffb4354d17f tempest-ProjectMemberTests-1574481172 None] Volume 57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7', 'volume_size': 1}
Jul 10 13:02:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-fbb5694e-2d69-428b-8885-5ffb4354d17f tempest-ProjectMemberTests-1574481172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:02:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-fbb5694e-2d69-428b-8885-5ffb4354d17f tempest-ProjectMemberTests-1574481172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:02:51 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-fbb5694e-2d69-428b-8885-5ffb4354d17f tempest-ProjectMemberTests-1574481172 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:02:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2112194327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ab5735dd8284364bf17f2c244fabbf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:02:52Z,use_quota=True,user_id='7ead579763934814b4b50051ee0ea3a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 13:02:51 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-fbb5694e-2d69-428b-8885-5ffb4354d17f tempest-ProjectMemberTests-1574481172 None] Creating volume 57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 13:02:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-fbb5694e-2d69-428b-8885-5ffb4354d17f tempest-ProjectMemberTests-1574481172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:02:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-fbb5694e-2d69-428b-8885-5ffb4354d17f tempest-ProjectMemberTests-1574481172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:02:51 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-fbb5694e-2d69-428b-8885-5ffb4354d17f tempest-ProjectMemberTests-1574481172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:02:51 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-fbb5694e-2d69-428b-8885-5ffb4354d17f tempest-ProjectMemberTests-1574481172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:02:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-fbb5694e-2d69-428b-8885-5ffb4354d17f tempest-ProjectMemberTests-1574481172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:02:51 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-fbb5694e-2d69-428b-8885-5ffb4354d17f tempest-ProjectMemberTests-1574481172 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 13:02:51 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-fbb5694e-2d69-428b-8885-5ffb4354d17f tempest-ProjectMemberTests-1574481172 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 13:02:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fbb5694e-2d69-428b-8885-5ffb4354d17f tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-82f32393-1060-42aa-b31b-ddcda77e5509 tempest-ProjectReaderTests-1805919051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:02:51 devstack sudo[107282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7 1073741824
Jul 10 13:02:51 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:52 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fbb5694e-2d69-428b-8885-5ffb4354d17f tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7 1073741824" returned: 0 in 0.821s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fbb5694e-2d69-428b-8885-5ffb4354d17f tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:52 devstack sudo[107288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7
Jul 10 13:02:52 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:53 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fbb5694e-2d69-428b-8885-5ffb4354d17f tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7" returned: 0 in 0.639s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:53 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-fbb5694e-2d69-428b-8885-5ffb4354d17f tempest-ProjectMemberTests-1574481172 None] <== create_volume: return (1496ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 13:02:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-fbb5694e-2d69-428b-8885-5ffb4354d17f tempest-ProjectMemberTests-1574481172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.498s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:02:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-82f32393-1060-42aa-b31b-ddcda77e5509 tempest-ProjectReaderTests-1805919051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.469s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:02:53 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fbb5694e-2d69-428b-8885-5ffb4354d17f tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e170f04-e424-4700-8ec7-b1965efa0bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:53 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fbb5694e-2d69-428b-8885-5ffb4354d17f tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48ba1a63-2b18-4512-b9ad-d401cd23dceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:02:53 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-82f32393-1060-42aa-b31b-ddcda77e5509 tempest-ProjectReaderTests-1805919051 None] Creating offline snapshot 60ddd7e4-b14e-4926-8a91-359e198d9214 of volume 9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c {{(pid=87378) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 10 13:02:53 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-fbb5694e-2d69-428b-8885-5ffb4354d17f tempest-ProjectMemberTests-1574481172 None] Volume volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7 (57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7): created successfully
Jul 10 13:02:53 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fbb5694e-2d69-428b-8885-5ffb4354d17f tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48ba1a63-2b18-4512-b9ad-d401cd23dceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:02:53 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fbb5694e-2d69-428b-8885-5ffb4354d17f tempest-ProjectMemberTests-1574481172 None] Flow 'volume_create_manager' (f3b891d7-18b4-42b1-a209-430635c9ff52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:02:53 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00c633c-b9b1-4c48-995d-2f4987ef3512]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:02:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-82f32393-1060-42aa-b31b-ddcda77e5509 tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:53 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-fbb5694e-2d69-428b-8885-5ffb4354d17f tempest-ProjectMemberTests-1574481172 None] Created volume successfully.
Jul 10 13:02:53 devstack sudo[107291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c
Jul 10 13:02:53 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-564d3abf-0ec2-4cb7-b531-8256a9c64bec tempest-ProjectMemberTests-1574481172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:02:54 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-82f32393-1060-42aa-b31b-ddcda77e5509 tempest-ProjectReaderTests-1805919051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c" returned: 0 in 0.775s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-82f32393-1060-42aa-b31b-ddcda77e5509 tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c.60ddd7e4-b14e-4926-8a91-359e198d9214 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:54 devstack sudo[107296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c.60ddd7e4-b14e-4926-8a91-359e198d9214 1G
Jul 10 13:02:54 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:54 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-82f32393-1060-42aa-b31b-ddcda77e5509 tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c.60ddd7e4-b14e-4926-8a91-359e198d9214 1G" returned: 0 in 0.816s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-82f32393-1060-42aa-b31b-ddcda77e5509 tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c.60ddd7e4-b14e-4926-8a91-359e198d9214 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:54 devstack sudo[107302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c.60ddd7e4-b14e-4926-8a91-359e198d9214
Jul 10 13:02:54 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:55 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-82f32393-1060-42aa-b31b-ddcda77e5509 tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c.60ddd7e4-b14e-4926-8a91-359e198d9214" returned: 0 in 0.677s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:55 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-82f32393-1060-42aa-b31b-ddcda77e5509 tempest-ProjectReaderTests-1805919051 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c.60ddd7e4-b14e-4926-8a91-359e198d9214 is being set with open permissions: ugo+rw
Jul 10 13:02:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-82f32393-1060-42aa-b31b-ddcda77e5509 tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c.60ddd7e4-b14e-4926-8a91-359e198d9214 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:55 devstack sudo[107307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c.60ddd7e4-b14e-4926-8a91-359e198d9214
Jul 10 13:02:55 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:56 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-82f32393-1060-42aa-b31b-ddcda77e5509 tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c.60ddd7e4-b14e-4926-8a91-359e198d9214" returned: 0 in 0.642s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-82f32393-1060-42aa-b31b-ddcda77e5509 tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:56 devstack sudo[107310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c.info
Jul 10 13:02:56 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:56 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-82f32393-1060-42aa-b31b-ddcda77e5509 tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c.info" returned: 0 in 0.643s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:56 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-82f32393-1060-42aa-b31b-ddcda77e5509 tempest-ProjectReaderTests-1805919051 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c.info is being set with open permissions: ugo+rw
Jul 10 13:02:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-82f32393-1060-42aa-b31b-ddcda77e5509 tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:56 devstack sudo[107314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c.info
Jul 10 13:02:56 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:57 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-82f32393-1060-42aa-b31b-ddcda77e5509 tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c.info" returned: 0 in 0.626s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-82f32393-1060-42aa-b31b-ddcda77e5509 tempest-ProjectReaderTests-1805919051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.273s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:02:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-564d3abf-0ec2-4cb7-b531-8256a9c64bec tempest-ProjectMemberTests-1574481172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.522s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:02:57 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-564d3abf-0ec2-4cb7-b531-8256a9c64bec tempest-ProjectMemberTests-1574481172 None] Creating offline snapshot b5ad6e08-8e1f-4d55-9bc2-fe4052af1b79 of volume 57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7 {{(pid=87378) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 10 13:02:57 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-82f32393-1060-42aa-b31b-ddcda77e5509 tempest-ProjectReaderTests-1805919051 None] Create snapshot completed successfully
Jul 10 13:02:57 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0507071-ffc7-4fbd-a7d2-c0792fd5bb13]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:02:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-564d3abf-0ec2-4cb7-b531-8256a9c64bec tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:57 devstack sudo[107317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7
Jul 10 13:02:57 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:57 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9da004b5-188b-4811-8722-022ed384c5e3 tempest-ProjectReaderTests-1805919051 None] Acquiring lock "cinder-60ddd7e4-b14e-4926-8a91-359e198d9214-delete_snapshot" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:02:57 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9da004b5-188b-4811-8722-022ed384c5e3 tempest-ProjectReaderTests-1805919051 None] Lock "cinder-60ddd7e4-b14e-4926-8a91-359e198d9214-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:02:57 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9da004b5-188b-4811-8722-022ed384c5e3 tempest-ProjectReaderTests-1805919051 None] Acquiring lock "cinder-quobyte-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:02:57 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9da004b5-188b-4811-8722-022ed384c5e3 tempest-ProjectReaderTests-1805919051 None] Lock "cinder-quobyte-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:02:57 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9da004b5-188b-4811-8722-022ed384c5e3 tempest-ProjectReaderTests-1805919051 None] Acquiring lock "cinder-quobyte-60ddd7e4-b14e-4926-8a91-359e198d9214" by "_delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:02:57 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9da004b5-188b-4811-8722-022ed384c5e3 tempest-ProjectReaderTests-1805919051 None] Lock "cinder-quobyte-60ddd7e4-b14e-4926-8a91-359e198d9214" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:02:57 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-9da004b5-188b-4811-8722-022ed384c5e3 tempest-ProjectReaderTests-1805919051 None] Deleting offline snapshot 60ddd7e4-b14e-4926-8a91-359e198d9214 of volume 9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 10 13:02:57 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-9da004b5-188b-4811-8722-022ed384c5e3 tempest-ProjectReaderTests-1805919051 None] snapshot_file for this snap is: volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c.60ddd7e4-b14e-4926-8a91-359e198d9214 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 10 13:02:57 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[28365224-f126-4b8e-912a-a1fd03ce074f]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:02:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9da004b5-188b-4811-8722-022ed384c5e3 tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c.60ddd7e4-b14e-4926-8a91-359e198d9214 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:58 devstack sudo[107319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c.60ddd7e4-b14e-4926-8a91-359e198d9214
Jul 10 13:02:58 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:58 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-564d3abf-0ec2-4cb7-b531-8256a9c64bec tempest-ProjectMemberTests-1574481172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7" returned: 0 in 0.765s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-564d3abf-0ec2-4cb7-b531-8256a9c64bec tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7.b5ad6e08-8e1f-4d55-9bc2-fe4052af1b79 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:58 devstack sudo[107324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7.b5ad6e08-8e1f-4d55-9bc2-fe4052af1b79 1G
Jul 10 13:02:58 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:58 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9da004b5-188b-4811-8722-022ed384c5e3 tempest-ProjectReaderTests-1805919051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c.60ddd7e4-b14e-4926-8a91-359e198d9214" returned: 0 in 0.768s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:58 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-9da004b5-188b-4811-8722-022ed384c5e3 tempest-ProjectReaderTests-1805919051 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 13:02:58 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[69aed3b3-0991-49c6-a279-b2d2157b508c]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:02:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9da004b5-188b-4811-8722-022ed384c5e3 tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:58 devstack sudo[107329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c
Jul 10 13:02:58 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:59 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-564d3abf-0ec2-4cb7-b531-8256a9c64bec tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7.b5ad6e08-8e1f-4d55-9bc2-fe4052af1b79 1G" returned: 0 in 0.787s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-564d3abf-0ec2-4cb7-b531-8256a9c64bec tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7.b5ad6e08-8e1f-4d55-9bc2-fe4052af1b79 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:59 devstack sudo[107335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7.b5ad6e08-8e1f-4d55-9bc2-fe4052af1b79
Jul 10 13:02:59 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:59 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9da004b5-188b-4811-8722-022ed384c5e3 tempest-ProjectReaderTests-1805919051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c" returned: 0 in 0.772s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9da004b5-188b-4811-8722-022ed384c5e3 tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c.60ddd7e4-b14e-4926-8a91-359e198d9214 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:59 devstack sudo[107342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c.60ddd7e4-b14e-4926-8a91-359e198d9214
Jul 10 13:02:59 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:02:59 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root
Jul 10 13:02:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-564d3abf-0ec2-4cb7-b531-8256a9c64bec tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7.b5ad6e08-8e1f-4d55-9bc2-fe4052af1b79" returned: 0 in 0.672s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:02:59 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-564d3abf-0ec2-4cb7-b531-8256a9c64bec tempest-ProjectMemberTests-1574481172 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7.b5ad6e08-8e1f-4d55-9bc2-fe4052af1b79 is being set with open permissions: ugo+rw
Jul 10 13:02:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-564d3abf-0ec2-4cb7-b531-8256a9c64bec tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7.b5ad6e08-8e1f-4d55-9bc2-fe4052af1b79 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:02:59 devstack sudo[107348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7.b5ad6e08-8e1f-4d55-9bc2-fe4052af1b79
Jul 10 13:02:59 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:00 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9da004b5-188b-4811-8722-022ed384c5e3 tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c.60ddd7e4-b14e-4926-8a91-359e198d9214" returned: 0 in 0.783s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9da004b5-188b-4811-8722-022ed384c5e3 tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c.60ddd7e4-b14e-4926-8a91-359e198d9214 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:00 devstack sudo[107354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c.60ddd7e4-b14e-4926-8a91-359e198d9214
Jul 10 13:03:00 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:00 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-564d3abf-0ec2-4cb7-b531-8256a9c64bec tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7.b5ad6e08-8e1f-4d55-9bc2-fe4052af1b79" returned: 0 in 0.624s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-564d3abf-0ec2-4cb7-b531-8256a9c64bec tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:00 devstack sudo[107356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7.info
Jul 10 13:03:00 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:00 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9da004b5-188b-4811-8722-022ed384c5e3 tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c.60ddd7e4-b14e-4926-8a91-359e198d9214" returned: 0 in 0.677s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:01 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9da004b5-188b-4811-8722-022ed384c5e3 tempest-ProjectReaderTests-1805919051 None] Lock "cinder-quobyte-60ddd7e4-b14e-4926-8a91-359e198d9214" released by "_delete_snapshot" :: held 3.101s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:03:01 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9da004b5-188b-4811-8722-022ed384c5e3 tempest-ProjectReaderTests-1805919051 None] Lock "cinder-quobyte-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c" released by "delete_snapshot" :: held 3.122s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:03:01 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-564d3abf-0ec2-4cb7-b531-8256a9c64bec tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7.info" returned: 0 in 0.660s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:01 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-564d3abf-0ec2-4cb7-b531-8256a9c64bec tempest-ProjectMemberTests-1574481172 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7.info is being set with open permissions: ugo+rw
Jul 10 13:03:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-564d3abf-0ec2-4cb7-b531-8256a9c64bec tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:01 devstack sudo[107360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7.info
Jul 10 13:03:01 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:01 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-9da004b5-188b-4811-8722-022ed384c5e3 tempest-ProjectReaderTests-1805919051 None] Created reservations ['7ec9a5a1-f5b5-4ad7-8df7-ea456dab7b26', '0a4f20db-5cdf-4c39-854f-601c497a325a', 'de76ef42-238a-4a3f-badc-5cc74cd4f962', 'c70fb928-1081-4f5e-96f9-5864fb4d42ef'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:03:01 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-9da004b5-188b-4811-8722-022ed384c5e3 tempest-ProjectReaderTests-1805919051 None] Delete snapshot completed successfully.
Jul 10 13:03:01 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9da004b5-188b-4811-8722-022ed384c5e3 tempest-ProjectReaderTests-1805919051 None] Lock "cinder-60ddd7e4-b14e-4926-8a91-359e198d9214-delete_snapshot" released by "delete_snapshot" :: held 3.297s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:03:01 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-564d3abf-0ec2-4cb7-b531-8256a9c64bec tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7.info" returned: 0 in 0.667s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-564d3abf-0ec2-4cb7-b531-8256a9c64bec tempest-ProjectMemberTests-1574481172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.268s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:03:01 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-564d3abf-0ec2-4cb7-b531-8256a9c64bec tempest-ProjectMemberTests-1574481172 None] Create snapshot completed successfully
Jul 10 13:03:02 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-752812d3-02a5-48a1-b16d-ac363edd9845 tempest-ProjectReaderTests-1805919051 None] Acquiring lock "cinder-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:03:02 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-752812d3-02a5-48a1-b16d-ac363edd9845 tempest-ProjectReaderTests-1805919051 None] Lock "cinder-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:03:02 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-752812d3-02a5-48a1-b16d-ac363edd9845 tempest-ProjectReaderTests-1805919051 None] Acquiring lock "cinder-quobyte-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:03:02 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-752812d3-02a5-48a1-b16d-ac363edd9845 tempest-ProjectReaderTests-1805919051 None] Lock "cinder-quobyte-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c" acquired by "delete_volume" :: waited 0.014s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:03:02 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b16d63b-8e05-42f2-8532-e2d637209c3f]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:03:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-752812d3-02a5-48a1-b16d-ac363edd9845 tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:02 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9b9597a0-4106-4750-a2ba-bc0c5dd5d28e tempest-ProjectMemberTests-1574481172 None] Acquiring lock "cinder-b5ad6e08-8e1f-4d55-9bc2-fe4052af1b79-delete_snapshot" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:03:02 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9b9597a0-4106-4750-a2ba-bc0c5dd5d28e tempest-ProjectMemberTests-1574481172 None] Lock "cinder-b5ad6e08-8e1f-4d55-9bc2-fe4052af1b79-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:03:02 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9b9597a0-4106-4750-a2ba-bc0c5dd5d28e tempest-ProjectMemberTests-1574481172 None] Acquiring lock "cinder-quobyte-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:03:02 devstack sudo[107363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c
Jul 10 13:03:02 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9b9597a0-4106-4750-a2ba-bc0c5dd5d28e tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:03:02 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9b9597a0-4106-4750-a2ba-bc0c5dd5d28e tempest-ProjectMemberTests-1574481172 None] Acquiring lock "cinder-quobyte-b5ad6e08-8e1f-4d55-9bc2-fe4052af1b79" by "_delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:03:02 devstack sudo[107363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:02 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9b9597a0-4106-4750-a2ba-bc0c5dd5d28e tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-b5ad6e08-8e1f-4d55-9bc2-fe4052af1b79" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:03:02 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-9b9597a0-4106-4750-a2ba-bc0c5dd5d28e tempest-ProjectMemberTests-1574481172 None] Deleting offline snapshot b5ad6e08-8e1f-4d55-9bc2-fe4052af1b79 of volume 57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 10 13:03:02 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-9b9597a0-4106-4750-a2ba-bc0c5dd5d28e tempest-ProjectMemberTests-1574481172 None] snapshot_file for this snap is: volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7.b5ad6e08-8e1f-4d55-9bc2-fe4052af1b79 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 10 13:03:02 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[16630639-6d9d-4b28-902d-93ae30b4e27d]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:03:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9b9597a0-4106-4750-a2ba-bc0c5dd5d28e tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7.b5ad6e08-8e1f-4d55-9bc2-fe4052af1b79 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:02 devstack sudo[107365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7.b5ad6e08-8e1f-4d55-9bc2-fe4052af1b79
Jul 10 13:03:02 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:02 devstack sudo[107363]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-752812d3-02a5-48a1-b16d-ac363edd9845 tempest-ProjectReaderTests-1805919051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c" returned: 0 in 0.775s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-752812d3-02a5-48a1-b16d-ac363edd9845 tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:02 devstack sudo[107370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c
Jul 10 13:03:02 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:03 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9b9597a0-4106-4750-a2ba-bc0c5dd5d28e tempest-ProjectMemberTests-1574481172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7.b5ad6e08-8e1f-4d55-9bc2-fe4052af1b79" returned: 0 in 0.776s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:03 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-9b9597a0-4106-4750-a2ba-bc0c5dd5d28e tempest-ProjectMemberTests-1574481172 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 13:03:03 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[046ce53f-1b85-4e61-8994-d50fc8282467]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:03:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9b9597a0-4106-4750-a2ba-bc0c5dd5d28e tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:03 devstack sudo[107375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7
Jul 10 13:03:03 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:03 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-752812d3-02a5-48a1-b16d-ac363edd9845 tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c" returned: 0 in 0.663s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:03 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-752812d3-02a5-48a1-b16d-ac363edd9845 tempest-ProjectReaderTests-1805919051 None] Lock "cinder-quobyte-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c" released by "delete_volume" :: held 1.500s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:03:03 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-752812d3-02a5-48a1-b16d-ac363edd9845 tempest-ProjectReaderTests-1805919051 None] Created reservations ['3a414248-723a-455f-9086-bcf1ef14a7c9', '7e257530-626d-48a1-b52a-4c950ab3783e', '87138135-f4eb-4603-91d1-ba865eda0d31', '7de4c27b-234e-43e6-8c3f-e3c6f02fcf80'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:03:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-752812d3-02a5-48a1-b16d-ac363edd9845 tempest-ProjectReaderTests-1805919051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:03:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-752812d3-02a5-48a1-b16d-ac363edd9845 tempest-ProjectReaderTests-1805919051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:03:03 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-752812d3-02a5-48a1-b16d-ac363edd9845 tempest-ProjectReaderTests-1805919051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:03:03 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-752812d3-02a5-48a1-b16d-ac363edd9845 tempest-ProjectReaderTests-1805919051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:03:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-752812d3-02a5-48a1-b16d-ac363edd9845 tempest-ProjectReaderTests-1805919051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:03:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-752812d3-02a5-48a1-b16d-ac363edd9845 tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:03 devstack sudo[107378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:03:03 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:03 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9b9597a0-4106-4750-a2ba-bc0c5dd5d28e tempest-ProjectMemberTests-1574481172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7" returned: 0 in 0.772s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9b9597a0-4106-4750-a2ba-bc0c5dd5d28e tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7.b5ad6e08-8e1f-4d55-9bc2-fe4052af1b79 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:03 devstack sudo[107383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7.b5ad6e08-8e1f-4d55-9bc2-fe4052af1b79
Jul 10 13:03:03 devstack sudo[107383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:04 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-752812d3-02a5-48a1-b16d-ac363edd9845 tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.678s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:04 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-752812d3-02a5-48a1-b16d-ac363edd9845 tempest-ProjectReaderTests-1805919051 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:03:04 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-752812d3-02a5-48a1-b16d-ac363edd9845 tempest-ProjectReaderTests-1805919051 None] Deleted volume successfully.
Jul 10 13:03:04 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-752812d3-02a5-48a1-b16d-ac363edd9845 tempest-ProjectReaderTests-1805919051 None] Lock "cinder-9dc20f8c-1fe1-4d61-aa8d-b293caaeb53c-delete_volume" released by "delete_volume" :: held 2.383s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:03:04 devstack sudo[107383]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9b9597a0-4106-4750-a2ba-bc0c5dd5d28e tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7.b5ad6e08-8e1f-4d55-9bc2-fe4052af1b79" returned: 0 in 0.757s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9b9597a0-4106-4750-a2ba-bc0c5dd5d28e tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7.b5ad6e08-8e1f-4d55-9bc2-fe4052af1b79 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:04 devstack sudo[107389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7.b5ad6e08-8e1f-4d55-9bc2-fe4052af1b79
Jul 10 13:03:04 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:04 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-01146442-fd1b-43bd-b52f-e9819465700d tempest-ProjectReaderTests-1805919051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 13:03:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-01146442-fd1b-43bd-b52f-e9819465700d tempest-ProjectReaderTests-1805919051 None] Flow 'volume_create_manager' (2bdec50a-d83f-40f4-836f-b538ece9b8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:03:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-01146442-fd1b-43bd-b52f-e9819465700d tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d18aa8e-1ab5-45ea-ae81-f6a8349268d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:03:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-01146442-fd1b-43bd-b52f-e9819465700d tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d18aa8e-1ab5-45ea-ae81-f6a8349268d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:03:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-354510716',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60950602-624b-4407-b295-705733a04fc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eba2bac9ba8240e4b6c7825aeee0bdc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:03:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:03:05Z,use_quota=True,user_id='5c9819a9765743f798b8c839da755b20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:03:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-01146442-fd1b-43bd-b52f-e9819465700d tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b32057d2-6ad3-4e10-8e89-4d315cc06ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:03:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-01146442-fd1b-43bd-b52f-e9819465700d tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b32057d2-6ad3-4e10-8e89-4d315cc06ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:03:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-01146442-fd1b-43bd-b52f-e9819465700d tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5580d6d-2fd5-4e0e-831f-1fee592c26cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:03:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-01146442-fd1b-43bd-b52f-e9819465700d tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5580d6d-2fd5-4e0e-831f-1fee592c26cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60950602-624b-4407-b295-705733a04fc4', 'volume_name': 'volume-60950602-624b-4407-b295-705733a04fc4', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:03:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-01146442-fd1b-43bd-b52f-e9819465700d tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1474dd81-5150-4df2-a095-7941bded1752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:03:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-01146442-fd1b-43bd-b52f-e9819465700d tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1474dd81-5150-4df2-a095-7941bded1752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:03:04 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-01146442-fd1b-43bd-b52f-e9819465700d tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97255530-6890-4e94-b2e4-c6a4521d83e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:03:04 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-01146442-fd1b-43bd-b52f-e9819465700d tempest-ProjectReaderTests-1805919051 None] Volume 60950602-624b-4407-b295-705733a04fc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60950602-624b-4407-b295-705733a04fc4', 'volume_size': 1}
Jul 10 13:03:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-01146442-fd1b-43bd-b52f-e9819465700d tempest-ProjectReaderTests-1805919051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:03:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-01146442-fd1b-43bd-b52f-e9819465700d tempest-ProjectReaderTests-1805919051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:03:04 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-01146442-fd1b-43bd-b52f-e9819465700d tempest-ProjectReaderTests-1805919051 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:03:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-354510716',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60950602-624b-4407-b295-705733a04fc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eba2bac9ba8240e4b6c7825aeee0bdc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:03:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:03:05Z,use_quota=True,user_id='5c9819a9765743f798b8c839da755b20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 13:03:04 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-01146442-fd1b-43bd-b52f-e9819465700d tempest-ProjectReaderTests-1805919051 None] Creating volume 60950602-624b-4407-b295-705733a04fc4 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 13:03:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-01146442-fd1b-43bd-b52f-e9819465700d tempest-ProjectReaderTests-1805919051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:03:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-01146442-fd1b-43bd-b52f-e9819465700d tempest-ProjectReaderTests-1805919051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:03:04 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-01146442-fd1b-43bd-b52f-e9819465700d tempest-ProjectReaderTests-1805919051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:03:04 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-01146442-fd1b-43bd-b52f-e9819465700d tempest-ProjectReaderTests-1805919051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:03:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-01146442-fd1b-43bd-b52f-e9819465700d tempest-ProjectReaderTests-1805919051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:03:04 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-01146442-fd1b-43bd-b52f-e9819465700d tempest-ProjectReaderTests-1805919051 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 13:03:04 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-01146442-fd1b-43bd-b52f-e9819465700d tempest-ProjectReaderTests-1805919051 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 13:03:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-01146442-fd1b-43bd-b52f-e9819465700d tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-60950602-624b-4407-b295-705733a04fc4 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:04 devstack sudo[107391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-60950602-624b-4407-b295-705733a04fc4 1073741824
Jul 10 13:03:04 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:05 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-9b9597a0-4106-4750-a2ba-bc0c5dd5d28e tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7.b5ad6e08-8e1f-4d55-9bc2-fe4052af1b79" returned: 0 in 0.654s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:05 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9b9597a0-4106-4750-a2ba-bc0c5dd5d28e tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-b5ad6e08-8e1f-4d55-9bc2-fe4052af1b79" released by "_delete_snapshot" :: held 3.057s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:03:05 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9b9597a0-4106-4750-a2ba-bc0c5dd5d28e tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7" released by "delete_snapshot" :: held 3.080s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:03:05 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-9b9597a0-4106-4750-a2ba-bc0c5dd5d28e tempest-ProjectMemberTests-1574481172 None] Created reservations ['02419e38-8633-49c5-b3e5-61a16ae1522c', '173562a0-9e9b-40da-a8a8-4468474d8d66', '8ffe1ca1-f6e9-4418-aa8d-2c9a246af9dc', '03d0b71a-a305-4ec5-a383-b4385f7a2321'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:03:05 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-9b9597a0-4106-4750-a2ba-bc0c5dd5d28e tempest-ProjectMemberTests-1574481172 None] Delete snapshot completed successfully.
Jul 10 13:03:05 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-9b9597a0-4106-4750-a2ba-bc0c5dd5d28e tempest-ProjectMemberTests-1574481172 None] Lock "cinder-b5ad6e08-8e1f-4d55-9bc2-fe4052af1b79-delete_snapshot" released by "delete_snapshot" :: held 3.215s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:03:05 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-01146442-fd1b-43bd-b52f-e9819465700d tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-60950602-624b-4407-b295-705733a04fc4 1073741824" returned: 0 in 0.832s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-01146442-fd1b-43bd-b52f-e9819465700d tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-60950602-624b-4407-b295-705733a04fc4 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:05 devstack sudo[107398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-60950602-624b-4407-b295-705733a04fc4
Jul 10 13:03:05 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:06 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-01146442-fd1b-43bd-b52f-e9819465700d tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-60950602-624b-4407-b295-705733a04fc4" returned: 0 in 0.644s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:06 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-01146442-fd1b-43bd-b52f-e9819465700d tempest-ProjectReaderTests-1805919051 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 13:03:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-01146442-fd1b-43bd-b52f-e9819465700d tempest-ProjectReaderTests-1805919051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:03:06 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-01146442-fd1b-43bd-b52f-e9819465700d tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97255530-6890-4e94-b2e4-c6a4521d83e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60950602-624b-4407-b295-705733a04fc4', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:03:06 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-01146442-fd1b-43bd-b52f-e9819465700d tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d294ccf1-25c2-40a1-a81d-2ca336664767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:03:06 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-01146442-fd1b-43bd-b52f-e9819465700d tempest-ProjectReaderTests-1805919051 None] Volume volume-60950602-624b-4407-b295-705733a04fc4 (60950602-624b-4407-b295-705733a04fc4): created successfully
Jul 10 13:03:06 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-01146442-fd1b-43bd-b52f-e9819465700d tempest-ProjectReaderTests-1805919051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d294ccf1-25c2-40a1-a81d-2ca336664767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:03:06 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-01146442-fd1b-43bd-b52f-e9819465700d tempest-ProjectReaderTests-1805919051 None] Flow 'volume_create_manager' (2bdec50a-d83f-40f4-836f-b538ece9b8ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:03:06 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-01146442-fd1b-43bd-b52f-e9819465700d tempest-ProjectReaderTests-1805919051 None] Created volume successfully.
Jul 10 13:03:06 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8c53e892-0ed7-4bdf-a115-1cb2dc3f908c tempest-ProjectMemberTests-1574481172 None] Acquiring lock "cinder-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:03:06 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8c53e892-0ed7-4bdf-a115-1cb2dc3f908c tempest-ProjectMemberTests-1574481172 None] Lock "cinder-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:03:06 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8c53e892-0ed7-4bdf-a115-1cb2dc3f908c tempest-ProjectMemberTests-1574481172 None] Acquiring lock "cinder-quobyte-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:03:06 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8c53e892-0ed7-4bdf-a115-1cb2dc3f908c tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7" acquired by "delete_volume" :: waited 0.014s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:03:06 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa661b6-baa8-4f21-afc4-737360e68a80]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:03:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8c53e892-0ed7-4bdf-a115-1cb2dc3f908c tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:06 devstack sudo[107401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7
Jul 10 13:03:06 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-de30ee6d-03b5-43c9-bae2-efdd86b57d47 tempest-ProjectReaderTests-1805919051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:03:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-de30ee6d-03b5-43c9-bae2-efdd86b57d47 tempest-ProjectReaderTests-1805919051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:03:07 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-de30ee6d-03b5-43c9-bae2-efdd86b57d47 tempest-ProjectReaderTests-1805919051 None] Creating offline snapshot 4afde696-fab4-4a39-9cb8-26e895272796 of volume 60950602-624b-4407-b295-705733a04fc4 {{(pid=87378) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 10 13:03:07 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[191a358d-066c-422b-9f23-87b169c6a161]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:03:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-de30ee6d-03b5-43c9-bae2-efdd86b57d47 tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-60950602-624b-4407-b295-705733a04fc4 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:07 devstack sudo[107403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-60950602-624b-4407-b295-705733a04fc4
Jul 10 13:03:07 devstack sudo[107403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:07 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8c53e892-0ed7-4bdf-a115-1cb2dc3f908c tempest-ProjectMemberTests-1574481172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7" returned: 0 in 0.766s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8c53e892-0ed7-4bdf-a115-1cb2dc3f908c tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:07 devstack sudo[107408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7
Jul 10 13:03:07 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:07 devstack sudo[107403]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-de30ee6d-03b5-43c9-bae2-efdd86b57d47 tempest-ProjectReaderTests-1805919051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-60950602-624b-4407-b295-705733a04fc4" returned: 0 in 0.787s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-de30ee6d-03b5-43c9-bae2-efdd86b57d47 tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-60950602-624b-4407-b295-705733a04fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-60950602-624b-4407-b295-705733a04fc4.4afde696-fab4-4a39-9cb8-26e895272796 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:07 devstack sudo[107413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-60950602-624b-4407-b295-705733a04fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-60950602-624b-4407-b295-705733a04fc4.4afde696-fab4-4a39-9cb8-26e895272796 1G
Jul 10 13:03:07 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:08 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8c53e892-0ed7-4bdf-a115-1cb2dc3f908c tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7" returned: 0 in 0.686s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:08 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8c53e892-0ed7-4bdf-a115-1cb2dc3f908c tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7" released by "delete_volume" :: held 1.503s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:03:08 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-8c53e892-0ed7-4bdf-a115-1cb2dc3f908c tempest-ProjectMemberTests-1574481172 None] Created reservations ['27d9d2fd-c98d-4489-b054-ccccc4532d37', 'a829b7a2-0126-49a1-b4ee-8fa3b0be3e06', '9d188d9d-9371-4fb7-82ab-cbd223cc915c', 'de6bd01f-c395-495b-bee1-aaac27e717c0'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:03:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-8c53e892-0ed7-4bdf-a115-1cb2dc3f908c tempest-ProjectMemberTests-1574481172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:03:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-8c53e892-0ed7-4bdf-a115-1cb2dc3f908c tempest-ProjectMemberTests-1574481172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:03:08 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-8c53e892-0ed7-4bdf-a115-1cb2dc3f908c tempest-ProjectMemberTests-1574481172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:03:08 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-8c53e892-0ed7-4bdf-a115-1cb2dc3f908c tempest-ProjectMemberTests-1574481172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:03:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-8c53e892-0ed7-4bdf-a115-1cb2dc3f908c tempest-ProjectMemberTests-1574481172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:03:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8c53e892-0ed7-4bdf-a115-1cb2dc3f908c tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:08 devstack sudo[107416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:03:08 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:08 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-de30ee6d-03b5-43c9-bae2-efdd86b57d47 tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-60950602-624b-4407-b295-705733a04fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-60950602-624b-4407-b295-705733a04fc4.4afde696-fab4-4a39-9cb8-26e895272796 1G" returned: 0 in 0.820s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-de30ee6d-03b5-43c9-bae2-efdd86b57d47 tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60950602-624b-4407-b295-705733a04fc4 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-60950602-624b-4407-b295-705733a04fc4.4afde696-fab4-4a39-9cb8-26e895272796 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:08 devstack sudo[107421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60950602-624b-4407-b295-705733a04fc4 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-60950602-624b-4407-b295-705733a04fc4.4afde696-fab4-4a39-9cb8-26e895272796
Jul 10 13:03:08 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:08 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8c53e892-0ed7-4bdf-a115-1cb2dc3f908c tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.683s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:08 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-8c53e892-0ed7-4bdf-a115-1cb2dc3f908c tempest-ProjectMemberTests-1574481172 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:03:08 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-8c53e892-0ed7-4bdf-a115-1cb2dc3f908c tempest-ProjectMemberTests-1574481172 None] Deleted volume successfully.
Jul 10 13:03:08 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-8c53e892-0ed7-4bdf-a115-1cb2dc3f908c tempest-ProjectMemberTests-1574481172 None] Lock "cinder-57b1f4be-4473-4ea9-8ae2-eb74edf2f2a7-delete_volume" released by "delete_volume" :: held 2.390s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:03:09 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cc9e327-8a77-411a-87dd-ff6fd099e4da tempest-ProjectMemberTests-1574481172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 13:03:09 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6cc9e327-8a77-411a-87dd-ff6fd099e4da tempest-ProjectMemberTests-1574481172 None] Flow 'volume_create_manager' (22b2b47b-e768-4255-b72b-fa0492327956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:03:09 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6cc9e327-8a77-411a-87dd-ff6fd099e4da tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88c9c53c-3af0-40d5-b31b-bc93e2d6ec4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:03:09 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6cc9e327-8a77-411a-87dd-ff6fd099e4da tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88c9c53c-3af0-40d5-b31b-bc93e2d6ec4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-245133389',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4db9680e-26b4-4abf-b2ec-767d26cf6e74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ab5735dd8284364bf17f2c244fabbf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:03:09Z,use_quota=True,user_id='7ead579763934814b4b50051ee0ea3a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:03:09 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6cc9e327-8a77-411a-87dd-ff6fd099e4da tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbd95dda-e567-4359-b0cb-d9ffb06763e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:03:09 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6cc9e327-8a77-411a-87dd-ff6fd099e4da tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbd95dda-e567-4359-b0cb-d9ffb06763e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:03:09 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6cc9e327-8a77-411a-87dd-ff6fd099e4da tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85702565-6632-447d-8ff4-b649630c5666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:03:09 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6cc9e327-8a77-411a-87dd-ff6fd099e4da tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85702565-6632-447d-8ff4-b649630c5666) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4db9680e-26b4-4abf-b2ec-767d26cf6e74', 'volume_name': 'volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:03:09 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6cc9e327-8a77-411a-87dd-ff6fd099e4da tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6233a628-eeba-4174-a149-07d7e37b6a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:03:09 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6cc9e327-8a77-411a-87dd-ff6fd099e4da tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6233a628-eeba-4174-a149-07d7e37b6a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:03:09 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6cc9e327-8a77-411a-87dd-ff6fd099e4da tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c263320-3bfb-43b2-84a0-16cdcbc832eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:03:09 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-6cc9e327-8a77-411a-87dd-ff6fd099e4da tempest-ProjectMemberTests-1574481172 None] Volume 4db9680e-26b4-4abf-b2ec-767d26cf6e74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74', 'volume_size': 1}
Jul 10 13:03:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-6cc9e327-8a77-411a-87dd-ff6fd099e4da tempest-ProjectMemberTests-1574481172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:03:09 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-de30ee6d-03b5-43c9-bae2-efdd86b57d47 tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60950602-624b-4407-b295-705733a04fc4 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-60950602-624b-4407-b295-705733a04fc4.4afde696-fab4-4a39-9cb8-26e895272796" returned: 0 in 0.740s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:09 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-de30ee6d-03b5-43c9-bae2-efdd86b57d47 tempest-ProjectReaderTests-1805919051 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-60950602-624b-4407-b295-705733a04fc4.4afde696-fab4-4a39-9cb8-26e895272796 is being set with open permissions: ugo+rw
Jul 10 13:03:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-de30ee6d-03b5-43c9-bae2-efdd86b57d47 tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-60950602-624b-4407-b295-705733a04fc4.4afde696-fab4-4a39-9cb8-26e895272796 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:09 devstack sudo[107427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-60950602-624b-4407-b295-705733a04fc4.4afde696-fab4-4a39-9cb8-26e895272796
Jul 10 13:03:09 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:10 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-de30ee6d-03b5-43c9-bae2-efdd86b57d47 tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-60950602-624b-4407-b295-705733a04fc4.4afde696-fab4-4a39-9cb8-26e895272796" returned: 0 in 0.630s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-de30ee6d-03b5-43c9-bae2-efdd86b57d47 tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-60950602-624b-4407-b295-705733a04fc4.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:10 devstack sudo[107431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-60950602-624b-4407-b295-705733a04fc4.info
Jul 10 13:03:10 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:10 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-de30ee6d-03b5-43c9-bae2-efdd86b57d47 tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-60950602-624b-4407-b295-705733a04fc4.info" returned: 0 in 0.648s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:10 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-de30ee6d-03b5-43c9-bae2-efdd86b57d47 tempest-ProjectReaderTests-1805919051 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-60950602-624b-4407-b295-705733a04fc4.info is being set with open permissions: ugo+rw
Jul 10 13:03:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-de30ee6d-03b5-43c9-bae2-efdd86b57d47 tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-60950602-624b-4407-b295-705733a04fc4.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:10 devstack sudo[107434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-60950602-624b-4407-b295-705733a04fc4.info
Jul 10 13:03:10 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:11 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-de30ee6d-03b5-43c9-bae2-efdd86b57d47 tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-60950602-624b-4407-b295-705733a04fc4.info" returned: 0 in 0.626s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-de30ee6d-03b5-43c9-bae2-efdd86b57d47 tempest-ProjectReaderTests-1805919051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.326s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:03:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-6cc9e327-8a77-411a-87dd-ff6fd099e4da tempest-ProjectMemberTests-1574481172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.060s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:03:11 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-6cc9e327-8a77-411a-87dd-ff6fd099e4da tempest-ProjectMemberTests-1574481172 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-245133389',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4db9680e-26b4-4abf-b2ec-767d26cf6e74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ab5735dd8284364bf17f2c244fabbf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:03:09Z,use_quota=True,user_id='7ead579763934814b4b50051ee0ea3a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 13:03:11 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-6cc9e327-8a77-411a-87dd-ff6fd099e4da tempest-ProjectMemberTests-1574481172 None] Creating volume 4db9680e-26b4-4abf-b2ec-767d26cf6e74 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 13:03:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-6cc9e327-8a77-411a-87dd-ff6fd099e4da tempest-ProjectMemberTests-1574481172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:03:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-6cc9e327-8a77-411a-87dd-ff6fd099e4da tempest-ProjectMemberTests-1574481172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:03:11 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-6cc9e327-8a77-411a-87dd-ff6fd099e4da tempest-ProjectMemberTests-1574481172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:03:11 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-6cc9e327-8a77-411a-87dd-ff6fd099e4da tempest-ProjectMemberTests-1574481172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:03:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-6cc9e327-8a77-411a-87dd-ff6fd099e4da tempest-ProjectMemberTests-1574481172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:03:11 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-6cc9e327-8a77-411a-87dd-ff6fd099e4da tempest-ProjectMemberTests-1574481172 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 13:03:11 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-6cc9e327-8a77-411a-87dd-ff6fd099e4da tempest-ProjectMemberTests-1574481172 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 13:03:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6cc9e327-8a77-411a-87dd-ff6fd099e4da tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:11 devstack sudo[107437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74 1073741824
Jul 10 13:03:11 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:11 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-de30ee6d-03b5-43c9-bae2-efdd86b57d47 tempest-ProjectReaderTests-1805919051 None] Create snapshot completed successfully
Jul 10 13:03:12 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6cc9e327-8a77-411a-87dd-ff6fd099e4da tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74 1073741824" returned: 0 in 0.801s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6cc9e327-8a77-411a-87dd-ff6fd099e4da tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:12 devstack sudo[107442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74
Jul 10 13:03:12 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:12 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-577f1cf1-94d7-427e-a845-37061e732f4c tempest-ProjectReaderTests-1805919051 None] Acquiring lock "cinder-4afde696-fab4-4a39-9cb8-26e895272796-delete_snapshot" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:03:12 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-577f1cf1-94d7-427e-a845-37061e732f4c tempest-ProjectReaderTests-1805919051 None] Lock "cinder-4afde696-fab4-4a39-9cb8-26e895272796-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:03:12 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-577f1cf1-94d7-427e-a845-37061e732f4c tempest-ProjectReaderTests-1805919051 None] Acquiring lock "cinder-quobyte-60950602-624b-4407-b295-705733a04fc4" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:03:12 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-577f1cf1-94d7-427e-a845-37061e732f4c tempest-ProjectReaderTests-1805919051 None] Lock "cinder-quobyte-60950602-624b-4407-b295-705733a04fc4" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:03:12 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-577f1cf1-94d7-427e-a845-37061e732f4c tempest-ProjectReaderTests-1805919051 None] Acquiring lock "cinder-quobyte-4afde696-fab4-4a39-9cb8-26e895272796" by "_delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:03:12 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-577f1cf1-94d7-427e-a845-37061e732f4c tempest-ProjectReaderTests-1805919051 None] Lock "cinder-quobyte-4afde696-fab4-4a39-9cb8-26e895272796" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:03:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-577f1cf1-94d7-427e-a845-37061e732f4c tempest-ProjectReaderTests-1805919051 None] Deleting offline snapshot 4afde696-fab4-4a39-9cb8-26e895272796 of volume 60950602-624b-4407-b295-705733a04fc4 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 10 13:03:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-577f1cf1-94d7-427e-a845-37061e732f4c tempest-ProjectReaderTests-1805919051 None] snapshot_file for this snap is: volume-60950602-624b-4407-b295-705733a04fc4.4afde696-fab4-4a39-9cb8-26e895272796 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 10 13:03:12 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2319f4a-fdda-4b44-8f05-ad2c88070aed]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:03:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-577f1cf1-94d7-427e-a845-37061e732f4c tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-60950602-624b-4407-b295-705733a04fc4.4afde696-fab4-4a39-9cb8-26e895272796 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:12 devstack sudo[107444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-60950602-624b-4407-b295-705733a04fc4.4afde696-fab4-4a39-9cb8-26e895272796
Jul 10 13:03:12 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:12 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6cc9e327-8a77-411a-87dd-ff6fd099e4da tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74" returned: 0 in 0.648s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-6cc9e327-8a77-411a-87dd-ff6fd099e4da tempest-ProjectMemberTests-1574481172 None] <== create_volume: return (1491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 13:03:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-6cc9e327-8a77-411a-87dd-ff6fd099e4da tempest-ProjectMemberTests-1574481172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:03:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6cc9e327-8a77-411a-87dd-ff6fd099e4da tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c263320-3bfb-43b2-84a0-16cdcbc832eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:03:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6cc9e327-8a77-411a-87dd-ff6fd099e4da tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c200ab8-6738-4b5d-9700-0588356c88f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:03:12 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-6cc9e327-8a77-411a-87dd-ff6fd099e4da tempest-ProjectMemberTests-1574481172 None] Volume volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74 (4db9680e-26b4-4abf-b2ec-767d26cf6e74): created successfully
Jul 10 13:03:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6cc9e327-8a77-411a-87dd-ff6fd099e4da tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c200ab8-6738-4b5d-9700-0588356c88f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:03:12 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-6cc9e327-8a77-411a-87dd-ff6fd099e4da tempest-ProjectMemberTests-1574481172 None] Flow 'volume_create_manager' (22b2b47b-e768-4255-b72b-fa0492327956) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:03:12 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-6cc9e327-8a77-411a-87dd-ff6fd099e4da tempest-ProjectMemberTests-1574481172 None] Created volume successfully.
Jul 10 13:03:12 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 13:03:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:03:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:03:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:03:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:03:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:03:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:13 devstack sudo[107450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:03:13 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:13 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-577f1cf1-94d7-427e-a845-37061e732f4c tempest-ProjectReaderTests-1805919051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-60950602-624b-4407-b295-705733a04fc4.4afde696-fab4-4a39-9cb8-26e895272796" returned: 0 in 0.771s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:13 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-577f1cf1-94d7-427e-a845-37061e732f4c tempest-ProjectReaderTests-1805919051 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60950602-624b-4407-b295-705733a04fc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 13:03:13 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6524d301-a628-4a78-aa9f-b51ee77f4835]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:03:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-577f1cf1-94d7-427e-a845-37061e732f4c tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-60950602-624b-4407-b295-705733a04fc4 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:13 devstack sudo[107452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-60950602-624b-4407-b295-705733a04fc4
Jul 10 13:03:13 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c44c8cd6-b2e5-4575-b2d2-8fadd709c885 tempest-ProjectMemberTests-1574481172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:03:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c44c8cd6-b2e5-4575-b2d2-8fadd709c885 tempest-ProjectMemberTests-1574481172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:03:13 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-c44c8cd6-b2e5-4575-b2d2-8fadd709c885 tempest-ProjectMemberTests-1574481172 None] Creating offline snapshot 7eab2352-22eb-48cb-a9db-643ecb0e585e of volume 4db9680e-26b4-4abf-b2ec-767d26cf6e74 {{(pid=87378) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 10 13:03:13 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a3ba8c-25a8-4f51-bd92-c352ef1c3c2d]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:03:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c44c8cd6-b2e5-4575-b2d2-8fadd709c885 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:13 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.642s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:13 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:03:13 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager._thread_info {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 13:03:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread count: 28 {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 10 13:03:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread info: [<_MainThread(MainThread, started 128233544536192)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128233445424704)>, <Thread(Thread-3 (stat_writer), started daemon 128233435118528)>, <Thread(Rabbit-heartbeat, started daemon 128233435718016)>, <Thread(Thread-5 (_runner), started daemon 128233432624448)>, <Thread(Thread-7 (_runner), started daemon 128233432674688)>, <Thread(fd_logger, started daemon 128233428569472)>, <Thread(privsep_reader, started daemon 128233429417088)>, <Thread(tpool_thread_0, started daemon 128233421182656)>, <Thread(tpool_thread_1, started daemon 128233412789952)>, <Thread(tpool_thread_2, started daemon 128233404397248)>, <Thread(tpool_thread_3, started daemon 128233396004544)>, <Thread(tpool_thread_4, started daemon 128233387611840)>, <Thread(tpool_thread_5, started daemon 128233379219136)>, <Thread(tpool_thread_6, started daemon 128233370826432)>, <Thread(tpool_thread_7, started daemon 128233362433728)>, <Thread(tpool_thread_8, started daemon 128233354041024)>, <Thread(tpool_thread_9, started daemon 128233345631936)>, <Thread(tpool_thread_10, started daemon 128233337222848)>, <Thread(tpool_thread_11, started daemon 128233328813760)>, <Thread(tpool_thread_12, started daemon 128233320404672)>, <Thread(tpool_thread_13, started daemon 128233311995584)>, <Thread(tpool_thread_14, started daemon 128233303586496)>, <Thread(tpool_thread_15, started daemon 128233295177408)>, <Thread(tpool_thread_16, started daemon 128233286768320)>, <Thread(tpool_thread_17, started daemon 128233278359232)>, <Thread(tpool_thread_18, started daemon 128233269950144)>, <Thread(tpool_thread_19, started daemon 128233261541056)>] {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 10 13:03:13 devstack sudo[107455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74
Jul 10 13:03:13 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:13 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-577f1cf1-94d7-427e-a845-37061e732f4c tempest-ProjectReaderTests-1805919051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-60950602-624b-4407-b295-705733a04fc4" returned: 0 in 0.805s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-577f1cf1-94d7-427e-a845-37061e732f4c tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-60950602-624b-4407-b295-705733a04fc4.4afde696-fab4-4a39-9cb8-26e895272796 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:13 devstack sudo[107460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-60950602-624b-4407-b295-705733a04fc4.4afde696-fab4-4a39-9cb8-26e895272796
Jul 10 13:03:13 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:14 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c44c8cd6-b2e5-4575-b2d2-8fadd709c885 tempest-ProjectMemberTests-1574481172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74" returned: 0 in 0.757s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c44c8cd6-b2e5-4575-b2d2-8fadd709c885 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74.7eab2352-22eb-48cb-a9db-643ecb0e585e 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:14 devstack sudo[107465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74.7eab2352-22eb-48cb-a9db-643ecb0e585e 1G
Jul 10 13:03:14 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:14 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-577f1cf1-94d7-427e-a845-37061e732f4c tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-60950602-624b-4407-b295-705733a04fc4.4afde696-fab4-4a39-9cb8-26e895272796" returned: 0 in 0.731s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-577f1cf1-94d7-427e-a845-37061e732f4c tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-60950602-624b-4407-b295-705733a04fc4.4afde696-fab4-4a39-9cb8-26e895272796 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:14 devstack sudo[107470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-60950602-624b-4407-b295-705733a04fc4.4afde696-fab4-4a39-9cb8-26e895272796
Jul 10 13:03:14 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:15 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c44c8cd6-b2e5-4575-b2d2-8fadd709c885 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74.7eab2352-22eb-48cb-a9db-643ecb0e585e 1G" returned: 0 in 0.797s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c44c8cd6-b2e5-4575-b2d2-8fadd709c885 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74.7eab2352-22eb-48cb-a9db-643ecb0e585e {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:15 devstack sudo[107475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74.7eab2352-22eb-48cb-a9db-643ecb0e585e
Jul 10 13:03:15 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:15 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-577f1cf1-94d7-427e-a845-37061e732f4c tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-60950602-624b-4407-b295-705733a04fc4.4afde696-fab4-4a39-9cb8-26e895272796" returned: 0 in 0.642s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:15 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-577f1cf1-94d7-427e-a845-37061e732f4c tempest-ProjectReaderTests-1805919051 None] Lock "cinder-quobyte-4afde696-fab4-4a39-9cb8-26e895272796" released by "_delete_snapshot" :: held 3.047s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:03:15 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-577f1cf1-94d7-427e-a845-37061e732f4c tempest-ProjectReaderTests-1805919051 None] Lock "cinder-quobyte-60950602-624b-4407-b295-705733a04fc4" released by "delete_snapshot" :: held 3.072s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:03:15 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-577f1cf1-94d7-427e-a845-37061e732f4c tempest-ProjectReaderTests-1805919051 None] Created reservations ['e74a2d46-6b93-41b7-a445-d2d80d5c874b', 'e5c83289-cb0e-447f-a2de-0bf5bb34cbaa', 'fdf31f21-915d-48bd-a934-fb95b720f016', '1feda736-b132-467b-8353-4d71588db744'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:03:15 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-577f1cf1-94d7-427e-a845-37061e732f4c tempest-ProjectReaderTests-1805919051 None] Delete snapshot completed successfully.
Jul 10 13:03:15 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-577f1cf1-94d7-427e-a845-37061e732f4c tempest-ProjectReaderTests-1805919051 None] Lock "cinder-4afde696-fab4-4a39-9cb8-26e895272796-delete_snapshot" released by "delete_snapshot" :: held 3.213s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:03:15 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c44c8cd6-b2e5-4575-b2d2-8fadd709c885 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74.7eab2352-22eb-48cb-a9db-643ecb0e585e" returned: 0 in 0.727s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:15 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-c44c8cd6-b2e5-4575-b2d2-8fadd709c885 tempest-ProjectMemberTests-1574481172 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74.7eab2352-22eb-48cb-a9db-643ecb0e585e is being set with open permissions: ugo+rw
Jul 10 13:03:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c44c8cd6-b2e5-4575-b2d2-8fadd709c885 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74.7eab2352-22eb-48cb-a9db-643ecb0e585e {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:15 devstack sudo[107481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74.7eab2352-22eb-48cb-a9db-643ecb0e585e
Jul 10 13:03:15 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:16 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:16 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-875d664c-33bb-412d-aed1-4d7ebafaed31 tempest-ProjectReaderTests-1805919051 None] Acquiring lock "cinder-60950602-624b-4407-b295-705733a04fc4-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:03:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c44c8cd6-b2e5-4575-b2d2-8fadd709c885 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74.7eab2352-22eb-48cb-a9db-643ecb0e585e" returned: 0 in 0.633s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:16 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-875d664c-33bb-412d-aed1-4d7ebafaed31 tempest-ProjectReaderTests-1805919051 None] Lock "cinder-60950602-624b-4407-b295-705733a04fc4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:03:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c44c8cd6-b2e5-4575-b2d2-8fadd709c885 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:16 devstack sudo[107484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74.info
Jul 10 13:03:16 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:16 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-875d664c-33bb-412d-aed1-4d7ebafaed31 tempest-ProjectReaderTests-1805919051 None] Acquiring lock "cinder-quobyte-60950602-624b-4407-b295-705733a04fc4" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:03:16 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-875d664c-33bb-412d-aed1-4d7ebafaed31 tempest-ProjectReaderTests-1805919051 None] Lock "cinder-quobyte-60950602-624b-4407-b295-705733a04fc4" acquired by "delete_volume" :: waited 0.017s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:03:16 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d156514f-3077-4ad1-b120-bf3c317bf0dc]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:03:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-875d664c-33bb-412d-aed1-4d7ebafaed31 tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-60950602-624b-4407-b295-705733a04fc4 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:16 devstack sudo[107486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-60950602-624b-4407-b295-705733a04fc4
Jul 10 13:03:16 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:17 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c44c8cd6-b2e5-4575-b2d2-8fadd709c885 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74.info" returned: 0 in 0.647s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:17 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-c44c8cd6-b2e5-4575-b2d2-8fadd709c885 tempest-ProjectMemberTests-1574481172 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74.info is being set with open permissions: ugo+rw
Jul 10 13:03:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c44c8cd6-b2e5-4575-b2d2-8fadd709c885 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:17 devstack sudo[107489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74.info
Jul 10 13:03:17 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:17 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-875d664c-33bb-412d-aed1-4d7ebafaed31 tempest-ProjectReaderTests-1805919051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-60950602-624b-4407-b295-705733a04fc4" returned: 0 in 0.778s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-875d664c-33bb-412d-aed1-4d7ebafaed31 tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-60950602-624b-4407-b295-705733a04fc4 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:17 devstack sudo[107494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-60950602-624b-4407-b295-705733a04fc4
Jul 10 13:03:17 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:17 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c44c8cd6-b2e5-4575-b2d2-8fadd709c885 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74.info" returned: 0 in 0.635s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c44c8cd6-b2e5-4575-b2d2-8fadd709c885 tempest-ProjectMemberTests-1574481172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.298s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:03:17 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-c44c8cd6-b2e5-4575-b2d2-8fadd709c885 tempest-ProjectMemberTests-1574481172 None] Create snapshot completed successfully
Jul 10 13:03:18 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-875d664c-33bb-412d-aed1-4d7ebafaed31 tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-60950602-624b-4407-b295-705733a04fc4" returned: 0 in 0.678s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:18 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-875d664c-33bb-412d-aed1-4d7ebafaed31 tempest-ProjectReaderTests-1805919051 None] Lock "cinder-quobyte-60950602-624b-4407-b295-705733a04fc4" released by "delete_volume" :: held 1.508s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:03:18 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-875d664c-33bb-412d-aed1-4d7ebafaed31 tempest-ProjectReaderTests-1805919051 None] Created reservations ['c37006b2-ee68-4c4c-b549-c7eafb852ff2', '6e493628-b28e-4c2c-9716-f17f5fec7d34', '3a490f3f-698c-4b01-be0a-484e708f3567', 'a50ef510-a768-41a5-a4ab-f55b9a1e11c2'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:03:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-875d664c-33bb-412d-aed1-4d7ebafaed31 tempest-ProjectReaderTests-1805919051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:03:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-875d664c-33bb-412d-aed1-4d7ebafaed31 tempest-ProjectReaderTests-1805919051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:03:18 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-875d664c-33bb-412d-aed1-4d7ebafaed31 tempest-ProjectReaderTests-1805919051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:03:18 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-875d664c-33bb-412d-aed1-4d7ebafaed31 tempest-ProjectReaderTests-1805919051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:03:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-875d664c-33bb-412d-aed1-4d7ebafaed31 tempest-ProjectReaderTests-1805919051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:03:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-875d664c-33bb-412d-aed1-4d7ebafaed31 tempest-ProjectReaderTests-1805919051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:18 devstack sudo[107498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:03:18 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:18 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-31188c03-ea81-480c-9d7f-02ba13497ae3 tempest-ProjectMemberTests-1574481172 None] Acquiring lock "cinder-7eab2352-22eb-48cb-a9db-643ecb0e585e-delete_snapshot" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:03:18 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-31188c03-ea81-480c-9d7f-02ba13497ae3 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-7eab2352-22eb-48cb-a9db-643ecb0e585e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:03:18 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-31188c03-ea81-480c-9d7f-02ba13497ae3 tempest-ProjectMemberTests-1574481172 None] Acquiring lock "cinder-quobyte-4db9680e-26b4-4abf-b2ec-767d26cf6e74" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:03:18 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-31188c03-ea81-480c-9d7f-02ba13497ae3 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-4db9680e-26b4-4abf-b2ec-767d26cf6e74" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:03:18 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-31188c03-ea81-480c-9d7f-02ba13497ae3 tempest-ProjectMemberTests-1574481172 None] Acquiring lock "cinder-quobyte-7eab2352-22eb-48cb-a9db-643ecb0e585e" by "_delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:03:18 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-31188c03-ea81-480c-9d7f-02ba13497ae3 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-7eab2352-22eb-48cb-a9db-643ecb0e585e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:03:18 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-31188c03-ea81-480c-9d7f-02ba13497ae3 tempest-ProjectMemberTests-1574481172 None] Deleting offline snapshot 7eab2352-22eb-48cb-a9db-643ecb0e585e of volume 4db9680e-26b4-4abf-b2ec-767d26cf6e74 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 10 13:03:18 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-31188c03-ea81-480c-9d7f-02ba13497ae3 tempest-ProjectMemberTests-1574481172 None] snapshot_file for this snap is: volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74.7eab2352-22eb-48cb-a9db-643ecb0e585e {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 10 13:03:18 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a5e175-69df-4dda-b9af-69e9b4b32b9a]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:03:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-31188c03-ea81-480c-9d7f-02ba13497ae3 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74.7eab2352-22eb-48cb-a9db-643ecb0e585e {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:18 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-875d664c-33bb-412d-aed1-4d7ebafaed31 tempest-ProjectReaderTests-1805919051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.653s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:18 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-875d664c-33bb-412d-aed1-4d7ebafaed31 tempest-ProjectReaderTests-1805919051 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:03:18 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-875d664c-33bb-412d-aed1-4d7ebafaed31 tempest-ProjectReaderTests-1805919051 None] Deleted volume successfully.
Jul 10 13:03:18 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-875d664c-33bb-412d-aed1-4d7ebafaed31 tempest-ProjectReaderTests-1805919051 None] Lock "cinder-60950602-624b-4407-b295-705733a04fc4-delete_volume" released by "delete_volume" :: held 2.425s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:03:18 devstack sudo[107501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74.7eab2352-22eb-48cb-a9db-643ecb0e585e
Jul 10 13:03:18 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:19 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-31188c03-ea81-480c-9d7f-02ba13497ae3 tempest-ProjectMemberTests-1574481172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74.7eab2352-22eb-48cb-a9db-643ecb0e585e" returned: 0 in 0.819s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:19 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-31188c03-ea81-480c-9d7f-02ba13497ae3 tempest-ProjectMemberTests-1574481172 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 13:03:19 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[066730a7-f460-4115-8805-2d21794dcedc]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:03:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-31188c03-ea81-480c-9d7f-02ba13497ae3 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:19 devstack sudo[107507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74
Jul 10 13:03:19 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:20 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-31188c03-ea81-480c-9d7f-02ba13497ae3 tempest-ProjectMemberTests-1574481172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74" returned: 0 in 0.815s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-31188c03-ea81-480c-9d7f-02ba13497ae3 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74.7eab2352-22eb-48cb-a9db-643ecb0e585e {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:20 devstack sudo[107512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74.7eab2352-22eb-48cb-a9db-643ecb0e585e
Jul 10 13:03:20 devstack sudo[107512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:21 devstack sudo[107512]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-31188c03-ea81-480c-9d7f-02ba13497ae3 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74.7eab2352-22eb-48cb-a9db-643ecb0e585e" returned: 0 in 0.762s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-31188c03-ea81-480c-9d7f-02ba13497ae3 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74.7eab2352-22eb-48cb-a9db-643ecb0e585e {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:21 devstack sudo[107517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74.7eab2352-22eb-48cb-a9db-643ecb0e585e
Jul 10 13:03:21 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:21 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-31188c03-ea81-480c-9d7f-02ba13497ae3 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74.7eab2352-22eb-48cb-a9db-643ecb0e585e" returned: 0 in 0.695s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:22 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-31188c03-ea81-480c-9d7f-02ba13497ae3 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-7eab2352-22eb-48cb-a9db-643ecb0e585e" released by "_delete_snapshot" :: held 3.221s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:03:22 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-31188c03-ea81-480c-9d7f-02ba13497ae3 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-4db9680e-26b4-4abf-b2ec-767d26cf6e74" released by "delete_snapshot" :: held 3.244s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:03:22 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-31188c03-ea81-480c-9d7f-02ba13497ae3 tempest-ProjectMemberTests-1574481172 None] Created reservations ['59bd01f3-5817-49ac-800a-2b37490ba417', '8a014be9-a486-4e20-9198-d2fcd9e17fb3', '9a10a7f8-d31d-4155-8a1d-dadc512cbd4f', '1495b8f8-121f-46a6-8add-ae8f9578a664'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:03:22 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-31188c03-ea81-480c-9d7f-02ba13497ae3 tempest-ProjectMemberTests-1574481172 None] Delete snapshot completed successfully.
Jul 10 13:03:22 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-31188c03-ea81-480c-9d7f-02ba13497ae3 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-7eab2352-22eb-48cb-a9db-643ecb0e585e-delete_snapshot" released by "delete_snapshot" :: held 3.411s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:03:23 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-c0033b33-1c0f-4f1b-831a-1699150c536c tempest-ProjectMemberTests-1574481172 None] Acquiring lock "cinder-4db9680e-26b4-4abf-b2ec-767d26cf6e74-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:03:23 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-c0033b33-1c0f-4f1b-831a-1699150c536c tempest-ProjectMemberTests-1574481172 None] Lock "cinder-4db9680e-26b4-4abf-b2ec-767d26cf6e74-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:03:23 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-c0033b33-1c0f-4f1b-831a-1699150c536c tempest-ProjectMemberTests-1574481172 None] Acquiring lock "cinder-quobyte-4db9680e-26b4-4abf-b2ec-767d26cf6e74" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:03:23 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-c0033b33-1c0f-4f1b-831a-1699150c536c tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-4db9680e-26b4-4abf-b2ec-767d26cf6e74" acquired by "delete_volume" :: waited 0.018s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:03:23 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ee25be-355e-4dfd-963e-e22f1d09ca29]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:03:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c0033b33-1c0f-4f1b-831a-1699150c536c tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:23 devstack sudo[107520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74
Jul 10 13:03:23 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:23 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c0033b33-1c0f-4f1b-831a-1699150c536c tempest-ProjectMemberTests-1574481172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74" returned: 0 in 0.780s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c0033b33-1c0f-4f1b-831a-1699150c536c tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:23 devstack sudo[107525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74
Jul 10 13:03:23 devstack sudo[107525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:24 devstack sudo[107525]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c0033b33-1c0f-4f1b-831a-1699150c536c tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-4db9680e-26b4-4abf-b2ec-767d26cf6e74" returned: 0 in 0.675s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:24 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-c0033b33-1c0f-4f1b-831a-1699150c536c tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-4db9680e-26b4-4abf-b2ec-767d26cf6e74" released by "delete_volume" :: held 1.518s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:03:24 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-c0033b33-1c0f-4f1b-831a-1699150c536c tempest-ProjectMemberTests-1574481172 None] Created reservations ['93df609c-7299-461b-ab12-8e1c3420302d', '19ff7229-8b27-4e8c-b9f4-922916e6891d', '005c1253-2ce2-4bfe-bd8a-50de229ff8b4', '7c133a12-8e85-4474-81bd-aa200c0e631f'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:03:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c0033b33-1c0f-4f1b-831a-1699150c536c tempest-ProjectMemberTests-1574481172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:03:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c0033b33-1c0f-4f1b-831a-1699150c536c tempest-ProjectMemberTests-1574481172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:03:24 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-c0033b33-1c0f-4f1b-831a-1699150c536c tempest-ProjectMemberTests-1574481172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:03:24 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-c0033b33-1c0f-4f1b-831a-1699150c536c tempest-ProjectMemberTests-1574481172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:03:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c0033b33-1c0f-4f1b-831a-1699150c536c tempest-ProjectMemberTests-1574481172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:03:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c0033b33-1c0f-4f1b-831a-1699150c536c tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:24 devstack sudo[107528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:03:24 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:25 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c0033b33-1c0f-4f1b-831a-1699150c536c tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.663s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:25 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-c0033b33-1c0f-4f1b-831a-1699150c536c tempest-ProjectMemberTests-1574481172 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:03:25 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-c0033b33-1c0f-4f1b-831a-1699150c536c tempest-ProjectMemberTests-1574481172 None] Deleted volume successfully.
Jul 10 13:03:25 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-c0033b33-1c0f-4f1b-831a-1699150c536c tempest-ProjectMemberTests-1574481172 None] Lock "cinder-4db9680e-26b4-4abf-b2ec-767d26cf6e74-delete_volume" released by "delete_volume" :: held 2.404s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:03:25 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-78983fb8-982f-4675-9c44-525a02c8e576 tempest-ProjectMemberTests-1574481172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 13:03:25 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-78983fb8-982f-4675-9c44-525a02c8e576 tempest-ProjectMemberTests-1574481172 None] Flow 'volume_create_manager' (78d36858-62e8-4b54-a911-0d539251d8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:03:25 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-78983fb8-982f-4675-9c44-525a02c8e576 tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a230eebd-3f90-469e-9f59-d1bb78daec2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:03:25 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-78983fb8-982f-4675-9c44-525a02c8e576 tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a230eebd-3f90-469e-9f59-d1bb78daec2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:03:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-932305884',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ab5735dd8284364bf17f2c244fabbf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:03:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:03:26Z,use_quota=True,user_id='7ead579763934814b4b50051ee0ea3a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:03:25 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-78983fb8-982f-4675-9c44-525a02c8e576 tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (074c2403-0bf0-435f-9691-f0f430527692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:03:25 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-78983fb8-982f-4675-9c44-525a02c8e576 tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (074c2403-0bf0-435f-9691-f0f430527692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:03:25 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-78983fb8-982f-4675-9c44-525a02c8e576 tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c7ce9ac-26b5-4aa7-b819-b1fb505fe8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:03:25 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-78983fb8-982f-4675-9c44-525a02c8e576 tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c7ce9ac-26b5-4aa7-b819-b1fb505fe8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f', 'volume_name': 'volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:03:25 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-78983fb8-982f-4675-9c44-525a02c8e576 tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cee42f6a-5320-4930-ac52-3900776ac56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:03:25 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-78983fb8-982f-4675-9c44-525a02c8e576 tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cee42f6a-5320-4930-ac52-3900776ac56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:03:25 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-78983fb8-982f-4675-9c44-525a02c8e576 tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99bba13f-4c9c-418e-94fa-f043ebfe9c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:03:25 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-78983fb8-982f-4675-9c44-525a02c8e576 tempest-ProjectMemberTests-1574481172 None] Volume ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f', 'volume_size': 1}
Jul 10 13:03:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-78983fb8-982f-4675-9c44-525a02c8e576 tempest-ProjectMemberTests-1574481172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:03:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-78983fb8-982f-4675-9c44-525a02c8e576 tempest-ProjectMemberTests-1574481172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:03:25 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-78983fb8-982f-4675-9c44-525a02c8e576 tempest-ProjectMemberTests-1574481172 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:03:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-932305884',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ab5735dd8284364bf17f2c244fabbf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:03:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:03:26Z,use_quota=True,user_id='7ead579763934814b4b50051ee0ea3a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 13:03:25 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-78983fb8-982f-4675-9c44-525a02c8e576 tempest-ProjectMemberTests-1574481172 None] Creating volume ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 13:03:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-78983fb8-982f-4675-9c44-525a02c8e576 tempest-ProjectMemberTests-1574481172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:03:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-78983fb8-982f-4675-9c44-525a02c8e576 tempest-ProjectMemberTests-1574481172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:03:25 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-78983fb8-982f-4675-9c44-525a02c8e576 tempest-ProjectMemberTests-1574481172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:03:25 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-78983fb8-982f-4675-9c44-525a02c8e576 tempest-ProjectMemberTests-1574481172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:03:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-78983fb8-982f-4675-9c44-525a02c8e576 tempest-ProjectMemberTests-1574481172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:03:25 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-78983fb8-982f-4675-9c44-525a02c8e576 tempest-ProjectMemberTests-1574481172 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 13:03:25 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-78983fb8-982f-4675-9c44-525a02c8e576 tempest-ProjectMemberTests-1574481172 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 13:03:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-78983fb8-982f-4675-9c44-525a02c8e576 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:25 devstack sudo[107531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f 1073741824
Jul 10 13:03:25 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:26 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-78983fb8-982f-4675-9c44-525a02c8e576 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f 1073741824" returned: 0 in 0.877s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-78983fb8-982f-4675-9c44-525a02c8e576 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:26 devstack sudo[107537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f
Jul 10 13:03:26 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:27 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-78983fb8-982f-4675-9c44-525a02c8e576 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f" returned: 0 in 0.648s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:27 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-78983fb8-982f-4675-9c44-525a02c8e576 tempest-ProjectMemberTests-1574481172 None] <== create_volume: return (1568ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 13:03:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-78983fb8-982f-4675-9c44-525a02c8e576 tempest-ProjectMemberTests-1574481172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.570s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:03:27 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-78983fb8-982f-4675-9c44-525a02c8e576 tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99bba13f-4c9c-418e-94fa-f043ebfe9c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:03:27 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-78983fb8-982f-4675-9c44-525a02c8e576 tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (002a7d31-dd1e-48fd-9960-9a903346a34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:03:27 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-78983fb8-982f-4675-9c44-525a02c8e576 tempest-ProjectMemberTests-1574481172 None] Volume volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f (ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f): created successfully
Jul 10 13:03:27 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-78983fb8-982f-4675-9c44-525a02c8e576 tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (002a7d31-dd1e-48fd-9960-9a903346a34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:03:27 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-78983fb8-982f-4675-9c44-525a02c8e576 tempest-ProjectMemberTests-1574481172 None] Flow 'volume_create_manager' (78d36858-62e8-4b54-a911-0d539251d8fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:03:27 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-78983fb8-982f-4675-9c44-525a02c8e576 tempest-ProjectMemberTests-1574481172 None] Created volume successfully.
Jul 10 13:03:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-8ea07b6f-c720-499a-b389-3746bb9bc369 tempest-ProjectMemberTests-1574481172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:03:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-8ea07b6f-c720-499a-b389-3746bb9bc369 tempest-ProjectMemberTests-1574481172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:03:28 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-8ea07b6f-c720-499a-b389-3746bb9bc369 tempest-ProjectMemberTests-1574481172 None] Creating offline snapshot b84e4000-f0b1-4cb7-a333-1babd8ddf969 of volume ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f {{(pid=87378) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 10 13:03:28 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a7fa50-36c0-4933-85bd-d4cde22185d3]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:03:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8ea07b6f-c720-499a-b389-3746bb9bc369 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:28 devstack sudo[107540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f
Jul 10 13:03:28 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:28 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8ea07b6f-c720-499a-b389-3746bb9bc369 tempest-ProjectMemberTests-1574481172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f" returned: 0 in 0.851s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8ea07b6f-c720-499a-b389-3746bb9bc369 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f.b84e4000-f0b1-4cb7-a333-1babd8ddf969 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:28 devstack sudo[107546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f.b84e4000-f0b1-4cb7-a333-1babd8ddf969 1G
Jul 10 13:03:28 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:29 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8ea07b6f-c720-499a-b389-3746bb9bc369 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f.b84e4000-f0b1-4cb7-a333-1babd8ddf969 1G" returned: 0 in 0.886s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8ea07b6f-c720-499a-b389-3746bb9bc369 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f.b84e4000-f0b1-4cb7-a333-1babd8ddf969 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:29 devstack sudo[107587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f.b84e4000-f0b1-4cb7-a333-1babd8ddf969
Jul 10 13:03:29 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:30 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:30 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8ea07b6f-c720-499a-b389-3746bb9bc369 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f.b84e4000-f0b1-4cb7-a333-1babd8ddf969" returned: 0 in 0.746s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:30 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-8ea07b6f-c720-499a-b389-3746bb9bc369 tempest-ProjectMemberTests-1574481172 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f.b84e4000-f0b1-4cb7-a333-1babd8ddf969 is being set with open permissions: ugo+rw
Jul 10 13:03:30 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8ea07b6f-c720-499a-b389-3746bb9bc369 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f.b84e4000-f0b1-4cb7-a333-1babd8ddf969 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:30 devstack sudo[107594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f.b84e4000-f0b1-4cb7-a333-1babd8ddf969
Jul 10 13:03:30 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:31 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8ea07b6f-c720-499a-b389-3746bb9bc369 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f.b84e4000-f0b1-4cb7-a333-1babd8ddf969" returned: 0 in 0.668s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8ea07b6f-c720-499a-b389-3746bb9bc369 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:31 devstack sudo[107597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f.info
Jul 10 13:03:31 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:31 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8ea07b6f-c720-499a-b389-3746bb9bc369 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f.info" returned: 0 in 0.700s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:31 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-8ea07b6f-c720-499a-b389-3746bb9bc369 tempest-ProjectMemberTests-1574481172 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f.info is being set with open permissions: ugo+rw
Jul 10 13:03:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8ea07b6f-c720-499a-b389-3746bb9bc369 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:31 devstack sudo[107600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f.info
Jul 10 13:03:31 devstack sudo[107600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:32 devstack sudo[107600]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-8ea07b6f-c720-499a-b389-3746bb9bc369 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f.info" returned: 0 in 0.689s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-8ea07b6f-c720-499a-b389-3746bb9bc369 tempest-ProjectMemberTests-1574481172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.630s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:03:32 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:UPDATE=126,cinder:SELECT=94,cinder:DELETE=11,cinder:INSERT=32 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 13:03:32 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-8ea07b6f-c720-499a-b389-3746bb9bc369 tempest-ProjectMemberTests-1574481172 None] Create snapshot completed successfully
Jul 10 13:03:33 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-804aaa36-3368-4551-a8ca-fdc146856103 tempest-ProjectMemberTests-1574481172 None] Acquiring lock "cinder-b84e4000-f0b1-4cb7-a333-1babd8ddf969-delete_snapshot" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:03:33 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-804aaa36-3368-4551-a8ca-fdc146856103 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-b84e4000-f0b1-4cb7-a333-1babd8ddf969-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:03:33 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-804aaa36-3368-4551-a8ca-fdc146856103 tempest-ProjectMemberTests-1574481172 None] Acquiring lock "cinder-quobyte-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:03:33 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-804aaa36-3368-4551-a8ca-fdc146856103 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:03:33 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-804aaa36-3368-4551-a8ca-fdc146856103 tempest-ProjectMemberTests-1574481172 None] Acquiring lock "cinder-quobyte-b84e4000-f0b1-4cb7-a333-1babd8ddf969" by "_delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:03:33 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-804aaa36-3368-4551-a8ca-fdc146856103 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-b84e4000-f0b1-4cb7-a333-1babd8ddf969" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:03:33 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-804aaa36-3368-4551-a8ca-fdc146856103 tempest-ProjectMemberTests-1574481172 None] Deleting offline snapshot b84e4000-f0b1-4cb7-a333-1babd8ddf969 of volume ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 10 13:03:33 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-804aaa36-3368-4551-a8ca-fdc146856103 tempest-ProjectMemberTests-1574481172 None] snapshot_file for this snap is: volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f.b84e4000-f0b1-4cb7-a333-1babd8ddf969 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 10 13:03:33 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff90ff4-62d2-4927-9699-28c4b69c83c1]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:03:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-804aaa36-3368-4551-a8ca-fdc146856103 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f.b84e4000-f0b1-4cb7-a333-1babd8ddf969 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:33 devstack sudo[107603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f.b84e4000-f0b1-4cb7-a333-1babd8ddf969
Jul 10 13:03:33 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:34 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-804aaa36-3368-4551-a8ca-fdc146856103 tempest-ProjectMemberTests-1574481172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f.b84e4000-f0b1-4cb7-a333-1babd8ddf969" returned: 0 in 0.765s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:34 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-804aaa36-3368-4551-a8ca-fdc146856103 tempest-ProjectMemberTests-1574481172 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 13:03:34 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d82de88-0062-4bbf-a5be-8cd71288d5bd]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:03:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-804aaa36-3368-4551-a8ca-fdc146856103 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:34 devstack sudo[107608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f
Jul 10 13:03:34 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:34 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-804aaa36-3368-4551-a8ca-fdc146856103 tempest-ProjectMemberTests-1574481172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f" returned: 0 in 0.762s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-804aaa36-3368-4551-a8ca-fdc146856103 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f.b84e4000-f0b1-4cb7-a333-1babd8ddf969 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:34 devstack sudo[107613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f.b84e4000-f0b1-4cb7-a333-1babd8ddf969
Jul 10 13:03:34 devstack sudo[107613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:35 devstack sudo[107613]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-804aaa36-3368-4551-a8ca-fdc146856103 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f.b84e4000-f0b1-4cb7-a333-1babd8ddf969" returned: 0 in 0.712s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-804aaa36-3368-4551-a8ca-fdc146856103 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f.b84e4000-f0b1-4cb7-a333-1babd8ddf969 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:35 devstack sudo[107619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f.b84e4000-f0b1-4cb7-a333-1babd8ddf969
Jul 10 13:03:35 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:36 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-804aaa36-3368-4551-a8ca-fdc146856103 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f.b84e4000-f0b1-4cb7-a333-1babd8ddf969" returned: 0 in 0.648s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:36 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-804aaa36-3368-4551-a8ca-fdc146856103 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-b84e4000-f0b1-4cb7-a333-1babd8ddf969" released by "_delete_snapshot" :: held 2.980s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:03:36 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-804aaa36-3368-4551-a8ca-fdc146856103 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f" released by "delete_snapshot" :: held 3.004s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:03:36 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:SELECT=105,cinder:UPDATE=128,cinder:INSERT=37,cinder:DELETE=11 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 13:03:36 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-804aaa36-3368-4551-a8ca-fdc146856103 tempest-ProjectMemberTests-1574481172 None] Created reservations ['1898c275-8ff0-4285-bb79-3ec906ed30b2', '92ca99d6-bfcf-4024-a9ef-89622b5918b5', 'f6b9c3e0-0946-40ca-b270-b3a2dd1e3613', 'af93f287-59ef-4af9-bf5c-475cd67f2de9'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:03:36 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-804aaa36-3368-4551-a8ca-fdc146856103 tempest-ProjectMemberTests-1574481172 None] Delete snapshot completed successfully.
Jul 10 13:03:36 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-804aaa36-3368-4551-a8ca-fdc146856103 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-b84e4000-f0b1-4cb7-a333-1babd8ddf969-delete_snapshot" released by "delete_snapshot" :: held 3.151s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:03:37 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f0610fd2-2b45-4749-9cbf-ddaed2caf5f4 tempest-ProjectMemberTests-1574481172 None] Acquiring lock "cinder-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:03:37 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f0610fd2-2b45-4749-9cbf-ddaed2caf5f4 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:03:37 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f0610fd2-2b45-4749-9cbf-ddaed2caf5f4 tempest-ProjectMemberTests-1574481172 None] Acquiring lock "cinder-quobyte-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:03:37 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f0610fd2-2b45-4749-9cbf-ddaed2caf5f4 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f" acquired by "delete_volume" :: waited 0.015s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:03:37 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c9c56e-56c2-4340-9683-9f4c75db8d4d]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:03:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f0610fd2-2b45-4749-9cbf-ddaed2caf5f4 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:37 devstack sudo[107628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f
Jul 10 13:03:37 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:38 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f0610fd2-2b45-4749-9cbf-ddaed2caf5f4 tempest-ProjectMemberTests-1574481172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f" returned: 0 in 0.743s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f0610fd2-2b45-4749-9cbf-ddaed2caf5f4 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:38 devstack sudo[107633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f
Jul 10 13:03:38 devstack sudo[107633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:38 devstack sudo[107633]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f0610fd2-2b45-4749-9cbf-ddaed2caf5f4 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f" returned: 0 in 0.637s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:38 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f0610fd2-2b45-4749-9cbf-ddaed2caf5f4 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f" released by "delete_volume" :: held 1.434s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:03:39 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-f0610fd2-2b45-4749-9cbf-ddaed2caf5f4 tempest-ProjectMemberTests-1574481172 None] Created reservations ['7bb6428c-8385-4ad6-bc6b-9eda2c53104f', '9267b380-e8fb-4921-b067-28568ee56fbe', 'cb769dce-6b19-474d-8cf9-7686cd4e43de', '6d0ae31c-cd65-45d9-b8a6-1faa42b6f9e8'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:03:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f0610fd2-2b45-4749-9cbf-ddaed2caf5f4 tempest-ProjectMemberTests-1574481172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:03:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f0610fd2-2b45-4749-9cbf-ddaed2caf5f4 tempest-ProjectMemberTests-1574481172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:03:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-f0610fd2-2b45-4749-9cbf-ddaed2caf5f4 tempest-ProjectMemberTests-1574481172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:03:39 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-f0610fd2-2b45-4749-9cbf-ddaed2caf5f4 tempest-ProjectMemberTests-1574481172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:03:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f0610fd2-2b45-4749-9cbf-ddaed2caf5f4 tempest-ProjectMemberTests-1574481172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:03:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f0610fd2-2b45-4749-9cbf-ddaed2caf5f4 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:39 devstack sudo[107636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:03:39 devstack sudo[107636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:39 devstack sudo[107636]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f0610fd2-2b45-4749-9cbf-ddaed2caf5f4 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.672s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:39 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-f0610fd2-2b45-4749-9cbf-ddaed2caf5f4 tempest-ProjectMemberTests-1574481172 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:03:39 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-f0610fd2-2b45-4749-9cbf-ddaed2caf5f4 tempest-ProjectMemberTests-1574481172 None] Deleted volume successfully.
Jul 10 13:03:39 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-f0610fd2-2b45-4749-9cbf-ddaed2caf5f4 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-ca66fa6e-d33e-4ba7-a23f-ffa47cd7310f-delete_volume" released by "delete_volume" :: held 2.292s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:03:40 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-f60ff734-3a0b-4dd8-b21c-3144942b61bd tempest-ProjectMemberTests-1574481172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 13:03:40 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f60ff734-3a0b-4dd8-b21c-3144942b61bd tempest-ProjectMemberTests-1574481172 None] Flow 'volume_create_manager' (8c6e1d50-007a-430a-a0a0-aeac1674ff33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:03:40 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f60ff734-3a0b-4dd8-b21c-3144942b61bd tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (222d0fea-82c1-41ea-9ec6-4607d154d5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:03:40 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f60ff734-3a0b-4dd8-b21c-3144942b61bd tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (222d0fea-82c1-41ea-9ec6-4607d154d5c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-627598866',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73511732-aaef-4d42-8750-33d86556e209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ab5735dd8284364bf17f2c244fabbf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:03:40Z,use_quota=True,user_id='7ead579763934814b4b50051ee0ea3a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:03:40 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f60ff734-3a0b-4dd8-b21c-3144942b61bd tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5850c767-40bb-4556-8c98-4b4a1c308489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:03:40 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f60ff734-3a0b-4dd8-b21c-3144942b61bd tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5850c767-40bb-4556-8c98-4b4a1c308489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:03:40 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f60ff734-3a0b-4dd8-b21c-3144942b61bd tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (014d1c7f-9735-46e1-a32a-3db5d3d02420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:03:40 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f60ff734-3a0b-4dd8-b21c-3144942b61bd tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (014d1c7f-9735-46e1-a32a-3db5d3d02420) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73511732-aaef-4d42-8750-33d86556e209', 'volume_name': 'volume-73511732-aaef-4d42-8750-33d86556e209', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:03:40 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f60ff734-3a0b-4dd8-b21c-3144942b61bd tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b1b3272-9d59-460e-b41f-123209afcd50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:03:40 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f60ff734-3a0b-4dd8-b21c-3144942b61bd tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b1b3272-9d59-460e-b41f-123209afcd50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:03:40 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f60ff734-3a0b-4dd8-b21c-3144942b61bd tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (382a6839-259e-43bb-8221-b8eda7aa2021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:03:40 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-f60ff734-3a0b-4dd8-b21c-3144942b61bd tempest-ProjectMemberTests-1574481172 None] Volume 73511732-aaef-4d42-8750-33d86556e209: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73511732-aaef-4d42-8750-33d86556e209', 'volume_size': 1}
Jul 10 13:03:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f60ff734-3a0b-4dd8-b21c-3144942b61bd tempest-ProjectMemberTests-1574481172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:03:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f60ff734-3a0b-4dd8-b21c-3144942b61bd tempest-ProjectMemberTests-1574481172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:03:40 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-f60ff734-3a0b-4dd8-b21c-3144942b61bd tempest-ProjectMemberTests-1574481172 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-627598866',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73511732-aaef-4d42-8750-33d86556e209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ab5735dd8284364bf17f2c244fabbf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:03:40Z,use_quota=True,user_id='7ead579763934814b4b50051ee0ea3a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 13:03:40 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-f60ff734-3a0b-4dd8-b21c-3144942b61bd tempest-ProjectMemberTests-1574481172 None] Creating volume 73511732-aaef-4d42-8750-33d86556e209 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 13:03:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f60ff734-3a0b-4dd8-b21c-3144942b61bd tempest-ProjectMemberTests-1574481172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:03:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f60ff734-3a0b-4dd8-b21c-3144942b61bd tempest-ProjectMemberTests-1574481172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:03:40 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-f60ff734-3a0b-4dd8-b21c-3144942b61bd tempest-ProjectMemberTests-1574481172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:03:40 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-f60ff734-3a0b-4dd8-b21c-3144942b61bd tempest-ProjectMemberTests-1574481172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:03:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f60ff734-3a0b-4dd8-b21c-3144942b61bd tempest-ProjectMemberTests-1574481172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:03:40 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-f60ff734-3a0b-4dd8-b21c-3144942b61bd tempest-ProjectMemberTests-1574481172 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 13:03:40 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-f60ff734-3a0b-4dd8-b21c-3144942b61bd tempest-ProjectMemberTests-1574481172 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 13:03:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f60ff734-3a0b-4dd8-b21c-3144942b61bd tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-73511732-aaef-4d42-8750-33d86556e209 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:40 devstack sudo[107641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-73511732-aaef-4d42-8750-33d86556e209 1073741824
Jul 10 13:03:40 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:41 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f60ff734-3a0b-4dd8-b21c-3144942b61bd tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-73511732-aaef-4d42-8750-33d86556e209 1073741824" returned: 0 in 0.813s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f60ff734-3a0b-4dd8-b21c-3144942b61bd tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-73511732-aaef-4d42-8750-33d86556e209 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:41 devstack sudo[107646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-73511732-aaef-4d42-8750-33d86556e209
Jul 10 13:03:41 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:41 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-f60ff734-3a0b-4dd8-b21c-3144942b61bd tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-73511732-aaef-4d42-8750-33d86556e209" returned: 0 in 0.637s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:41 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-f60ff734-3a0b-4dd8-b21c-3144942b61bd tempest-ProjectMemberTests-1574481172 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 13:03:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-f60ff734-3a0b-4dd8-b21c-3144942b61bd tempest-ProjectMemberTests-1574481172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:03:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f60ff734-3a0b-4dd8-b21c-3144942b61bd tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (382a6839-259e-43bb-8221-b8eda7aa2021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73511732-aaef-4d42-8750-33d86556e209', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:03:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f60ff734-3a0b-4dd8-b21c-3144942b61bd tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dab8fbb6-babc-4a13-9366-fc934032f4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:03:41 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-f60ff734-3a0b-4dd8-b21c-3144942b61bd tempest-ProjectMemberTests-1574481172 None] Volume volume-73511732-aaef-4d42-8750-33d86556e209 (73511732-aaef-4d42-8750-33d86556e209): created successfully
Jul 10 13:03:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f60ff734-3a0b-4dd8-b21c-3144942b61bd tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dab8fbb6-babc-4a13-9366-fc934032f4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:03:41 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-f60ff734-3a0b-4dd8-b21c-3144942b61bd tempest-ProjectMemberTests-1574481172 None] Flow 'volume_create_manager' (8c6e1d50-007a-430a-a0a0-aeac1674ff33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:03:41 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-f60ff734-3a0b-4dd8-b21c-3144942b61bd tempest-ProjectMemberTests-1574481172 None] Created volume successfully.
Jul 10 13:03:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5c16fe5d-a1d1-498d-9140-b87b14088a9a tempest-ProjectMemberTests-1574481172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:03:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5c16fe5d-a1d1-498d-9140-b87b14088a9a tempest-ProjectMemberTests-1574481172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:03:42 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-5c16fe5d-a1d1-498d-9140-b87b14088a9a tempest-ProjectMemberTests-1574481172 None] Creating offline snapshot d4f65dbd-44a9-4558-8fa2-11d98d348b54 of volume 73511732-aaef-4d42-8750-33d86556e209 {{(pid=87378) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 10 13:03:42 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a4b931-b192-4ec3-9b34-0d0180b29feb]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:03:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5c16fe5d-a1d1-498d-9140-b87b14088a9a tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-73511732-aaef-4d42-8750-33d86556e209 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:42 devstack sudo[107649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-73511732-aaef-4d42-8750-33d86556e209
Jul 10 13:03:42 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:43 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5c16fe5d-a1d1-498d-9140-b87b14088a9a tempest-ProjectMemberTests-1574481172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-73511732-aaef-4d42-8750-33d86556e209" returned: 0 in 0.766s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5c16fe5d-a1d1-498d-9140-b87b14088a9a tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-73511732-aaef-4d42-8750-33d86556e209,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-73511732-aaef-4d42-8750-33d86556e209.d4f65dbd-44a9-4558-8fa2-11d98d348b54 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:43 devstack sudo[107654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-73511732-aaef-4d42-8750-33d86556e209,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-73511732-aaef-4d42-8750-33d86556e209.d4f65dbd-44a9-4558-8fa2-11d98d348b54 1G
Jul 10 13:03:43 devstack sudo[107654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:43 devstack sudo[107654]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5c16fe5d-a1d1-498d-9140-b87b14088a9a tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-73511732-aaef-4d42-8750-33d86556e209,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-73511732-aaef-4d42-8750-33d86556e209.d4f65dbd-44a9-4558-8fa2-11d98d348b54 1G" returned: 0 in 0.772s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5c16fe5d-a1d1-498d-9140-b87b14088a9a tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73511732-aaef-4d42-8750-33d86556e209 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-73511732-aaef-4d42-8750-33d86556e209.d4f65dbd-44a9-4558-8fa2-11d98d348b54 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:43 devstack sudo[107660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73511732-aaef-4d42-8750-33d86556e209 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-73511732-aaef-4d42-8750-33d86556e209.d4f65dbd-44a9-4558-8fa2-11d98d348b54
Jul 10 13:03:43 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:44 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5c16fe5d-a1d1-498d-9140-b87b14088a9a tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73511732-aaef-4d42-8750-33d86556e209 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-73511732-aaef-4d42-8750-33d86556e209.d4f65dbd-44a9-4558-8fa2-11d98d348b54" returned: 0 in 0.673s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:44 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-5c16fe5d-a1d1-498d-9140-b87b14088a9a tempest-ProjectMemberTests-1574481172 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-73511732-aaef-4d42-8750-33d86556e209.d4f65dbd-44a9-4558-8fa2-11d98d348b54 is being set with open permissions: ugo+rw
Jul 10 13:03:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5c16fe5d-a1d1-498d-9140-b87b14088a9a tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-73511732-aaef-4d42-8750-33d86556e209.d4f65dbd-44a9-4558-8fa2-11d98d348b54 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:44 devstack sudo[107665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-73511732-aaef-4d42-8750-33d86556e209.d4f65dbd-44a9-4558-8fa2-11d98d348b54
Jul 10 13:03:44 devstack sudo[107665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:45 devstack sudo[107665]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5c16fe5d-a1d1-498d-9140-b87b14088a9a tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-73511732-aaef-4d42-8750-33d86556e209.d4f65dbd-44a9-4558-8fa2-11d98d348b54" returned: 0 in 0.627s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5c16fe5d-a1d1-498d-9140-b87b14088a9a tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-73511732-aaef-4d42-8750-33d86556e209.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:45 devstack sudo[107668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-73511732-aaef-4d42-8750-33d86556e209.info
Jul 10 13:03:45 devstack sudo[107668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:45 devstack sudo[107668]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5c16fe5d-a1d1-498d-9140-b87b14088a9a tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-73511732-aaef-4d42-8750-33d86556e209.info" returned: 0 in 0.649s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:45 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-5c16fe5d-a1d1-498d-9140-b87b14088a9a tempest-ProjectMemberTests-1574481172 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-73511732-aaef-4d42-8750-33d86556e209.info is being set with open permissions: ugo+rw
Jul 10 13:03:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5c16fe5d-a1d1-498d-9140-b87b14088a9a tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-73511732-aaef-4d42-8750-33d86556e209.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:45 devstack sudo[107671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-73511732-aaef-4d42-8750-33d86556e209.info
Jul 10 13:03:45 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:46 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-5c16fe5d-a1d1-498d-9140-b87b14088a9a tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-73511732-aaef-4d42-8750-33d86556e209.info" returned: 0 in 0.631s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-5c16fe5d-a1d1-498d-9140-b87b14088a9a tempest-ProjectMemberTests-1574481172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.197s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:03:46 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-5c16fe5d-a1d1-498d-9140-b87b14088a9a tempest-ProjectMemberTests-1574481172 None] Create snapshot completed successfully
Jul 10 13:03:47 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-6410a8a8-6fd7-4a6c-92d1-628018b693c1 tempest-ProjectMemberTests-1574481172 None] Acquiring lock "cinder-d4f65dbd-44a9-4558-8fa2-11d98d348b54-delete_snapshot" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:03:47 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-6410a8a8-6fd7-4a6c-92d1-628018b693c1 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-d4f65dbd-44a9-4558-8fa2-11d98d348b54-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:03:47 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-6410a8a8-6fd7-4a6c-92d1-628018b693c1 tempest-ProjectMemberTests-1574481172 None] Acquiring lock "cinder-quobyte-73511732-aaef-4d42-8750-33d86556e209" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:03:47 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-6410a8a8-6fd7-4a6c-92d1-628018b693c1 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-73511732-aaef-4d42-8750-33d86556e209" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:03:47 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-6410a8a8-6fd7-4a6c-92d1-628018b693c1 tempest-ProjectMemberTests-1574481172 None] Acquiring lock "cinder-quobyte-d4f65dbd-44a9-4558-8fa2-11d98d348b54" by "_delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:03:47 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-6410a8a8-6fd7-4a6c-92d1-628018b693c1 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-d4f65dbd-44a9-4558-8fa2-11d98d348b54" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:03:47 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-6410a8a8-6fd7-4a6c-92d1-628018b693c1 tempest-ProjectMemberTests-1574481172 None] Deleting offline snapshot d4f65dbd-44a9-4558-8fa2-11d98d348b54 of volume 73511732-aaef-4d42-8750-33d86556e209 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 10 13:03:47 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-6410a8a8-6fd7-4a6c-92d1-628018b693c1 tempest-ProjectMemberTests-1574481172 None] snapshot_file for this snap is: volume-73511732-aaef-4d42-8750-33d86556e209.d4f65dbd-44a9-4558-8fa2-11d98d348b54 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 10 13:03:47 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2711dc-ad81-479b-a403-07b17c0b1840]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:03:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6410a8a8-6fd7-4a6c-92d1-628018b693c1 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-73511732-aaef-4d42-8750-33d86556e209.d4f65dbd-44a9-4558-8fa2-11d98d348b54 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:47 devstack sudo[107674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-73511732-aaef-4d42-8750-33d86556e209.d4f65dbd-44a9-4558-8fa2-11d98d348b54
Jul 10 13:03:47 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:48 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6410a8a8-6fd7-4a6c-92d1-628018b693c1 tempest-ProjectMemberTests-1574481172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-73511732-aaef-4d42-8750-33d86556e209.d4f65dbd-44a9-4558-8fa2-11d98d348b54" returned: 0 in 0.763s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:48 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-6410a8a8-6fd7-4a6c-92d1-628018b693c1 tempest-ProjectMemberTests-1574481172 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73511732-aaef-4d42-8750-33d86556e209(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 13:03:48 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf96a2dd-2115-478c-bd73-5861de3563b9]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:03:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6410a8a8-6fd7-4a6c-92d1-628018b693c1 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-73511732-aaef-4d42-8750-33d86556e209 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:48 devstack sudo[107679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-73511732-aaef-4d42-8750-33d86556e209
Jul 10 13:03:48 devstack sudo[107679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:49 devstack sudo[107679]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6410a8a8-6fd7-4a6c-92d1-628018b693c1 tempest-ProjectMemberTests-1574481172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-73511732-aaef-4d42-8750-33d86556e209" returned: 0 in 0.737s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6410a8a8-6fd7-4a6c-92d1-628018b693c1 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-73511732-aaef-4d42-8750-33d86556e209.d4f65dbd-44a9-4558-8fa2-11d98d348b54 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:49 devstack sudo[107684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-73511732-aaef-4d42-8750-33d86556e209.d4f65dbd-44a9-4558-8fa2-11d98d348b54
Jul 10 13:03:49 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:49 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6410a8a8-6fd7-4a6c-92d1-628018b693c1 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-73511732-aaef-4d42-8750-33d86556e209.d4f65dbd-44a9-4558-8fa2-11d98d348b54" returned: 0 in 0.713s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6410a8a8-6fd7-4a6c-92d1-628018b693c1 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-73511732-aaef-4d42-8750-33d86556e209.d4f65dbd-44a9-4558-8fa2-11d98d348b54 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:49 devstack sudo[107690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-73511732-aaef-4d42-8750-33d86556e209.d4f65dbd-44a9-4558-8fa2-11d98d348b54
Jul 10 13:03:49 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:50 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-6410a8a8-6fd7-4a6c-92d1-628018b693c1 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-73511732-aaef-4d42-8750-33d86556e209.d4f65dbd-44a9-4558-8fa2-11d98d348b54" returned: 0 in 0.654s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:50 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-6410a8a8-6fd7-4a6c-92d1-628018b693c1 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-d4f65dbd-44a9-4558-8fa2-11d98d348b54" released by "_delete_snapshot" :: held 2.952s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:03:50 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-6410a8a8-6fd7-4a6c-92d1-628018b693c1 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-73511732-aaef-4d42-8750-33d86556e209" released by "delete_snapshot" :: held 2.973s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:03:50 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-6410a8a8-6fd7-4a6c-92d1-628018b693c1 tempest-ProjectMemberTests-1574481172 None] Created reservations ['832aa29a-5eec-4edd-95f9-dea789c31949', '9719c46b-1ad1-470b-9984-0e1782c1ceb9', '067fbd69-7b13-4481-8ac0-77158bb1a21a', '02a36678-10f6-4881-a6c1-c17d10e81e79'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:03:50 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-6410a8a8-6fd7-4a6c-92d1-628018b693c1 tempest-ProjectMemberTests-1574481172 None] Delete snapshot completed successfully.
Jul 10 13:03:50 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-6410a8a8-6fd7-4a6c-92d1-628018b693c1 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-d4f65dbd-44a9-4558-8fa2-11d98d348b54-delete_snapshot" released by "delete_snapshot" :: held 3.104s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:03:50 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-60e273ac-fb54-437c-a824-41ad46ec5e66 tempest-ProjectMemberTests-1574481172 None] Acquiring lock "cinder-73511732-aaef-4d42-8750-33d86556e209-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:03:50 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-60e273ac-fb54-437c-a824-41ad46ec5e66 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-73511732-aaef-4d42-8750-33d86556e209-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:03:50 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-60e273ac-fb54-437c-a824-41ad46ec5e66 tempest-ProjectMemberTests-1574481172 None] Acquiring lock "cinder-quobyte-73511732-aaef-4d42-8750-33d86556e209" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:03:50 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-60e273ac-fb54-437c-a824-41ad46ec5e66 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-73511732-aaef-4d42-8750-33d86556e209" acquired by "delete_volume" :: waited 0.016s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:03:50 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e574b703-342a-46ce-b174-498c41039a2d]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:03:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-60e273ac-fb54-437c-a824-41ad46ec5e66 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-73511732-aaef-4d42-8750-33d86556e209 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:50 devstack sudo[107693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-73511732-aaef-4d42-8750-33d86556e209
Jul 10 13:03:50 devstack sudo[107693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:51 devstack sudo[107693]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-60e273ac-fb54-437c-a824-41ad46ec5e66 tempest-ProjectMemberTests-1574481172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-73511732-aaef-4d42-8750-33d86556e209" returned: 0 in 0.741s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-60e273ac-fb54-437c-a824-41ad46ec5e66 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-73511732-aaef-4d42-8750-33d86556e209 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:51 devstack sudo[107698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-73511732-aaef-4d42-8750-33d86556e209
Jul 10 13:03:51 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:52 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-60e273ac-fb54-437c-a824-41ad46ec5e66 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-73511732-aaef-4d42-8750-33d86556e209" returned: 0 in 0.628s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:52 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-60e273ac-fb54-437c-a824-41ad46ec5e66 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-73511732-aaef-4d42-8750-33d86556e209" released by "delete_volume" :: held 1.422s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:03:52 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-60e273ac-fb54-437c-a824-41ad46ec5e66 tempest-ProjectMemberTests-1574481172 None] Created reservations ['cefffe33-f57e-4648-b4b5-8aedfd79f238', '25c4713c-6b46-4a13-8bcd-dfa694eb8b93', '8d8b3926-3f5b-4a1e-82aa-b28c3206b853', '1d7fe268-fba6-49b2-91fb-5e62754e456b'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:03:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-60e273ac-fb54-437c-a824-41ad46ec5e66 tempest-ProjectMemberTests-1574481172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:03:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-60e273ac-fb54-437c-a824-41ad46ec5e66 tempest-ProjectMemberTests-1574481172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:03:52 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-60e273ac-fb54-437c-a824-41ad46ec5e66 tempest-ProjectMemberTests-1574481172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:03:52 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-60e273ac-fb54-437c-a824-41ad46ec5e66 tempest-ProjectMemberTests-1574481172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:03:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-60e273ac-fb54-437c-a824-41ad46ec5e66 tempest-ProjectMemberTests-1574481172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:03:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-60e273ac-fb54-437c-a824-41ad46ec5e66 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:52 devstack sudo[107701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:03:52 devstack sudo[107701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:52 devstack sudo[107701]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-60e273ac-fb54-437c-a824-41ad46ec5e66 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.650s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:52 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-60e273ac-fb54-437c-a824-41ad46ec5e66 tempest-ProjectMemberTests-1574481172 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:03:52 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-60e273ac-fb54-437c-a824-41ad46ec5e66 tempest-ProjectMemberTests-1574481172 None] Deleted volume successfully.
Jul 10 13:03:53 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-60e273ac-fb54-437c-a824-41ad46ec5e66 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-73511732-aaef-4d42-8750-33d86556e209-delete_volume" released by "delete_volume" :: held 2.269s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:03:53 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-20492e4c-99c0-420b-a6c6-80728c27980f tempest-ProjectMemberTests-1574481172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 13:03:53 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-20492e4c-99c0-420b-a6c6-80728c27980f tempest-ProjectMemberTests-1574481172 None] Flow 'volume_create_manager' (bc402992-71e8-4e0a-b9d5-3adeb1fec76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:03:53 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-20492e4c-99c0-420b-a6c6-80728c27980f tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5e4e24f-7c37-45e0-b5bd-851ee40ae2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:03:53 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-20492e4c-99c0-420b-a6c6-80728c27980f tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5e4e24f-7c37-45e0-b5bd-851ee40ae2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:03:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-756764000',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3186a0cb-c4d2-4959-abe3-722521439e47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ab5735dd8284364bf17f2c244fabbf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:03:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:03:53Z,use_quota=True,user_id='7ead579763934814b4b50051ee0ea3a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:03:53 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-20492e4c-99c0-420b-a6c6-80728c27980f tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac401208-c5e2-467b-a951-d98715a52add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:03:53 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-20492e4c-99c0-420b-a6c6-80728c27980f tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac401208-c5e2-467b-a951-d98715a52add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:03:53 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-20492e4c-99c0-420b-a6c6-80728c27980f tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b272954-5fae-4ecc-9e1d-add3e54a4d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:03:53 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-20492e4c-99c0-420b-a6c6-80728c27980f tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b272954-5fae-4ecc-9e1d-add3e54a4d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3186a0cb-c4d2-4959-abe3-722521439e47', 'volume_name': 'volume-3186a0cb-c4d2-4959-abe3-722521439e47', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:03:53 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-20492e4c-99c0-420b-a6c6-80728c27980f tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5e57472-b474-48dd-8665-b8db6c11455d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:03:53 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-20492e4c-99c0-420b-a6c6-80728c27980f tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5e57472-b474-48dd-8665-b8db6c11455d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:03:53 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-20492e4c-99c0-420b-a6c6-80728c27980f tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa812111-99b1-4cb8-8994-befddfe8d804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:03:53 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-20492e4c-99c0-420b-a6c6-80728c27980f tempest-ProjectMemberTests-1574481172 None] Volume 3186a0cb-c4d2-4959-abe3-722521439e47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3186a0cb-c4d2-4959-abe3-722521439e47', 'volume_size': 1}
Jul 10 13:03:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-20492e4c-99c0-420b-a6c6-80728c27980f tempest-ProjectMemberTests-1574481172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:03:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-20492e4c-99c0-420b-a6c6-80728c27980f tempest-ProjectMemberTests-1574481172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:03:53 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-20492e4c-99c0-420b-a6c6-80728c27980f tempest-ProjectMemberTests-1574481172 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:03:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-756764000',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3186a0cb-c4d2-4959-abe3-722521439e47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ab5735dd8284364bf17f2c244fabbf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:03:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:03:53Z,use_quota=True,user_id='7ead579763934814b4b50051ee0ea3a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 13:03:53 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-20492e4c-99c0-420b-a6c6-80728c27980f tempest-ProjectMemberTests-1574481172 None] Creating volume 3186a0cb-c4d2-4959-abe3-722521439e47 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 13:03:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-20492e4c-99c0-420b-a6c6-80728c27980f tempest-ProjectMemberTests-1574481172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:03:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-20492e4c-99c0-420b-a6c6-80728c27980f tempest-ProjectMemberTests-1574481172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:03:53 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-20492e4c-99c0-420b-a6c6-80728c27980f tempest-ProjectMemberTests-1574481172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:03:53 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-20492e4c-99c0-420b-a6c6-80728c27980f tempest-ProjectMemberTests-1574481172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:03:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-20492e4c-99c0-420b-a6c6-80728c27980f tempest-ProjectMemberTests-1574481172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:03:53 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-20492e4c-99c0-420b-a6c6-80728c27980f tempest-ProjectMemberTests-1574481172 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 13:03:53 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-20492e4c-99c0-420b-a6c6-80728c27980f tempest-ProjectMemberTests-1574481172 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 13:03:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-20492e4c-99c0-420b-a6c6-80728c27980f tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3186a0cb-c4d2-4959-abe3-722521439e47 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:53 devstack sudo[107704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3186a0cb-c4d2-4959-abe3-722521439e47 1073741824
Jul 10 13:03:53 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:54 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-20492e4c-99c0-420b-a6c6-80728c27980f tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3186a0cb-c4d2-4959-abe3-722521439e47 1073741824" returned: 0 in 0.823s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-20492e4c-99c0-420b-a6c6-80728c27980f tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3186a0cb-c4d2-4959-abe3-722521439e47 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:54 devstack sudo[107709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3186a0cb-c4d2-4959-abe3-722521439e47
Jul 10 13:03:54 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:54 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-20492e4c-99c0-420b-a6c6-80728c27980f tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3186a0cb-c4d2-4959-abe3-722521439e47" returned: 0 in 0.628s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:54 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-20492e4c-99c0-420b-a6c6-80728c27980f tempest-ProjectMemberTests-1574481172 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 13:03:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-20492e4c-99c0-420b-a6c6-80728c27980f tempest-ProjectMemberTests-1574481172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:03:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-20492e4c-99c0-420b-a6c6-80728c27980f tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa812111-99b1-4cb8-8994-befddfe8d804) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3186a0cb-c4d2-4959-abe3-722521439e47', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:03:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-20492e4c-99c0-420b-a6c6-80728c27980f tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (249abf5a-a46c-47fc-8cae-5f158c40eb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:03:54 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-20492e4c-99c0-420b-a6c6-80728c27980f tempest-ProjectMemberTests-1574481172 None] Volume volume-3186a0cb-c4d2-4959-abe3-722521439e47 (3186a0cb-c4d2-4959-abe3-722521439e47): created successfully
Jul 10 13:03:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-20492e4c-99c0-420b-a6c6-80728c27980f tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (249abf5a-a46c-47fc-8cae-5f158c40eb94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:03:54 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-20492e4c-99c0-420b-a6c6-80728c27980f tempest-ProjectMemberTests-1574481172 None] Flow 'volume_create_manager' (bc402992-71e8-4e0a-b9d5-3adeb1fec76d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:03:54 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-20492e4c-99c0-420b-a6c6-80728c27980f tempest-ProjectMemberTests-1574481172 None] Created volume successfully.
Jul 10 13:03:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c6515011-d9b1-45b8-9388-fa2a6c3407d6 tempest-ProjectMemberTests-1574481172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:03:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c6515011-d9b1-45b8-9388-fa2a6c3407d6 tempest-ProjectMemberTests-1574481172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:03:55 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-c6515011-d9b1-45b8-9388-fa2a6c3407d6 tempest-ProjectMemberTests-1574481172 None] Creating offline snapshot 6aa97c17-44cd-4c82-9d87-96387f7ce4e3 of volume 3186a0cb-c4d2-4959-abe3-722521439e47 {{(pid=87378) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 10 13:03:55 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[49230e2d-e33c-4d91-af58-d7afa3dfe745]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:03:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c6515011-d9b1-45b8-9388-fa2a6c3407d6 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3186a0cb-c4d2-4959-abe3-722521439e47 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:55 devstack sudo[107712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3186a0cb-c4d2-4959-abe3-722521439e47
Jul 10 13:03:55 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:56 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c6515011-d9b1-45b8-9388-fa2a6c3407d6 tempest-ProjectMemberTests-1574481172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3186a0cb-c4d2-4959-abe3-722521439e47" returned: 0 in 0.740s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c6515011-d9b1-45b8-9388-fa2a6c3407d6 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3186a0cb-c4d2-4959-abe3-722521439e47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3186a0cb-c4d2-4959-abe3-722521439e47.6aa97c17-44cd-4c82-9d87-96387f7ce4e3 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:56 devstack sudo[107717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3186a0cb-c4d2-4959-abe3-722521439e47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3186a0cb-c4d2-4959-abe3-722521439e47.6aa97c17-44cd-4c82-9d87-96387f7ce4e3 1G
Jul 10 13:03:56 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:57 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c6515011-d9b1-45b8-9388-fa2a6c3407d6 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3186a0cb-c4d2-4959-abe3-722521439e47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3186a0cb-c4d2-4959-abe3-722521439e47.6aa97c17-44cd-4c82-9d87-96387f7ce4e3 1G" returned: 0 in 0.794s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c6515011-d9b1-45b8-9388-fa2a6c3407d6 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3186a0cb-c4d2-4959-abe3-722521439e47 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3186a0cb-c4d2-4959-abe3-722521439e47.6aa97c17-44cd-4c82-9d87-96387f7ce4e3 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:57 devstack sudo[107723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3186a0cb-c4d2-4959-abe3-722521439e47 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3186a0cb-c4d2-4959-abe3-722521439e47.6aa97c17-44cd-4c82-9d87-96387f7ce4e3
Jul 10 13:03:57 devstack sudo[107723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:57 devstack sudo[107723]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c6515011-d9b1-45b8-9388-fa2a6c3407d6 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3186a0cb-c4d2-4959-abe3-722521439e47 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3186a0cb-c4d2-4959-abe3-722521439e47.6aa97c17-44cd-4c82-9d87-96387f7ce4e3" returned: 0 in 0.679s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:57 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-c6515011-d9b1-45b8-9388-fa2a6c3407d6 tempest-ProjectMemberTests-1574481172 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3186a0cb-c4d2-4959-abe3-722521439e47.6aa97c17-44cd-4c82-9d87-96387f7ce4e3 is being set with open permissions: ugo+rw
Jul 10 13:03:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c6515011-d9b1-45b8-9388-fa2a6c3407d6 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3186a0cb-c4d2-4959-abe3-722521439e47.6aa97c17-44cd-4c82-9d87-96387f7ce4e3 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:57 devstack sudo[107728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3186a0cb-c4d2-4959-abe3-722521439e47.6aa97c17-44cd-4c82-9d87-96387f7ce4e3
Jul 10 13:03:57 devstack sudo[107728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:58 devstack sudo[107728]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c6515011-d9b1-45b8-9388-fa2a6c3407d6 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3186a0cb-c4d2-4959-abe3-722521439e47.6aa97c17-44cd-4c82-9d87-96387f7ce4e3" returned: 0 in 0.648s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c6515011-d9b1-45b8-9388-fa2a6c3407d6 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3186a0cb-c4d2-4959-abe3-722521439e47.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:58 devstack sudo[107731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3186a0cb-c4d2-4959-abe3-722521439e47.info
Jul 10 13:03:58 devstack sudo[107731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:59 devstack sudo[107731]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c6515011-d9b1-45b8-9388-fa2a6c3407d6 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3186a0cb-c4d2-4959-abe3-722521439e47.info" returned: 0 in 0.632s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:59 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-c6515011-d9b1-45b8-9388-fa2a6c3407d6 tempest-ProjectMemberTests-1574481172 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3186a0cb-c4d2-4959-abe3-722521439e47.info is being set with open permissions: ugo+rw
Jul 10 13:03:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c6515011-d9b1-45b8-9388-fa2a6c3407d6 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3186a0cb-c4d2-4959-abe3-722521439e47.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:03:59 devstack sudo[107736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3186a0cb-c4d2-4959-abe3-722521439e47.info
Jul 10 13:03:59 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:03:59 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root
Jul 10 13:03:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c6515011-d9b1-45b8-9388-fa2a6c3407d6 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3186a0cb-c4d2-4959-abe3-722521439e47.info" returned: 0 in 0.632s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:03:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c6515011-d9b1-45b8-9388-fa2a6c3407d6 tempest-ProjectMemberTests-1574481172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.202s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:03:59 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-c6515011-d9b1-45b8-9388-fa2a6c3407d6 tempest-ProjectMemberTests-1574481172 None] Create snapshot completed successfully
Jul 10 13:04:00 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-c40a2640-7bed-43b7-94b6-ffdeaed7f625 tempest-ProjectMemberTests-1574481172 None] Acquiring lock "cinder-6aa97c17-44cd-4c82-9d87-96387f7ce4e3-delete_snapshot" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:04:00 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-c40a2640-7bed-43b7-94b6-ffdeaed7f625 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-6aa97c17-44cd-4c82-9d87-96387f7ce4e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:04:00 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-c40a2640-7bed-43b7-94b6-ffdeaed7f625 tempest-ProjectMemberTests-1574481172 None] Acquiring lock "cinder-quobyte-3186a0cb-c4d2-4959-abe3-722521439e47" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:04:00 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-c40a2640-7bed-43b7-94b6-ffdeaed7f625 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-3186a0cb-c4d2-4959-abe3-722521439e47" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:04:00 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-c40a2640-7bed-43b7-94b6-ffdeaed7f625 tempest-ProjectMemberTests-1574481172 None] Acquiring lock "cinder-quobyte-6aa97c17-44cd-4c82-9d87-96387f7ce4e3" by "_delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:04:00 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-c40a2640-7bed-43b7-94b6-ffdeaed7f625 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-6aa97c17-44cd-4c82-9d87-96387f7ce4e3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:04:00 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-c40a2640-7bed-43b7-94b6-ffdeaed7f625 tempest-ProjectMemberTests-1574481172 None] Deleting offline snapshot 6aa97c17-44cd-4c82-9d87-96387f7ce4e3 of volume 3186a0cb-c4d2-4959-abe3-722521439e47 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 10 13:04:00 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-c40a2640-7bed-43b7-94b6-ffdeaed7f625 tempest-ProjectMemberTests-1574481172 None] snapshot_file for this snap is: volume-3186a0cb-c4d2-4959-abe3-722521439e47.6aa97c17-44cd-4c82-9d87-96387f7ce4e3 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 10 13:04:00 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7cef8b4-6a36-4027-8c1b-9771661508f6]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:04:00 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c40a2640-7bed-43b7-94b6-ffdeaed7f625 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3186a0cb-c4d2-4959-abe3-722521439e47.6aa97c17-44cd-4c82-9d87-96387f7ce4e3 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:00 devstack sudo[107740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3186a0cb-c4d2-4959-abe3-722521439e47.6aa97c17-44cd-4c82-9d87-96387f7ce4e3
Jul 10 13:04:00 devstack sudo[107740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:01 devstack sudo[107740]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c40a2640-7bed-43b7-94b6-ffdeaed7f625 tempest-ProjectMemberTests-1574481172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3186a0cb-c4d2-4959-abe3-722521439e47.6aa97c17-44cd-4c82-9d87-96387f7ce4e3" returned: 0 in 0.737s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:01 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-c40a2640-7bed-43b7-94b6-ffdeaed7f625 tempest-ProjectMemberTests-1574481172 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3186a0cb-c4d2-4959-abe3-722521439e47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 13:04:01 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[8859c3af-eb12-4a27-800a-ad31c61181b7]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:04:01 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c40a2640-7bed-43b7-94b6-ffdeaed7f625 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3186a0cb-c4d2-4959-abe3-722521439e47 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:01 devstack sudo[107745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3186a0cb-c4d2-4959-abe3-722521439e47
Jul 10 13:04:01 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:02 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c40a2640-7bed-43b7-94b6-ffdeaed7f625 tempest-ProjectMemberTests-1574481172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3186a0cb-c4d2-4959-abe3-722521439e47" returned: 0 in 0.758s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:02 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c40a2640-7bed-43b7-94b6-ffdeaed7f625 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3186a0cb-c4d2-4959-abe3-722521439e47.6aa97c17-44cd-4c82-9d87-96387f7ce4e3 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:02 devstack sudo[107750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3186a0cb-c4d2-4959-abe3-722521439e47.6aa97c17-44cd-4c82-9d87-96387f7ce4e3
Jul 10 13:04:02 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:03 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c40a2640-7bed-43b7-94b6-ffdeaed7f625 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3186a0cb-c4d2-4959-abe3-722521439e47.6aa97c17-44cd-4c82-9d87-96387f7ce4e3" returned: 0 in 0.730s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c40a2640-7bed-43b7-94b6-ffdeaed7f625 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3186a0cb-c4d2-4959-abe3-722521439e47.6aa97c17-44cd-4c82-9d87-96387f7ce4e3 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:03 devstack sudo[107755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3186a0cb-c4d2-4959-abe3-722521439e47.6aa97c17-44cd-4c82-9d87-96387f7ce4e3
Jul 10 13:04:03 devstack sudo[107755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:03 devstack sudo[107755]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:03 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c40a2640-7bed-43b7-94b6-ffdeaed7f625 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3186a0cb-c4d2-4959-abe3-722521439e47.6aa97c17-44cd-4c82-9d87-96387f7ce4e3" returned: 0 in 0.645s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:03 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-c40a2640-7bed-43b7-94b6-ffdeaed7f625 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-6aa97c17-44cd-4c82-9d87-96387f7ce4e3" released by "_delete_snapshot" :: held 2.959s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:04:03 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-c40a2640-7bed-43b7-94b6-ffdeaed7f625 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-3186a0cb-c4d2-4959-abe3-722521439e47" released by "delete_snapshot" :: held 2.983s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:04:03 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-c40a2640-7bed-43b7-94b6-ffdeaed7f625 tempest-ProjectMemberTests-1574481172 None] Created reservations ['51e52cb2-e380-4ef8-bc5f-cbd57de2c52d', '0412e515-40d2-4f3d-8c07-c6ac2c5c9ee7', 'e6e3fc0f-2491-401b-b9f1-a365fe4c5945', '39f57780-0f56-43fd-93d8-c27856c6d847'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:04:03 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-c40a2640-7bed-43b7-94b6-ffdeaed7f625 tempest-ProjectMemberTests-1574481172 None] Delete snapshot completed successfully.
Jul 10 13:04:03 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-c40a2640-7bed-43b7-94b6-ffdeaed7f625 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-6aa97c17-44cd-4c82-9d87-96387f7ce4e3-delete_snapshot" released by "delete_snapshot" :: held 3.128s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:04:03 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1c529168-c6b9-4461-9a1b-abcaaaf969e6 tempest-ProjectMemberTests-1574481172 None] Acquiring lock "cinder-3186a0cb-c4d2-4959-abe3-722521439e47-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:04:03 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1c529168-c6b9-4461-9a1b-abcaaaf969e6 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-3186a0cb-c4d2-4959-abe3-722521439e47-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:04:04 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1c529168-c6b9-4461-9a1b-abcaaaf969e6 tempest-ProjectMemberTests-1574481172 None] Acquiring lock "cinder-quobyte-3186a0cb-c4d2-4959-abe3-722521439e47" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:04:04 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1c529168-c6b9-4461-9a1b-abcaaaf969e6 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-3186a0cb-c4d2-4959-abe3-722521439e47" acquired by "delete_volume" :: waited 0.016s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:04:04 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9f03d3-8fe9-4936-a59a-29dc9b697b48]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:04:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1c529168-c6b9-4461-9a1b-abcaaaf969e6 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3186a0cb-c4d2-4959-abe3-722521439e47 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:04 devstack sudo[107758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3186a0cb-c4d2-4959-abe3-722521439e47
Jul 10 13:04:04 devstack sudo[107758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:04 devstack sudo[107758]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1c529168-c6b9-4461-9a1b-abcaaaf969e6 tempest-ProjectMemberTests-1574481172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3186a0cb-c4d2-4959-abe3-722521439e47" returned: 0 in 0.760s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:04 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1c529168-c6b9-4461-9a1b-abcaaaf969e6 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3186a0cb-c4d2-4959-abe3-722521439e47 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:04 devstack sudo[107764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3186a0cb-c4d2-4959-abe3-722521439e47
Jul 10 13:04:04 devstack sudo[107764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:05 devstack sudo[107764]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1c529168-c6b9-4461-9a1b-abcaaaf969e6 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-3186a0cb-c4d2-4959-abe3-722521439e47" returned: 0 in 0.641s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:05 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1c529168-c6b9-4461-9a1b-abcaaaf969e6 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-3186a0cb-c4d2-4959-abe3-722521439e47" released by "delete_volume" :: held 1.454s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:04:05 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-1c529168-c6b9-4461-9a1b-abcaaaf969e6 tempest-ProjectMemberTests-1574481172 None] Created reservations ['f940199c-6bb2-4eea-ba38-0f4373746b3d', 'b0e994ac-60f9-4c0b-99f5-962e2442f0cc', 'cb9eda9e-5aea-48f8-8441-920542e192c7', 'f35dd0c8-9ff2-47e9-83bd-d3f09b0a78cf'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:04:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1c529168-c6b9-4461-9a1b-abcaaaf969e6 tempest-ProjectMemberTests-1574481172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:04:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1c529168-c6b9-4461-9a1b-abcaaaf969e6 tempest-ProjectMemberTests-1574481172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:04:05 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-1c529168-c6b9-4461-9a1b-abcaaaf969e6 tempest-ProjectMemberTests-1574481172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:04:05 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-1c529168-c6b9-4461-9a1b-abcaaaf969e6 tempest-ProjectMemberTests-1574481172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:04:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-1c529168-c6b9-4461-9a1b-abcaaaf969e6 tempest-ProjectMemberTests-1574481172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:04:05 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1c529168-c6b9-4461-9a1b-abcaaaf969e6 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:05 devstack sudo[107767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:04:05 devstack sudo[107767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:06 devstack sudo[107767]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-1c529168-c6b9-4461-9a1b-abcaaaf969e6 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.652s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:06 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-1c529168-c6b9-4461-9a1b-abcaaaf969e6 tempest-ProjectMemberTests-1574481172 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:04:06 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-1c529168-c6b9-4461-9a1b-abcaaaf969e6 tempest-ProjectMemberTests-1574481172 None] Deleted volume successfully.
Jul 10 13:04:06 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-1c529168-c6b9-4461-9a1b-abcaaaf969e6 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-3186a0cb-c4d2-4959-abe3-722521439e47-delete_volume" released by "delete_volume" :: held 2.302s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:04:06 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbbf77fd-8f7a-45c8-898a-71ad7dc659dc tempest-ProjectMemberTests-1574481172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 13:04:06 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fbbf77fd-8f7a-45c8-898a-71ad7dc659dc tempest-ProjectMemberTests-1574481172 None] Flow 'volume_create_manager' (9daaf034-c059-435d-80d8-1dc8eb6f381e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:04:06 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fbbf77fd-8f7a-45c8-898a-71ad7dc659dc tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb57063c-3755-45e4-81f3-e8a615dff42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:04:06 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fbbf77fd-8f7a-45c8-898a-71ad7dc659dc tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb57063c-3755-45e4-81f3-e8a615dff42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1440257997',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee0c9ddf-35fa-4dd7-80ac-a457455fd611,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ab5735dd8284364bf17f2c244fabbf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:04:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:04:07Z,use_quota=True,user_id='7ead579763934814b4b50051ee0ea3a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:04:06 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fbbf77fd-8f7a-45c8-898a-71ad7dc659dc tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61293da2-2b8b-4bf6-95bd-bc7eca72727e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:04:06 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fbbf77fd-8f7a-45c8-898a-71ad7dc659dc tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61293da2-2b8b-4bf6-95bd-bc7eca72727e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:04:06 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fbbf77fd-8f7a-45c8-898a-71ad7dc659dc tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c871db5c-a585-4112-a3bc-638537869077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:04:06 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fbbf77fd-8f7a-45c8-898a-71ad7dc659dc tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c871db5c-a585-4112-a3bc-638537869077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee0c9ddf-35fa-4dd7-80ac-a457455fd611', 'volume_name': 'volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:04:06 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fbbf77fd-8f7a-45c8-898a-71ad7dc659dc tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5ea014d-d0ed-4602-8ec9-9326f3aa52b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:04:06 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fbbf77fd-8f7a-45c8-898a-71ad7dc659dc tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5ea014d-d0ed-4602-8ec9-9326f3aa52b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:04:06 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fbbf77fd-8f7a-45c8-898a-71ad7dc659dc tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8b48c07-ec0c-4e70-a0a2-798222806f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:04:06 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-fbbf77fd-8f7a-45c8-898a-71ad7dc659dc tempest-ProjectMemberTests-1574481172 None] Volume ee0c9ddf-35fa-4dd7-80ac-a457455fd611: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611', 'volume_size': 1}
Jul 10 13:04:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-fbbf77fd-8f7a-45c8-898a-71ad7dc659dc tempest-ProjectMemberTests-1574481172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:04:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-fbbf77fd-8f7a-45c8-898a-71ad7dc659dc tempest-ProjectMemberTests-1574481172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:04:06 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-fbbf77fd-8f7a-45c8-898a-71ad7dc659dc tempest-ProjectMemberTests-1574481172 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1440257997',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee0c9ddf-35fa-4dd7-80ac-a457455fd611,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ab5735dd8284364bf17f2c244fabbf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:04:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:04:07Z,use_quota=True,user_id='7ead579763934814b4b50051ee0ea3a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 13:04:06 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-fbbf77fd-8f7a-45c8-898a-71ad7dc659dc tempest-ProjectMemberTests-1574481172 None] Creating volume ee0c9ddf-35fa-4dd7-80ac-a457455fd611 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 13:04:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-fbbf77fd-8f7a-45c8-898a-71ad7dc659dc tempest-ProjectMemberTests-1574481172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:04:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-fbbf77fd-8f7a-45c8-898a-71ad7dc659dc tempest-ProjectMemberTests-1574481172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:04:06 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-fbbf77fd-8f7a-45c8-898a-71ad7dc659dc tempest-ProjectMemberTests-1574481172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:04:06 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-fbbf77fd-8f7a-45c8-898a-71ad7dc659dc tempest-ProjectMemberTests-1574481172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:04:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-fbbf77fd-8f7a-45c8-898a-71ad7dc659dc tempest-ProjectMemberTests-1574481172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:04:06 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-fbbf77fd-8f7a-45c8-898a-71ad7dc659dc tempest-ProjectMemberTests-1574481172 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 13:04:06 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-fbbf77fd-8f7a-45c8-898a-71ad7dc659dc tempest-ProjectMemberTests-1574481172 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 13:04:06 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fbbf77fd-8f7a-45c8-898a-71ad7dc659dc tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:06 devstack sudo[107770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611 1073741824
Jul 10 13:04:06 devstack sudo[107770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:07 devstack sudo[107770]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fbbf77fd-8f7a-45c8-898a-71ad7dc659dc tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611 1073741824" returned: 0 in 0.789s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:07 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fbbf77fd-8f7a-45c8-898a-71ad7dc659dc tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:07 devstack sudo[107775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611
Jul 10 13:04:07 devstack sudo[107775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:08 devstack sudo[107775]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fbbf77fd-8f7a-45c8-898a-71ad7dc659dc tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611" returned: 0 in 0.643s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:08 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-fbbf77fd-8f7a-45c8-898a-71ad7dc659dc tempest-ProjectMemberTests-1574481172 None] <== create_volume: return (1473ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 13:04:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-fbbf77fd-8f7a-45c8-898a-71ad7dc659dc tempest-ProjectMemberTests-1574481172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:04:08 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fbbf77fd-8f7a-45c8-898a-71ad7dc659dc tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8b48c07-ec0c-4e70-a0a2-798222806f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:04:08 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fbbf77fd-8f7a-45c8-898a-71ad7dc659dc tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09607eab-04cd-478b-9b54-21f2bfe08387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:04:08 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-fbbf77fd-8f7a-45c8-898a-71ad7dc659dc tempest-ProjectMemberTests-1574481172 None] Volume volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611 (ee0c9ddf-35fa-4dd7-80ac-a457455fd611): created successfully
Jul 10 13:04:08 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fbbf77fd-8f7a-45c8-898a-71ad7dc659dc tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09607eab-04cd-478b-9b54-21f2bfe08387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:04:08 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-fbbf77fd-8f7a-45c8-898a-71ad7dc659dc tempest-ProjectMemberTests-1574481172 None] Flow 'volume_create_manager' (9daaf034-c059-435d-80d8-1dc8eb6f381e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:04:08 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-fbbf77fd-8f7a-45c8-898a-71ad7dc659dc tempest-ProjectMemberTests-1574481172 None] Created volume successfully.
Jul 10 13:04:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-fda6709e-a3cf-47f8-a837-e144b25d3a00 tempest-ProjectMemberTests-1574481172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:04:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-fda6709e-a3cf-47f8-a837-e144b25d3a00 tempest-ProjectMemberTests-1574481172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:04:08 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-fda6709e-a3cf-47f8-a837-e144b25d3a00 tempest-ProjectMemberTests-1574481172 None] Creating offline snapshot 1a25f3f3-c338-4625-9d8c-c7798a6bd5ae of volume ee0c9ddf-35fa-4dd7-80ac-a457455fd611 {{(pid=87378) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 10 13:04:08 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[486630ab-5c1e-46bb-81e9-c12731f8390c]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:04:08 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fda6709e-a3cf-47f8-a837-e144b25d3a00 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:08 devstack sudo[107778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611
Jul 10 13:04:08 devstack sudo[107778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:09 devstack sudo[107778]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fda6709e-a3cf-47f8-a837-e144b25d3a00 tempest-ProjectMemberTests-1574481172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611" returned: 0 in 0.726s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:09 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fda6709e-a3cf-47f8-a837-e144b25d3a00 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611.1a25f3f3-c338-4625-9d8c-c7798a6bd5ae 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:09 devstack sudo[107783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611.1a25f3f3-c338-4625-9d8c-c7798a6bd5ae 1G
Jul 10 13:04:09 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:10 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fda6709e-a3cf-47f8-a837-e144b25d3a00 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611.1a25f3f3-c338-4625-9d8c-c7798a6bd5ae 1G" returned: 0 in 0.772s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fda6709e-a3cf-47f8-a837-e144b25d3a00 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611.1a25f3f3-c338-4625-9d8c-c7798a6bd5ae {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:10 devstack sudo[107789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611.1a25f3f3-c338-4625-9d8c-c7798a6bd5ae
Jul 10 13:04:10 devstack sudo[107789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:10 devstack sudo[107789]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fda6709e-a3cf-47f8-a837-e144b25d3a00 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611.1a25f3f3-c338-4625-9d8c-c7798a6bd5ae" returned: 0 in 0.659s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:10 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-fda6709e-a3cf-47f8-a837-e144b25d3a00 tempest-ProjectMemberTests-1574481172 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611.1a25f3f3-c338-4625-9d8c-c7798a6bd5ae is being set with open permissions: ugo+rw
Jul 10 13:04:10 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fda6709e-a3cf-47f8-a837-e144b25d3a00 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611.1a25f3f3-c338-4625-9d8c-c7798a6bd5ae {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:11 devstack sudo[107794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611.1a25f3f3-c338-4625-9d8c-c7798a6bd5ae
Jul 10 13:04:11 devstack sudo[107794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:11 devstack sudo[107794]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fda6709e-a3cf-47f8-a837-e144b25d3a00 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611.1a25f3f3-c338-4625-9d8c-c7798a6bd5ae" returned: 0 in 0.624s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:11 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fda6709e-a3cf-47f8-a837-e144b25d3a00 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:11 devstack sudo[107797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611.info
Jul 10 13:04:11 devstack sudo[107797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:12 devstack sudo[107797]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fda6709e-a3cf-47f8-a837-e144b25d3a00 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611.info" returned: 0 in 0.634s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:12 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-fda6709e-a3cf-47f8-a837-e144b25d3a00 tempest-ProjectMemberTests-1574481172 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611.info is being set with open permissions: ugo+rw
Jul 10 13:04:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fda6709e-a3cf-47f8-a837-e144b25d3a00 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:12 devstack sudo[107800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611.info
Jul 10 13:04:12 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:12 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-fda6709e-a3cf-47f8-a837-e144b25d3a00 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611.info" returned: 0 in 0.620s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-fda6709e-a3cf-47f8-a837-e144b25d3a00 tempest-ProjectMemberTests-1574481172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.111s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:04:12 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-fda6709e-a3cf-47f8-a837-e144b25d3a00 tempest-ProjectMemberTests-1574481172 None] Create snapshot completed successfully
Jul 10 13:04:12 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 13:04:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:04:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:04:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:04:13 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:04:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:04:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:13 devstack sudo[107803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:04:13 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:13 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.654s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:13 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:04:13 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager._thread_info {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 13:04:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread count: 28 {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 10 13:04:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread info: [<_MainThread(MainThread, started 128233544536192)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128233445424704)>, <Thread(Thread-3 (stat_writer), started daemon 128233435118528)>, <Thread(Rabbit-heartbeat, started daemon 128233435718016)>, <Thread(Thread-5 (_runner), started daemon 128233432624448)>, <Thread(Thread-7 (_runner), started daemon 128233432674688)>, <Thread(fd_logger, started daemon 128233428569472)>, <Thread(privsep_reader, started daemon 128233429417088)>, <Thread(tpool_thread_0, started daemon 128233421182656)>, <Thread(tpool_thread_1, started daemon 128233412789952)>, <Thread(tpool_thread_2, started daemon 128233404397248)>, <Thread(tpool_thread_3, started daemon 128233396004544)>, <Thread(tpool_thread_4, started daemon 128233387611840)>, <Thread(tpool_thread_5, started daemon 128233379219136)>, <Thread(tpool_thread_6, started daemon 128233370826432)>, <Thread(tpool_thread_7, started daemon 128233362433728)>, <Thread(tpool_thread_8, started daemon 128233354041024)>, <Thread(tpool_thread_9, started daemon 128233345631936)>, <Thread(tpool_thread_10, started daemon 128233337222848)>, <Thread(tpool_thread_11, started daemon 128233328813760)>, <Thread(tpool_thread_12, started daemon 128233320404672)>, <Thread(tpool_thread_13, started daemon 128233311995584)>, <Thread(tpool_thread_14, started daemon 128233303586496)>, <Thread(tpool_thread_15, started daemon 128233295177408)>, <Thread(tpool_thread_16, started daemon 128233286768320)>, <Thread(tpool_thread_17, started daemon 128233278359232)>, <Thread(tpool_thread_18, started daemon 128233269950144)>, <Thread(tpool_thread_19, started daemon 128233261541056)>] {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 10 13:04:14 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-037804ee-b5b7-4271-9e1e-d869e0c0a2cc tempest-ProjectMemberTests-1574481172 None] Acquiring lock "cinder-1a25f3f3-c338-4625-9d8c-c7798a6bd5ae-delete_snapshot" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:04:14 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-037804ee-b5b7-4271-9e1e-d869e0c0a2cc tempest-ProjectMemberTests-1574481172 None] Lock "cinder-1a25f3f3-c338-4625-9d8c-c7798a6bd5ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:04:14 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-037804ee-b5b7-4271-9e1e-d869e0c0a2cc tempest-ProjectMemberTests-1574481172 None] Acquiring lock "cinder-quobyte-ee0c9ddf-35fa-4dd7-80ac-a457455fd611" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:04:14 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-037804ee-b5b7-4271-9e1e-d869e0c0a2cc tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-ee0c9ddf-35fa-4dd7-80ac-a457455fd611" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:04:14 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-037804ee-b5b7-4271-9e1e-d869e0c0a2cc tempest-ProjectMemberTests-1574481172 None] Acquiring lock "cinder-quobyte-1a25f3f3-c338-4625-9d8c-c7798a6bd5ae" by "_delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:04:14 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-037804ee-b5b7-4271-9e1e-d869e0c0a2cc tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-1a25f3f3-c338-4625-9d8c-c7798a6bd5ae" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:04:14 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-037804ee-b5b7-4271-9e1e-d869e0c0a2cc tempest-ProjectMemberTests-1574481172 None] Deleting offline snapshot 1a25f3f3-c338-4625-9d8c-c7798a6bd5ae of volume ee0c9ddf-35fa-4dd7-80ac-a457455fd611 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 10 13:04:14 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-037804ee-b5b7-4271-9e1e-d869e0c0a2cc tempest-ProjectMemberTests-1574481172 None] snapshot_file for this snap is: volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611.1a25f3f3-c338-4625-9d8c-c7798a6bd5ae {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 10 13:04:14 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f727b867-adc5-4f33-96c2-900b59cc691b]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:04:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-037804ee-b5b7-4271-9e1e-d869e0c0a2cc tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611.1a25f3f3-c338-4625-9d8c-c7798a6bd5ae {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:14 devstack sudo[107806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611.1a25f3f3-c338-4625-9d8c-c7798a6bd5ae
Jul 10 13:04:14 devstack sudo[107806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:14 devstack sudo[107806]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-037804ee-b5b7-4271-9e1e-d869e0c0a2cc tempest-ProjectMemberTests-1574481172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611.1a25f3f3-c338-4625-9d8c-c7798a6bd5ae" returned: 0 in 0.749s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:14 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-037804ee-b5b7-4271-9e1e-d869e0c0a2cc tempest-ProjectMemberTests-1574481172 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 13:04:14 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f4f397-c604-45d0-9e2c-193997a14f8d]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:04:14 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-037804ee-b5b7-4271-9e1e-d869e0c0a2cc tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:14 devstack sudo[107811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611
Jul 10 13:04:14 devstack sudo[107811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:15 devstack sudo[107811]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-037804ee-b5b7-4271-9e1e-d869e0c0a2cc tempest-ProjectMemberTests-1574481172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611" returned: 0 in 0.736s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:15 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-037804ee-b5b7-4271-9e1e-d869e0c0a2cc tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611.1a25f3f3-c338-4625-9d8c-c7798a6bd5ae {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:15 devstack sudo[107817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611.1a25f3f3-c338-4625-9d8c-c7798a6bd5ae
Jul 10 13:04:15 devstack sudo[107817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:16 devstack sudo[107817]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-037804ee-b5b7-4271-9e1e-d869e0c0a2cc tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611.1a25f3f3-c338-4625-9d8c-c7798a6bd5ae" returned: 0 in 0.726s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-037804ee-b5b7-4271-9e1e-d869e0c0a2cc tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611.1a25f3f3-c338-4625-9d8c-c7798a6bd5ae {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:16 devstack sudo[107822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611.1a25f3f3-c338-4625-9d8c-c7798a6bd5ae
Jul 10 13:04:16 devstack sudo[107822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:16 devstack sudo[107822]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:16 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-037804ee-b5b7-4271-9e1e-d869e0c0a2cc tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611.1a25f3f3-c338-4625-9d8c-c7798a6bd5ae" returned: 0 in 0.627s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:16 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-037804ee-b5b7-4271-9e1e-d869e0c0a2cc tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-1a25f3f3-c338-4625-9d8c-c7798a6bd5ae" released by "_delete_snapshot" :: held 2.925s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:04:16 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-037804ee-b5b7-4271-9e1e-d869e0c0a2cc tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-ee0c9ddf-35fa-4dd7-80ac-a457455fd611" released by "delete_snapshot" :: held 2.949s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:04:17 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-037804ee-b5b7-4271-9e1e-d869e0c0a2cc tempest-ProjectMemberTests-1574481172 None] Created reservations ['0f94fb34-9a9a-451f-b81b-3b75f72143d7', '86d35f81-d165-417e-9ae6-0ba832d91d56', '728f7537-fe19-40da-bdc5-cdae0c33994a', '80d1823c-f155-4499-81b8-e0f476b8c39e'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:04:17 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-037804ee-b5b7-4271-9e1e-d869e0c0a2cc tempest-ProjectMemberTests-1574481172 None] Delete snapshot completed successfully.
Jul 10 13:04:17 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-037804ee-b5b7-4271-9e1e-d869e0c0a2cc tempest-ProjectMemberTests-1574481172 None] Lock "cinder-1a25f3f3-c338-4625-9d8c-c7798a6bd5ae-delete_snapshot" released by "delete_snapshot" :: held 3.079s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:04:17 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-2a0e30ae-1335-4f52-9bae-595de41cdb04 tempest-ProjectMemberTests-1574481172 None] Acquiring lock "cinder-ee0c9ddf-35fa-4dd7-80ac-a457455fd611-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:04:17 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-2a0e30ae-1335-4f52-9bae-595de41cdb04 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-ee0c9ddf-35fa-4dd7-80ac-a457455fd611-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:04:17 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-2a0e30ae-1335-4f52-9bae-595de41cdb04 tempest-ProjectMemberTests-1574481172 None] Acquiring lock "cinder-quobyte-ee0c9ddf-35fa-4dd7-80ac-a457455fd611" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:04:17 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-2a0e30ae-1335-4f52-9bae-595de41cdb04 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-ee0c9ddf-35fa-4dd7-80ac-a457455fd611" acquired by "delete_volume" :: waited 0.014s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:04:17 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78f0bde-41ac-4ff7-843d-5a2985356038]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:04:17 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2a0e30ae-1335-4f52-9bae-595de41cdb04 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:17 devstack sudo[107825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611
Jul 10 13:04:17 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:18 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2a0e30ae-1335-4f52-9bae-595de41cdb04 tempest-ProjectMemberTests-1574481172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611" returned: 0 in 0.770s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2a0e30ae-1335-4f52-9bae-595de41cdb04 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:18 devstack sudo[107830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611
Jul 10 13:04:18 devstack sudo[107830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:18 devstack sudo[107830]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2a0e30ae-1335-4f52-9bae-595de41cdb04 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-ee0c9ddf-35fa-4dd7-80ac-a457455fd611" returned: 0 in 0.620s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:18 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-2a0e30ae-1335-4f52-9bae-595de41cdb04 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-ee0c9ddf-35fa-4dd7-80ac-a457455fd611" released by "delete_volume" :: held 1.444s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:04:18 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-2a0e30ae-1335-4f52-9bae-595de41cdb04 tempest-ProjectMemberTests-1574481172 None] Created reservations ['8a0de474-cbbb-43c0-8fa2-9dc4c343b6ae', '54ccfa12-e999-4a4f-9522-a73cc64315f1', '7b7665b0-c084-48b4-8559-f9f5358cf6fa', 'ff2d2570-62b8-4b42-ac85-f97901c1851f'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:04:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2a0e30ae-1335-4f52-9bae-595de41cdb04 tempest-ProjectMemberTests-1574481172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:04:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2a0e30ae-1335-4f52-9bae-595de41cdb04 tempest-ProjectMemberTests-1574481172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:04:18 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-2a0e30ae-1335-4f52-9bae-595de41cdb04 tempest-ProjectMemberTests-1574481172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:04:18 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-2a0e30ae-1335-4f52-9bae-595de41cdb04 tempest-ProjectMemberTests-1574481172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:04:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2a0e30ae-1335-4f52-9bae-595de41cdb04 tempest-ProjectMemberTests-1574481172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:04:18 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2a0e30ae-1335-4f52-9bae-595de41cdb04 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:18 devstack sudo[107833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:04:18 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:19 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2a0e30ae-1335-4f52-9bae-595de41cdb04 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.649s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:19 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-2a0e30ae-1335-4f52-9bae-595de41cdb04 tempest-ProjectMemberTests-1574481172 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:04:19 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-2a0e30ae-1335-4f52-9bae-595de41cdb04 tempest-ProjectMemberTests-1574481172 None] Deleted volume successfully.
Jul 10 13:04:19 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-2a0e30ae-1335-4f52-9bae-595de41cdb04 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-ee0c9ddf-35fa-4dd7-80ac-a457455fd611-delete_volume" released by "delete_volume" :: held 2.288s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:04:19 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2e84b84-612e-4005-8e25-4ffc8ce4d30a tempest-ProjectMemberTests-1574481172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 13:04:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-b2e84b84-612e-4005-8e25-4ffc8ce4d30a tempest-ProjectMemberTests-1574481172 None] Flow 'volume_create_manager' (68dd235b-fc77-4ee7-afce-01783e0150e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:04:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-b2e84b84-612e-4005-8e25-4ffc8ce4d30a tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5f95651-80ed-4236-b276-8e57eec29c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:04:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-b2e84b84-612e-4005-8e25-4ffc8ce4d30a tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5f95651-80ed-4236-b276-8e57eec29c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2082783997',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe79990f-ecad-491b-8b85-c0a2441ff7a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ab5735dd8284364bf17f2c244fabbf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:04:20Z,use_quota=True,user_id='7ead579763934814b4b50051ee0ea3a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:04:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-b2e84b84-612e-4005-8e25-4ffc8ce4d30a tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d561969-c6e0-48d1-8315-6da78d38b05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:04:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-b2e84b84-612e-4005-8e25-4ffc8ce4d30a tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d561969-c6e0-48d1-8315-6da78d38b05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:04:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-b2e84b84-612e-4005-8e25-4ffc8ce4d30a tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a314a76-20e8-4093-87b0-e7ebf58ca9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:04:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-b2e84b84-612e-4005-8e25-4ffc8ce4d30a tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a314a76-20e8-4093-87b0-e7ebf58ca9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe79990f-ecad-491b-8b85-c0a2441ff7a2', 'volume_name': 'volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:04:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-b2e84b84-612e-4005-8e25-4ffc8ce4d30a tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d1b6e43-fd2d-47de-98bd-39ae4f7d968b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:04:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-b2e84b84-612e-4005-8e25-4ffc8ce4d30a tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d1b6e43-fd2d-47de-98bd-39ae4f7d968b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:04:19 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-b2e84b84-612e-4005-8e25-4ffc8ce4d30a tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5a7d0ae-97f1-4e6e-8a1e-42e586a44b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:04:19 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-b2e84b84-612e-4005-8e25-4ffc8ce4d30a tempest-ProjectMemberTests-1574481172 None] Volume fe79990f-ecad-491b-8b85-c0a2441ff7a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2', 'volume_size': 1}
Jul 10 13:04:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-b2e84b84-612e-4005-8e25-4ffc8ce4d30a tempest-ProjectMemberTests-1574481172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:04:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-b2e84b84-612e-4005-8e25-4ffc8ce4d30a tempest-ProjectMemberTests-1574481172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:04:19 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-b2e84b84-612e-4005-8e25-4ffc8ce4d30a tempest-ProjectMemberTests-1574481172 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2082783997',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe79990f-ecad-491b-8b85-c0a2441ff7a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ab5735dd8284364bf17f2c244fabbf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:04:20Z,use_quota=True,user_id='7ead579763934814b4b50051ee0ea3a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 13:04:19 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-b2e84b84-612e-4005-8e25-4ffc8ce4d30a tempest-ProjectMemberTests-1574481172 None] Creating volume fe79990f-ecad-491b-8b85-c0a2441ff7a2 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 13:04:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-b2e84b84-612e-4005-8e25-4ffc8ce4d30a tempest-ProjectMemberTests-1574481172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:04:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-b2e84b84-612e-4005-8e25-4ffc8ce4d30a tempest-ProjectMemberTests-1574481172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:04:19 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-b2e84b84-612e-4005-8e25-4ffc8ce4d30a tempest-ProjectMemberTests-1574481172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:04:19 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-b2e84b84-612e-4005-8e25-4ffc8ce4d30a tempest-ProjectMemberTests-1574481172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:04:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-b2e84b84-612e-4005-8e25-4ffc8ce4d30a tempest-ProjectMemberTests-1574481172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:04:19 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-b2e84b84-612e-4005-8e25-4ffc8ce4d30a tempest-ProjectMemberTests-1574481172 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 13:04:19 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-b2e84b84-612e-4005-8e25-4ffc8ce4d30a tempest-ProjectMemberTests-1574481172 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 13:04:19 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b2e84b84-612e-4005-8e25-4ffc8ce4d30a tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:19 devstack sudo[107837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2 1073741824
Jul 10 13:04:19 devstack sudo[107837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:20 devstack sudo[107837]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b2e84b84-612e-4005-8e25-4ffc8ce4d30a tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2 1073741824" returned: 0 in 0.809s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:20 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b2e84b84-612e-4005-8e25-4ffc8ce4d30a tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:20 devstack sudo[107842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2
Jul 10 13:04:20 devstack sudo[107842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:21 devstack sudo[107842]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-b2e84b84-612e-4005-8e25-4ffc8ce4d30a tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2" returned: 0 in 0.637s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:21 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-b2e84b84-612e-4005-8e25-4ffc8ce4d30a tempest-ProjectMemberTests-1574481172 None] <== create_volume: return (1484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 13:04:21 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-b2e84b84-612e-4005-8e25-4ffc8ce4d30a tempest-ProjectMemberTests-1574481172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:04:21 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-b2e84b84-612e-4005-8e25-4ffc8ce4d30a tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5a7d0ae-97f1-4e6e-8a1e-42e586a44b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:04:21 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-b2e84b84-612e-4005-8e25-4ffc8ce4d30a tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cac7212-f1e4-4335-8271-e46cd780666c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:04:21 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-b2e84b84-612e-4005-8e25-4ffc8ce4d30a tempest-ProjectMemberTests-1574481172 None] Volume volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2 (fe79990f-ecad-491b-8b85-c0a2441ff7a2): created successfully
Jul 10 13:04:21 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-b2e84b84-612e-4005-8e25-4ffc8ce4d30a tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cac7212-f1e4-4335-8271-e46cd780666c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:04:21 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-b2e84b84-612e-4005-8e25-4ffc8ce4d30a tempest-ProjectMemberTests-1574481172 None] Flow 'volume_create_manager' (68dd235b-fc77-4ee7-afce-01783e0150e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:04:21 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-b2e84b84-612e-4005-8e25-4ffc8ce4d30a tempest-ProjectMemberTests-1574481172 None] Created volume successfully.
Jul 10 13:04:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2c71ef6e-c44f-4560-8f2a-fa9a747c04f7 tempest-ProjectMemberTests-1574481172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:04:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2c71ef6e-c44f-4560-8f2a-fa9a747c04f7 tempest-ProjectMemberTests-1574481172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:04:22 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-2c71ef6e-c44f-4560-8f2a-fa9a747c04f7 tempest-ProjectMemberTests-1574481172 None] Creating offline snapshot 5a65d45a-b5e7-46e8-9ebf-31e013da44e7 of volume fe79990f-ecad-491b-8b85-c0a2441ff7a2 {{(pid=87378) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 10 13:04:22 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[80af65c3-5c71-4d70-8a22-f70b8a8eb779]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:04:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2c71ef6e-c44f-4560-8f2a-fa9a747c04f7 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:22 devstack sudo[107845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2
Jul 10 13:04:22 devstack sudo[107845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:22 devstack sudo[107845]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2c71ef6e-c44f-4560-8f2a-fa9a747c04f7 tempest-ProjectMemberTests-1574481172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2" returned: 0 in 0.737s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:22 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2c71ef6e-c44f-4560-8f2a-fa9a747c04f7 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2.5a65d45a-b5e7-46e8-9ebf-31e013da44e7 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:22 devstack sudo[107851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2.5a65d45a-b5e7-46e8-9ebf-31e013da44e7 1G
Jul 10 13:04:22 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:23 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2c71ef6e-c44f-4560-8f2a-fa9a747c04f7 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2.5a65d45a-b5e7-46e8-9ebf-31e013da44e7 1G" returned: 0 in 0.782s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:23 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2c71ef6e-c44f-4560-8f2a-fa9a747c04f7 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2.5a65d45a-b5e7-46e8-9ebf-31e013da44e7 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:23 devstack sudo[107856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2.5a65d45a-b5e7-46e8-9ebf-31e013da44e7
Jul 10 13:04:23 devstack sudo[107856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:24 devstack sudo[107856]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2c71ef6e-c44f-4560-8f2a-fa9a747c04f7 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2.5a65d45a-b5e7-46e8-9ebf-31e013da44e7" returned: 0 in 0.664s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:24 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-2c71ef6e-c44f-4560-8f2a-fa9a747c04f7 tempest-ProjectMemberTests-1574481172 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2.5a65d45a-b5e7-46e8-9ebf-31e013da44e7 is being set with open permissions: ugo+rw
Jul 10 13:04:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2c71ef6e-c44f-4560-8f2a-fa9a747c04f7 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2.5a65d45a-b5e7-46e8-9ebf-31e013da44e7 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:24 devstack sudo[107861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2.5a65d45a-b5e7-46e8-9ebf-31e013da44e7
Jul 10 13:04:24 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:24 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2c71ef6e-c44f-4560-8f2a-fa9a747c04f7 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2.5a65d45a-b5e7-46e8-9ebf-31e013da44e7" returned: 0 in 0.640s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:24 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2c71ef6e-c44f-4560-8f2a-fa9a747c04f7 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:24 devstack sudo[107864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2.info
Jul 10 13:04:24 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:25 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2c71ef6e-c44f-4560-8f2a-fa9a747c04f7 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2.info" returned: 0 in 0.637s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:25 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-2c71ef6e-c44f-4560-8f2a-fa9a747c04f7 tempest-ProjectMemberTests-1574481172 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2.info is being set with open permissions: ugo+rw
Jul 10 13:04:25 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2c71ef6e-c44f-4560-8f2a-fa9a747c04f7 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:25 devstack sudo[107867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2.info
Jul 10 13:04:25 devstack sudo[107867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:26 devstack sudo[107867]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-2c71ef6e-c44f-4560-8f2a-fa9a747c04f7 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2.info" returned: 0 in 0.631s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:26 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-2c71ef6e-c44f-4560-8f2a-fa9a747c04f7 tempest-ProjectMemberTests-1574481172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.171s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:04:26 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-2c71ef6e-c44f-4560-8f2a-fa9a747c04f7 tempest-ProjectMemberTests-1574481172 None] Create snapshot completed successfully
Jul 10 13:04:27 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e6c33109-b3cb-455d-92f2-87958fd94300 tempest-ProjectMemberTests-1574481172 None] Acquiring lock "cinder-5a65d45a-b5e7-46e8-9ebf-31e013da44e7-delete_snapshot" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:04:27 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e6c33109-b3cb-455d-92f2-87958fd94300 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-5a65d45a-b5e7-46e8-9ebf-31e013da44e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:04:27 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e6c33109-b3cb-455d-92f2-87958fd94300 tempest-ProjectMemberTests-1574481172 None] Acquiring lock "cinder-quobyte-fe79990f-ecad-491b-8b85-c0a2441ff7a2" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:04:27 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e6c33109-b3cb-455d-92f2-87958fd94300 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-fe79990f-ecad-491b-8b85-c0a2441ff7a2" acquired by "delete_snapshot" :: waited 0.012s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:04:27 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e6c33109-b3cb-455d-92f2-87958fd94300 tempest-ProjectMemberTests-1574481172 None] Acquiring lock "cinder-quobyte-5a65d45a-b5e7-46e8-9ebf-31e013da44e7" by "_delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:04:27 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e6c33109-b3cb-455d-92f2-87958fd94300 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-5a65d45a-b5e7-46e8-9ebf-31e013da44e7" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:04:27 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-e6c33109-b3cb-455d-92f2-87958fd94300 tempest-ProjectMemberTests-1574481172 None] Deleting offline snapshot 5a65d45a-b5e7-46e8-9ebf-31e013da44e7 of volume fe79990f-ecad-491b-8b85-c0a2441ff7a2 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 10 13:04:27 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-e6c33109-b3cb-455d-92f2-87958fd94300 tempest-ProjectMemberTests-1574481172 None] snapshot_file for this snap is: volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2.5a65d45a-b5e7-46e8-9ebf-31e013da44e7 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 10 13:04:27 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a8e73a-0ba9-410d-9894-1af754486ad4]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:04:27 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e6c33109-b3cb-455d-92f2-87958fd94300 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2.5a65d45a-b5e7-46e8-9ebf-31e013da44e7 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:27 devstack sudo[107870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2.5a65d45a-b5e7-46e8-9ebf-31e013da44e7
Jul 10 13:04:27 devstack sudo[107870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:28 devstack sudo[107870]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e6c33109-b3cb-455d-92f2-87958fd94300 tempest-ProjectMemberTests-1574481172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2.5a65d45a-b5e7-46e8-9ebf-31e013da44e7" returned: 0 in 0.749s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:28 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-e6c33109-b3cb-455d-92f2-87958fd94300 tempest-ProjectMemberTests-1574481172 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 13:04:28 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[9739df3d-8ad5-4842-a2e0-f03616e7229e]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:04:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e6c33109-b3cb-455d-92f2-87958fd94300 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:28 devstack sudo[107875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2
Jul 10 13:04:28 devstack sudo[107875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:28 devstack sudo[107875]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e6c33109-b3cb-455d-92f2-87958fd94300 tempest-ProjectMemberTests-1574481172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2" returned: 0 in 0.734s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:28 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e6c33109-b3cb-455d-92f2-87958fd94300 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2.5a65d45a-b5e7-46e8-9ebf-31e013da44e7 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:28 devstack sudo[107880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2.5a65d45a-b5e7-46e8-9ebf-31e013da44e7
Jul 10 13:04:28 devstack sudo[107880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:29 devstack sudo[107880]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e6c33109-b3cb-455d-92f2-87958fd94300 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2.5a65d45a-b5e7-46e8-9ebf-31e013da44e7" returned: 0 in 0.704s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:29 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e6c33109-b3cb-455d-92f2-87958fd94300 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2.5a65d45a-b5e7-46e8-9ebf-31e013da44e7 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:29 devstack sudo[107885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2.5a65d45a-b5e7-46e8-9ebf-31e013da44e7
Jul 10 13:04:29 devstack sudo[107885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:30 devstack sudo[107885]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:30 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-e6c33109-b3cb-455d-92f2-87958fd94300 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2.5a65d45a-b5e7-46e8-9ebf-31e013da44e7" returned: 0 in 0.664s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:30 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e6c33109-b3cb-455d-92f2-87958fd94300 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-5a65d45a-b5e7-46e8-9ebf-31e013da44e7" released by "_delete_snapshot" :: held 2.936s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:04:30 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e6c33109-b3cb-455d-92f2-87958fd94300 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-fe79990f-ecad-491b-8b85-c0a2441ff7a2" released by "delete_snapshot" :: held 2.959s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:04:30 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-e6c33109-b3cb-455d-92f2-87958fd94300 tempest-ProjectMemberTests-1574481172 None] Created reservations ['b50ba5d7-68d3-48b1-887d-26e3baea176e', '1acffb5e-07bf-4d15-9d97-f043ff79c0d6', '2708995c-9dbb-4a6d-9b24-a3b6adb80ef6', '4383570b-4b10-42e5-ab0f-65d6deb1fea1'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:04:30 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-e6c33109-b3cb-455d-92f2-87958fd94300 tempest-ProjectMemberTests-1574481172 None] Delete snapshot completed successfully.
Jul 10 13:04:30 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-e6c33109-b3cb-455d-92f2-87958fd94300 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-5a65d45a-b5e7-46e8-9ebf-31e013da44e7-delete_snapshot" released by "delete_snapshot" :: held 3.094s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:04:30 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-0ecd07b3-a3e5-4064-b71c-f1b773fcb1b6 tempest-ProjectMemberTests-1574481172 None] Acquiring lock "cinder-fe79990f-ecad-491b-8b85-c0a2441ff7a2-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:04:30 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-0ecd07b3-a3e5-4064-b71c-f1b773fcb1b6 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-fe79990f-ecad-491b-8b85-c0a2441ff7a2-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:04:30 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-0ecd07b3-a3e5-4064-b71c-f1b773fcb1b6 tempest-ProjectMemberTests-1574481172 None] Acquiring lock "cinder-quobyte-fe79990f-ecad-491b-8b85-c0a2441ff7a2" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:04:30 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-0ecd07b3-a3e5-4064-b71c-f1b773fcb1b6 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-fe79990f-ecad-491b-8b85-c0a2441ff7a2" acquired by "delete_volume" :: waited 0.014s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:04:30 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d55bfd-cc33-404c-90a1-1abe377d6dde]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:04:30 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0ecd07b3-a3e5-4064-b71c-f1b773fcb1b6 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:30 devstack sudo[107925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2
Jul 10 13:04:30 devstack sudo[107925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:31 devstack sudo[107925]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0ecd07b3-a3e5-4064-b71c-f1b773fcb1b6 tempest-ProjectMemberTests-1574481172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2" returned: 0 in 0.751s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0ecd07b3-a3e5-4064-b71c-f1b773fcb1b6 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:31 devstack sudo[107930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2
Jul 10 13:04:31 devstack sudo[107930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:31 devstack sudo[107930]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:31 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0ecd07b3-a3e5-4064-b71c-f1b773fcb1b6 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-fe79990f-ecad-491b-8b85-c0a2441ff7a2" returned: 0 in 0.644s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:31 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-0ecd07b3-a3e5-4064-b71c-f1b773fcb1b6 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-fe79990f-ecad-491b-8b85-c0a2441ff7a2" released by "delete_volume" :: held 1.448s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:04:31 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-0ecd07b3-a3e5-4064-b71c-f1b773fcb1b6 tempest-ProjectMemberTests-1574481172 None] Created reservations ['b2e40a97-1723-47b1-9f9f-9bed45fd3eea', 'f4648611-2732-4869-ab9e-3fd3d7a0500f', '625936ef-703a-4324-9a10-604308eb2bd4', '75d2194c-ef59-42c4-9b74-f06058e13973'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:04:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0ecd07b3-a3e5-4064-b71c-f1b773fcb1b6 tempest-ProjectMemberTests-1574481172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:04:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0ecd07b3-a3e5-4064-b71c-f1b773fcb1b6 tempest-ProjectMemberTests-1574481172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:04:32 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-0ecd07b3-a3e5-4064-b71c-f1b773fcb1b6 tempest-ProjectMemberTests-1574481172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:04:32 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-0ecd07b3-a3e5-4064-b71c-f1b773fcb1b6 tempest-ProjectMemberTests-1574481172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:04:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-0ecd07b3-a3e5-4064-b71c-f1b773fcb1b6 tempest-ProjectMemberTests-1574481172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:04:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0ecd07b3-a3e5-4064-b71c-f1b773fcb1b6 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:32 devstack sudo[107933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:04:32 devstack sudo[107933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:32 devstack sudo[107933]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:32 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-0ecd07b3-a3e5-4064-b71c-f1b773fcb1b6 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.635s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:32 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-0ecd07b3-a3e5-4064-b71c-f1b773fcb1b6 tempest-ProjectMemberTests-1574481172 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:04:32 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-0ecd07b3-a3e5-4064-b71c-f1b773fcb1b6 tempest-ProjectMemberTests-1574481172 None] Deleted volume successfully.
Jul 10 13:04:32 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-0ecd07b3-a3e5-4064-b71c-f1b773fcb1b6 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-fe79990f-ecad-491b-8b85-c0a2441ff7a2-delete_volume" released by "delete_volume" :: held 2.270s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:04:33 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:SELECT=66,cinder:INSERT=26,cinder:UPDATE=90,cinder:DELETE=7 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 13:04:33 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d8ccf8a-6d6e-42f6-9def-4e93b3bfb705 tempest-ProjectMemberTests-1574481172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 13:04:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3d8ccf8a-6d6e-42f6-9def-4e93b3bfb705 tempest-ProjectMemberTests-1574481172 None] Flow 'volume_create_manager' (fe067bac-a563-45a6-b9ed-dcffc204c668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:04:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3d8ccf8a-6d6e-42f6-9def-4e93b3bfb705 tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5451f2a1-29be-403d-bb0e-387268b49a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:04:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3d8ccf8a-6d6e-42f6-9def-4e93b3bfb705 tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5451f2a1-29be-403d-bb0e-387268b49a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:04:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1918728662',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35c8e504-7b12-42bd-9cb2-4e89f531d819,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ab5735dd8284364bf17f2c244fabbf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:04:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:04:33Z,use_quota=True,user_id='7ead579763934814b4b50051ee0ea3a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:04:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3d8ccf8a-6d6e-42f6-9def-4e93b3bfb705 tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da92f504-8c56-4c1d-b284-b9eab8efd437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:04:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3d8ccf8a-6d6e-42f6-9def-4e93b3bfb705 tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da92f504-8c56-4c1d-b284-b9eab8efd437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:04:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3d8ccf8a-6d6e-42f6-9def-4e93b3bfb705 tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c4f3a0e-f2af-4e04-8a36-b4a9e6d10643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:04:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3d8ccf8a-6d6e-42f6-9def-4e93b3bfb705 tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c4f3a0e-f2af-4e04-8a36-b4a9e6d10643) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35c8e504-7b12-42bd-9cb2-4e89f531d819', 'volume_name': 'volume-35c8e504-7b12-42bd-9cb2-4e89f531d819', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:04:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3d8ccf8a-6d6e-42f6-9def-4e93b3bfb705 tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c822063-2e8f-4e65-871d-509e80bf5856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:04:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3d8ccf8a-6d6e-42f6-9def-4e93b3bfb705 tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c822063-2e8f-4e65-871d-509e80bf5856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:04:33 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3d8ccf8a-6d6e-42f6-9def-4e93b3bfb705 tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0840249e-3432-4301-8a35-d167014b980d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:04:33 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-3d8ccf8a-6d6e-42f6-9def-4e93b3bfb705 tempest-ProjectMemberTests-1574481172 None] Volume 35c8e504-7b12-42bd-9cb2-4e89f531d819: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35c8e504-7b12-42bd-9cb2-4e89f531d819', 'volume_size': 1}
Jul 10 13:04:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3d8ccf8a-6d6e-42f6-9def-4e93b3bfb705 tempest-ProjectMemberTests-1574481172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:04:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3d8ccf8a-6d6e-42f6-9def-4e93b3bfb705 tempest-ProjectMemberTests-1574481172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:04:33 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3d8ccf8a-6d6e-42f6-9def-4e93b3bfb705 tempest-ProjectMemberTests-1574481172 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:04:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1918728662',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35c8e504-7b12-42bd-9cb2-4e89f531d819,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ab5735dd8284364bf17f2c244fabbf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:04:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:04:33Z,use_quota=True,user_id='7ead579763934814b4b50051ee0ea3a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 13:04:33 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-3d8ccf8a-6d6e-42f6-9def-4e93b3bfb705 tempest-ProjectMemberTests-1574481172 None] Creating volume 35c8e504-7b12-42bd-9cb2-4e89f531d819 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 13:04:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3d8ccf8a-6d6e-42f6-9def-4e93b3bfb705 tempest-ProjectMemberTests-1574481172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:04:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3d8ccf8a-6d6e-42f6-9def-4e93b3bfb705 tempest-ProjectMemberTests-1574481172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:04:33 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3d8ccf8a-6d6e-42f6-9def-4e93b3bfb705 tempest-ProjectMemberTests-1574481172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:04:33 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3d8ccf8a-6d6e-42f6-9def-4e93b3bfb705 tempest-ProjectMemberTests-1574481172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:04:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3d8ccf8a-6d6e-42f6-9def-4e93b3bfb705 tempest-ProjectMemberTests-1574481172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:04:33 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3d8ccf8a-6d6e-42f6-9def-4e93b3bfb705 tempest-ProjectMemberTests-1574481172 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 13:04:33 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-3d8ccf8a-6d6e-42f6-9def-4e93b3bfb705 tempest-ProjectMemberTests-1574481172 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 13:04:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3d8ccf8a-6d6e-42f6-9def-4e93b3bfb705 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-35c8e504-7b12-42bd-9cb2-4e89f531d819 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:33 devstack sudo[107936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-35c8e504-7b12-42bd-9cb2-4e89f531d819 1073741824
Jul 10 13:04:33 devstack sudo[107936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:33 devstack sudo[107936]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3d8ccf8a-6d6e-42f6-9def-4e93b3bfb705 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-35c8e504-7b12-42bd-9cb2-4e89f531d819 1073741824" returned: 0 in 0.795s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:33 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3d8ccf8a-6d6e-42f6-9def-4e93b3bfb705 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-35c8e504-7b12-42bd-9cb2-4e89f531d819 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:34 devstack sudo[107942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-35c8e504-7b12-42bd-9cb2-4e89f531d819
Jul 10 13:04:34 devstack sudo[107942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:34 devstack sudo[107942]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-3d8ccf8a-6d6e-42f6-9def-4e93b3bfb705 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-35c8e504-7b12-42bd-9cb2-4e89f531d819" returned: 0 in 0.654s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:34 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-3d8ccf8a-6d6e-42f6-9def-4e93b3bfb705 tempest-ProjectMemberTests-1574481172 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 13:04:34 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-3d8ccf8a-6d6e-42f6-9def-4e93b3bfb705 tempest-ProjectMemberTests-1574481172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:04:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3d8ccf8a-6d6e-42f6-9def-4e93b3bfb705 tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0840249e-3432-4301-8a35-d167014b980d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35c8e504-7b12-42bd-9cb2-4e89f531d819', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:04:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3d8ccf8a-6d6e-42f6-9def-4e93b3bfb705 tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40d730be-4b16-4ef8-bf12-d5fc1b469a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:04:34 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-3d8ccf8a-6d6e-42f6-9def-4e93b3bfb705 tempest-ProjectMemberTests-1574481172 None] Volume volume-35c8e504-7b12-42bd-9cb2-4e89f531d819 (35c8e504-7b12-42bd-9cb2-4e89f531d819): created successfully
Jul 10 13:04:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3d8ccf8a-6d6e-42f6-9def-4e93b3bfb705 tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40d730be-4b16-4ef8-bf12-d5fc1b469a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:04:34 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-3d8ccf8a-6d6e-42f6-9def-4e93b3bfb705 tempest-ProjectMemberTests-1574481172 None] Flow 'volume_create_manager' (fe067bac-a563-45a6-b9ed-dcffc204c668) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:04:34 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-3d8ccf8a-6d6e-42f6-9def-4e93b3bfb705 tempest-ProjectMemberTests-1574481172 None] Created volume successfully.
Jul 10 13:04:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c318449b-8f60-43cf-b398-d40685a3ee45 tempest-ProjectMemberTests-1574481172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:04:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c318449b-8f60-43cf-b398-d40685a3ee45 tempest-ProjectMemberTests-1574481172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:04:35 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-c318449b-8f60-43cf-b398-d40685a3ee45 tempest-ProjectMemberTests-1574481172 None] Creating offline snapshot 2a7664be-ebb8-480a-9abd-ed3c7a83f21d of volume 35c8e504-7b12-42bd-9cb2-4e89f531d819 {{(pid=87378) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 10 13:04:35 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[613eb86c-9166-4adc-9f27-f53a04fdd566]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:04:35 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c318449b-8f60-43cf-b398-d40685a3ee45 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-35c8e504-7b12-42bd-9cb2-4e89f531d819 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:35 devstack sudo[107945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-35c8e504-7b12-42bd-9cb2-4e89f531d819
Jul 10 13:04:35 devstack sudo[107945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:36 devstack sudo[107945]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c318449b-8f60-43cf-b398-d40685a3ee45 tempest-ProjectMemberTests-1574481172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-35c8e504-7b12-42bd-9cb2-4e89f531d819" returned: 0 in 0.730s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c318449b-8f60-43cf-b398-d40685a3ee45 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-35c8e504-7b12-42bd-9cb2-4e89f531d819,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-35c8e504-7b12-42bd-9cb2-4e89f531d819.2a7664be-ebb8-480a-9abd-ed3c7a83f21d 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:36 devstack sudo[107956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-35c8e504-7b12-42bd-9cb2-4e89f531d819,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-35c8e504-7b12-42bd-9cb2-4e89f531d819.2a7664be-ebb8-480a-9abd-ed3c7a83f21d 1G
Jul 10 13:04:36 devstack sudo[107956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:36 devstack sudo[107956]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c318449b-8f60-43cf-b398-d40685a3ee45 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-35c8e504-7b12-42bd-9cb2-4e89f531d819,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-35c8e504-7b12-42bd-9cb2-4e89f531d819.2a7664be-ebb8-480a-9abd-ed3c7a83f21d 1G" returned: 0 in 0.768s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:36 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c318449b-8f60-43cf-b398-d40685a3ee45 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35c8e504-7b12-42bd-9cb2-4e89f531d819 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-35c8e504-7b12-42bd-9cb2-4e89f531d819.2a7664be-ebb8-480a-9abd-ed3c7a83f21d {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:36 devstack sudo[107961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35c8e504-7b12-42bd-9cb2-4e89f531d819 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-35c8e504-7b12-42bd-9cb2-4e89f531d819.2a7664be-ebb8-480a-9abd-ed3c7a83f21d
Jul 10 13:04:36 devstack sudo[107961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:37 devstack sudo[107961]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c318449b-8f60-43cf-b398-d40685a3ee45 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35c8e504-7b12-42bd-9cb2-4e89f531d819 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-35c8e504-7b12-42bd-9cb2-4e89f531d819.2a7664be-ebb8-480a-9abd-ed3c7a83f21d" returned: 0 in 0.698s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:37 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-c318449b-8f60-43cf-b398-d40685a3ee45 tempest-ProjectMemberTests-1574481172 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-35c8e504-7b12-42bd-9cb2-4e89f531d819.2a7664be-ebb8-480a-9abd-ed3c7a83f21d is being set with open permissions: ugo+rw
Jul 10 13:04:37 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c318449b-8f60-43cf-b398-d40685a3ee45 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-35c8e504-7b12-42bd-9cb2-4e89f531d819.2a7664be-ebb8-480a-9abd-ed3c7a83f21d {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:37 devstack sudo[107966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-35c8e504-7b12-42bd-9cb2-4e89f531d819.2a7664be-ebb8-480a-9abd-ed3c7a83f21d
Jul 10 13:04:37 devstack sudo[107966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:38 devstack sudo[107966]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c318449b-8f60-43cf-b398-d40685a3ee45 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-35c8e504-7b12-42bd-9cb2-4e89f531d819.2a7664be-ebb8-480a-9abd-ed3c7a83f21d" returned: 0 in 0.628s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:38 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:SELECT=70,cinder:INSERT=23,cinder:UPDATE=85,cinder:DELETE=7 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 13:04:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c318449b-8f60-43cf-b398-d40685a3ee45 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-35c8e504-7b12-42bd-9cb2-4e89f531d819.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:38 devstack sudo[107969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-35c8e504-7b12-42bd-9cb2-4e89f531d819.info
Jul 10 13:04:38 devstack sudo[107969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:38 devstack sudo[107969]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c318449b-8f60-43cf-b398-d40685a3ee45 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-35c8e504-7b12-42bd-9cb2-4e89f531d819.info" returned: 0 in 0.629s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:38 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-c318449b-8f60-43cf-b398-d40685a3ee45 tempest-ProjectMemberTests-1574481172 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-35c8e504-7b12-42bd-9cb2-4e89f531d819.info is being set with open permissions: ugo+rw
Jul 10 13:04:38 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c318449b-8f60-43cf-b398-d40685a3ee45 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-35c8e504-7b12-42bd-9cb2-4e89f531d819.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:38 devstack sudo[107972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-35c8e504-7b12-42bd-9cb2-4e89f531d819.info
Jul 10 13:04:38 devstack sudo[107972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:39 devstack sudo[107972]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-c318449b-8f60-43cf-b398-d40685a3ee45 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-35c8e504-7b12-42bd-9cb2-4e89f531d819.info" returned: 0 in 0.630s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:39 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-c318449b-8f60-43cf-b398-d40685a3ee45 tempest-ProjectMemberTests-1574481172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.165s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:04:39 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-c318449b-8f60-43cf-b398-d40685a3ee45 tempest-ProjectMemberTests-1574481172 None] Create snapshot completed successfully
Jul 10 13:04:40 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-cbda9579-6630-46ea-8468-5c172e167e88 tempest-ProjectMemberTests-1574481172 None] Acquiring lock "cinder-2a7664be-ebb8-480a-9abd-ed3c7a83f21d-delete_snapshot" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:04:40 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-cbda9579-6630-46ea-8468-5c172e167e88 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-2a7664be-ebb8-480a-9abd-ed3c7a83f21d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:04:40 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-cbda9579-6630-46ea-8468-5c172e167e88 tempest-ProjectMemberTests-1574481172 None] Acquiring lock "cinder-quobyte-35c8e504-7b12-42bd-9cb2-4e89f531d819" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:04:40 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-cbda9579-6630-46ea-8468-5c172e167e88 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-35c8e504-7b12-42bd-9cb2-4e89f531d819" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:04:40 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-cbda9579-6630-46ea-8468-5c172e167e88 tempest-ProjectMemberTests-1574481172 None] Acquiring lock "cinder-quobyte-2a7664be-ebb8-480a-9abd-ed3c7a83f21d" by "_delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:04:40 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-cbda9579-6630-46ea-8468-5c172e167e88 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-2a7664be-ebb8-480a-9abd-ed3c7a83f21d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:04:40 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-cbda9579-6630-46ea-8468-5c172e167e88 tempest-ProjectMemberTests-1574481172 None] Deleting offline snapshot 2a7664be-ebb8-480a-9abd-ed3c7a83f21d of volume 35c8e504-7b12-42bd-9cb2-4e89f531d819 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 10 13:04:40 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-cbda9579-6630-46ea-8468-5c172e167e88 tempest-ProjectMemberTests-1574481172 None] snapshot_file for this snap is: volume-35c8e504-7b12-42bd-9cb2-4e89f531d819.2a7664be-ebb8-480a-9abd-ed3c7a83f21d {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 10 13:04:40 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8cb3948-886b-49d4-803c-507ca173c1c0]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:04:40 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cbda9579-6630-46ea-8468-5c172e167e88 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-35c8e504-7b12-42bd-9cb2-4e89f531d819.2a7664be-ebb8-480a-9abd-ed3c7a83f21d {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:40 devstack sudo[107976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-35c8e504-7b12-42bd-9cb2-4e89f531d819.2a7664be-ebb8-480a-9abd-ed3c7a83f21d
Jul 10 13:04:40 devstack sudo[107976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:41 devstack sudo[107976]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cbda9579-6630-46ea-8468-5c172e167e88 tempest-ProjectMemberTests-1574481172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-35c8e504-7b12-42bd-9cb2-4e89f531d819.2a7664be-ebb8-480a-9abd-ed3c7a83f21d" returned: 0 in 0.736s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:41 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-cbda9579-6630-46ea-8468-5c172e167e88 tempest-ProjectMemberTests-1574481172 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35c8e504-7b12-42bd-9cb2-4e89f531d819(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 13:04:41 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67fd07d-05ca-4eae-b0af-36cd5aaaa22a]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:04:41 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cbda9579-6630-46ea-8468-5c172e167e88 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-35c8e504-7b12-42bd-9cb2-4e89f531d819 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:41 devstack sudo[107982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-35c8e504-7b12-42bd-9cb2-4e89f531d819
Jul 10 13:04:41 devstack sudo[107982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:42 devstack sudo[107982]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cbda9579-6630-46ea-8468-5c172e167e88 tempest-ProjectMemberTests-1574481172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-35c8e504-7b12-42bd-9cb2-4e89f531d819" returned: 0 in 0.733s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cbda9579-6630-46ea-8468-5c172e167e88 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-35c8e504-7b12-42bd-9cb2-4e89f531d819.2a7664be-ebb8-480a-9abd-ed3c7a83f21d {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:42 devstack sudo[107987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-35c8e504-7b12-42bd-9cb2-4e89f531d819.2a7664be-ebb8-480a-9abd-ed3c7a83f21d
Jul 10 13:04:42 devstack sudo[107987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:42 devstack sudo[107987]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cbda9579-6630-46ea-8468-5c172e167e88 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-35c8e504-7b12-42bd-9cb2-4e89f531d819.2a7664be-ebb8-480a-9abd-ed3c7a83f21d" returned: 0 in 0.733s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:42 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cbda9579-6630-46ea-8468-5c172e167e88 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-35c8e504-7b12-42bd-9cb2-4e89f531d819.2a7664be-ebb8-480a-9abd-ed3c7a83f21d {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:42 devstack sudo[107993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-35c8e504-7b12-42bd-9cb2-4e89f531d819.2a7664be-ebb8-480a-9abd-ed3c7a83f21d
Jul 10 13:04:42 devstack sudo[107993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:43 devstack sudo[107993]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-cbda9579-6630-46ea-8468-5c172e167e88 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-35c8e504-7b12-42bd-9cb2-4e89f531d819.2a7664be-ebb8-480a-9abd-ed3c7a83f21d" returned: 0 in 0.632s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:43 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-cbda9579-6630-46ea-8468-5c172e167e88 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-2a7664be-ebb8-480a-9abd-ed3c7a83f21d" released by "_delete_snapshot" :: held 2.916s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:04:43 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-cbda9579-6630-46ea-8468-5c172e167e88 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-35c8e504-7b12-42bd-9cb2-4e89f531d819" released by "delete_snapshot" :: held 2.936s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:04:43 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-cbda9579-6630-46ea-8468-5c172e167e88 tempest-ProjectMemberTests-1574481172 None] Created reservations ['3cd1d950-d91a-4a17-abac-d8a985722618', '244ac207-a7e9-4b66-97f1-0684debfe365', 'b8c6fbd2-579f-45e6-8def-37c2e3d7c1f9', '2403bf82-3003-4372-8e8a-d0208af4b94b'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:04:43 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-cbda9579-6630-46ea-8468-5c172e167e88 tempest-ProjectMemberTests-1574481172 None] Delete snapshot completed successfully.
Jul 10 13:04:43 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-cbda9579-6630-46ea-8468-5c172e167e88 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-2a7664be-ebb8-480a-9abd-ed3c7a83f21d-delete_snapshot" released by "delete_snapshot" :: held 3.057s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:04:43 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-25634004-8452-4c61-87ee-04f9bdfaf376 tempest-ProjectMemberTests-1574481172 None] Acquiring lock "cinder-35c8e504-7b12-42bd-9cb2-4e89f531d819-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:04:43 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-25634004-8452-4c61-87ee-04f9bdfaf376 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-35c8e504-7b12-42bd-9cb2-4e89f531d819-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:04:43 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-25634004-8452-4c61-87ee-04f9bdfaf376 tempest-ProjectMemberTests-1574481172 None] Acquiring lock "cinder-quobyte-35c8e504-7b12-42bd-9cb2-4e89f531d819" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:04:43 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-25634004-8452-4c61-87ee-04f9bdfaf376 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-35c8e504-7b12-42bd-9cb2-4e89f531d819" acquired by "delete_volume" :: waited 0.014s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:04:43 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ba3934-b4eb-4199-b46f-39405baf00a0]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:04:43 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-25634004-8452-4c61-87ee-04f9bdfaf376 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-35c8e504-7b12-42bd-9cb2-4e89f531d819 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:43 devstack sudo[107996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-35c8e504-7b12-42bd-9cb2-4e89f531d819
Jul 10 13:04:43 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:44 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-25634004-8452-4c61-87ee-04f9bdfaf376 tempest-ProjectMemberTests-1574481172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-35c8e504-7b12-42bd-9cb2-4e89f531d819" returned: 0 in 0.733s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:44 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-25634004-8452-4c61-87ee-04f9bdfaf376 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-35c8e504-7b12-42bd-9cb2-4e89f531d819 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:44 devstack sudo[108001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-35c8e504-7b12-42bd-9cb2-4e89f531d819
Jul 10 13:04:44 devstack sudo[108001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:45 devstack sudo[108001]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-25634004-8452-4c61-87ee-04f9bdfaf376 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-35c8e504-7b12-42bd-9cb2-4e89f531d819" returned: 0 in 0.632s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:45 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-25634004-8452-4c61-87ee-04f9bdfaf376 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-35c8e504-7b12-42bd-9cb2-4e89f531d819" released by "delete_volume" :: held 1.422s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:04:45 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-25634004-8452-4c61-87ee-04f9bdfaf376 tempest-ProjectMemberTests-1574481172 None] Created reservations ['c09e2fa9-5d8b-4dcc-85f4-9c4aba82e8a4', '37affa85-2420-4a13-a45a-9b819818aac3', 'a73722ae-8068-47e3-991b-cdfc75a100e3', '90cf758c-8f2b-4b48-8f2f-8ac9af4bb22a'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:04:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-25634004-8452-4c61-87ee-04f9bdfaf376 tempest-ProjectMemberTests-1574481172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:04:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-25634004-8452-4c61-87ee-04f9bdfaf376 tempest-ProjectMemberTests-1574481172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:04:45 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-25634004-8452-4c61-87ee-04f9bdfaf376 tempest-ProjectMemberTests-1574481172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:04:45 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-25634004-8452-4c61-87ee-04f9bdfaf376 tempest-ProjectMemberTests-1574481172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:04:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-25634004-8452-4c61-87ee-04f9bdfaf376 tempest-ProjectMemberTests-1574481172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:04:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-25634004-8452-4c61-87ee-04f9bdfaf376 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:45 devstack sudo[108004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:04:45 devstack sudo[108004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:45 devstack sudo[108004]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:45 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-25634004-8452-4c61-87ee-04f9bdfaf376 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.673s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:45 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-25634004-8452-4c61-87ee-04f9bdfaf376 tempest-ProjectMemberTests-1574481172 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:04:45 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-25634004-8452-4c61-87ee-04f9bdfaf376 tempest-ProjectMemberTests-1574481172 None] Deleted volume successfully.
Jul 10 13:04:45 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-25634004-8452-4c61-87ee-04f9bdfaf376 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-35c8e504-7b12-42bd-9cb2-4e89f531d819-delete_volume" released by "delete_volume" :: held 2.281s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:04:46 devstack cinder-volume[87378]: DEBUG cinder.volume.flows.manager.create_volume [None req-086dc408-6267-4107-af83-3dfd5eb6ec27 tempest-ProjectMemberTests-1574481172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87378) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 10 13:04:46 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-086dc408-6267-4107-af83-3dfd5eb6ec27 tempest-ProjectMemberTests-1574481172 None] Flow 'volume_create_manager' (70ced535-a0fe-4a8e-923b-db90a9338286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:04:46 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-086dc408-6267-4107-af83-3dfd5eb6ec27 tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24ae2288-8973-42c7-a104-3d8b997ebb3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:04:46 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-086dc408-6267-4107-af83-3dfd5eb6ec27 tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24ae2288-8973-42c7-a104-3d8b997ebb3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-258574193',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f4f6196-eb68-40b3-a46c-7ed5b7721123,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ab5735dd8284364bf17f2c244fabbf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:04:46Z,use_quota=True,user_id='7ead579763934814b4b50051ee0ea3a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:04:46 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-086dc408-6267-4107-af83-3dfd5eb6ec27 tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cf3bbd9-975d-4141-a39c-abcf286c7054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:04:46 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-086dc408-6267-4107-af83-3dfd5eb6ec27 tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cf3bbd9-975d-4141-a39c-abcf286c7054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:04:46 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-086dc408-6267-4107-af83-3dfd5eb6ec27 tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfd2bc9c-9e5c-4a03-b6bb-b3057002b47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:04:46 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-086dc408-6267-4107-af83-3dfd5eb6ec27 tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfd2bc9c-9e5c-4a03-b6bb-b3057002b47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f4f6196-eb68-40b3-a46c-7ed5b7721123', 'volume_name': 'volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:04:46 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-086dc408-6267-4107-af83-3dfd5eb6ec27 tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80381f9f-cd2f-4761-8280-4de336a97dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:04:46 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-086dc408-6267-4107-af83-3dfd5eb6ec27 tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80381f9f-cd2f-4761-8280-4de336a97dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:04:46 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-086dc408-6267-4107-af83-3dfd5eb6ec27 tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a95e8d55-cc0e-4825-addb-e7379428d34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:04:46 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-086dc408-6267-4107-af83-3dfd5eb6ec27 tempest-ProjectMemberTests-1574481172 None] Volume 8f4f6196-eb68-40b3-a46c-7ed5b7721123: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123', 'volume_size': 1}
Jul 10 13:04:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-086dc408-6267-4107-af83-3dfd5eb6ec27 tempest-ProjectMemberTests-1574481172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:04:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-086dc408-6267-4107-af83-3dfd5eb6ec27 tempest-ProjectMemberTests-1574481172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:04:46 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-086dc408-6267-4107-af83-3dfd5eb6ec27 tempest-ProjectMemberTests-1574481172 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74a0aed33a10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-10T11:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-258574193',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f4f6196-eb68-40b3-a46c-7ed5b7721123,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ab5735dd8284364bf17f2c244fabbf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T11:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T11:04:46Z,use_quota=True,user_id='7ead579763934814b4b50051ee0ea3a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a7001e9-9434-423e-8096-f17531c28d01),volume_type_id=0a7001e9-9434-423e-8096-f17531c28d01)}" {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 10 13:04:46 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-086dc408-6267-4107-af83-3dfd5eb6ec27 tempest-ProjectMemberTests-1574481172 None] Creating volume 8f4f6196-eb68-40b3-a46c-7ed5b7721123 {{(pid=87378) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 10 13:04:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-086dc408-6267-4107-af83-3dfd5eb6ec27 tempest-ProjectMemberTests-1574481172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:04:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-086dc408-6267-4107-af83-3dfd5eb6ec27 tempest-ProjectMemberTests-1574481172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:04:46 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-086dc408-6267-4107-af83-3dfd5eb6ec27 tempest-ProjectMemberTests-1574481172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:04:46 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-086dc408-6267-4107-af83-3dfd5eb6ec27 tempest-ProjectMemberTests-1574481172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:04:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-086dc408-6267-4107-af83-3dfd5eb6ec27 tempest-ProjectMemberTests-1574481172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:04:46 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-086dc408-6267-4107-af83-3dfd5eb6ec27 tempest-ProjectMemberTests-1574481172 None] Selected osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be as target Quobyte volume. {{(pid=87378) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 10 13:04:46 devstack cinder-volume[87378]: INFO cinder.volume.drivers.remotefs [None req-086dc408-6267-4107-af83-3dfd5eb6ec27 tempest-ProjectMemberTests-1574481172 None] casted to osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be
Jul 10 13:04:46 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-086dc408-6267-4107-af83-3dfd5eb6ec27 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123 1073741824 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:46 devstack sudo[108007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123 1073741824
Jul 10 13:04:46 devstack sudo[108007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:47 devstack sudo[108007]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-086dc408-6267-4107-af83-3dfd5eb6ec27 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123 1073741824" returned: 0 in 0.796s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-086dc408-6267-4107-af83-3dfd5eb6ec27 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:47 devstack sudo[108012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123
Jul 10 13:04:47 devstack sudo[108012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:47 devstack sudo[108012]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-086dc408-6267-4107-af83-3dfd5eb6ec27 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123" returned: 0 in 0.632s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:47 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-086dc408-6267-4107-af83-3dfd5eb6ec27 tempest-ProjectMemberTests-1574481172 None] <== create_volume: return (1473ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'} {{(pid=87378) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 10 13:04:47 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-086dc408-6267-4107-af83-3dfd5eb6ec27 tempest-ProjectMemberTests-1574481172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.476s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:04:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-086dc408-6267-4107-af83-3dfd5eb6ec27 tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a95e8d55-cc0e-4825-addb-e7379428d34d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123', 'volume_size': 1}' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:04:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-086dc408-6267-4107-af83-3dfd5eb6ec27 tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd0d4ffd-a066-40e0-994c-41ec81a52c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 10 13:04:47 devstack cinder-volume[87378]: INFO cinder.volume.flows.manager.create_volume [None req-086dc408-6267-4107-af83-3dfd5eb6ec27 tempest-ProjectMemberTests-1574481172 None] Volume volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123 (8f4f6196-eb68-40b3-a46c-7ed5b7721123): created successfully
Jul 10 13:04:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-086dc408-6267-4107-af83-3dfd5eb6ec27 tempest-ProjectMemberTests-1574481172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd0d4ffd-a066-40e0-994c-41ec81a52c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87378) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 10 13:04:47 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-086dc408-6267-4107-af83-3dfd5eb6ec27 tempest-ProjectMemberTests-1574481172 None] Flow 'volume_create_manager' (70ced535-a0fe-4a8e-923b-db90a9338286) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87378) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 10 13:04:47 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-086dc408-6267-4107-af83-3dfd5eb6ec27 tempest-ProjectMemberTests-1574481172 None] Created volume successfully.
Jul 10 13:04:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a379031e-e546-428d-94dc-2cc6709b10a6 tempest-ProjectMemberTests-1574481172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:04:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a379031e-e546-428d-94dc-2cc6709b10a6 tempest-ProjectMemberTests-1574481172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:04:48 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-a379031e-e546-428d-94dc-2cc6709b10a6 tempest-ProjectMemberTests-1574481172 None] Creating offline snapshot cb32cf3d-62dd-42c9-aafd-2d8f48f6ee3f of volume 8f4f6196-eb68-40b3-a46c-7ed5b7721123 {{(pid=87378) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 10 13:04:48 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a269e10e-533a-417d-9803-f1fdebcbf870]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:04:48 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a379031e-e546-428d-94dc-2cc6709b10a6 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:48 devstack sudo[108015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123
Jul 10 13:04:48 devstack sudo[108015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:49 devstack sudo[108015]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a379031e-e546-428d-94dc-2cc6709b10a6 tempest-ProjectMemberTests-1574481172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123" returned: 0 in 0.740s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:49 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a379031e-e546-428d-94dc-2cc6709b10a6 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123.cb32cf3d-62dd-42c9-aafd-2d8f48f6ee3f 1G {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:49 devstack sudo[108020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123.cb32cf3d-62dd-42c9-aafd-2d8f48f6ee3f 1G
Jul 10 13:04:49 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:50 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a379031e-e546-428d-94dc-2cc6709b10a6 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123.cb32cf3d-62dd-42c9-aafd-2d8f48f6ee3f 1G" returned: 0 in 0.785s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a379031e-e546-428d-94dc-2cc6709b10a6 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123.cb32cf3d-62dd-42c9-aafd-2d8f48f6ee3f {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:50 devstack sudo[108026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123.cb32cf3d-62dd-42c9-aafd-2d8f48f6ee3f
Jul 10 13:04:50 devstack sudo[108026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:50 devstack sudo[108026]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a379031e-e546-428d-94dc-2cc6709b10a6 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123 -F qcow2 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123.cb32cf3d-62dd-42c9-aafd-2d8f48f6ee3f" returned: 0 in 0.656s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:50 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-a379031e-e546-428d-94dc-2cc6709b10a6 tempest-ProjectMemberTests-1574481172 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123.cb32cf3d-62dd-42c9-aafd-2d8f48f6ee3f is being set with open permissions: ugo+rw
Jul 10 13:04:50 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a379031e-e546-428d-94dc-2cc6709b10a6 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123.cb32cf3d-62dd-42c9-aafd-2d8f48f6ee3f {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:50 devstack sudo[108031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123.cb32cf3d-62dd-42c9-aafd-2d8f48f6ee3f
Jul 10 13:04:50 devstack sudo[108031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:51 devstack sudo[108031]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a379031e-e546-428d-94dc-2cc6709b10a6 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123.cb32cf3d-62dd-42c9-aafd-2d8f48f6ee3f" returned: 0 in 0.618s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:51 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a379031e-e546-428d-94dc-2cc6709b10a6 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:51 devstack sudo[108034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123.info
Jul 10 13:04:51 devstack sudo[108034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:51 devstack sudo[108034]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a379031e-e546-428d-94dc-2cc6709b10a6 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123.info" returned: 0 in 0.627s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:52 devstack cinder-volume[87378]: WARNING cinder.volume.drivers.remotefs [None req-a379031e-e546-428d-94dc-2cc6709b10a6 tempest-ProjectMemberTests-1574481172 None] /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123.info is being set with open permissions: ugo+rw
Jul 10 13:04:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a379031e-e546-428d-94dc-2cc6709b10a6 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123.info {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:52 devstack sudo[108037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123.info
Jul 10 13:04:52 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:52 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a379031e-e546-428d-94dc-2cc6709b10a6 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123.info" returned: 0 in 0.618s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:52 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a379031e-e546-428d-94dc-2cc6709b10a6 tempest-ProjectMemberTests-1574481172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.118s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:04:52 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-a379031e-e546-428d-94dc-2cc6709b10a6 tempest-ProjectMemberTests-1574481172 None] Create snapshot completed successfully
Jul 10 13:04:53 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-af338e0b-86c8-4b37-9891-78cb8ba4fc16 tempest-ProjectMemberTests-1574481172 None] Acquiring lock "cinder-cb32cf3d-62dd-42c9-aafd-2d8f48f6ee3f-delete_snapshot" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:04:53 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-af338e0b-86c8-4b37-9891-78cb8ba4fc16 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-cb32cf3d-62dd-42c9-aafd-2d8f48f6ee3f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:04:53 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-af338e0b-86c8-4b37-9891-78cb8ba4fc16 tempest-ProjectMemberTests-1574481172 None] Acquiring lock "cinder-quobyte-8f4f6196-eb68-40b3-a46c-7ed5b7721123" by "delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:04:53 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-af338e0b-86c8-4b37-9891-78cb8ba4fc16 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-8f4f6196-eb68-40b3-a46c-7ed5b7721123" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:04:53 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-af338e0b-86c8-4b37-9891-78cb8ba4fc16 tempest-ProjectMemberTests-1574481172 None] Acquiring lock "cinder-quobyte-cb32cf3d-62dd-42c9-aafd-2d8f48f6ee3f" by "_delete_snapshot" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:04:53 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-af338e0b-86c8-4b37-9891-78cb8ba4fc16 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-cb32cf3d-62dd-42c9-aafd-2d8f48f6ee3f" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:04:53 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-af338e0b-86c8-4b37-9891-78cb8ba4fc16 tempest-ProjectMemberTests-1574481172 None] Deleting offline snapshot cb32cf3d-62dd-42c9-aafd-2d8f48f6ee3f of volume 8f4f6196-eb68-40b3-a46c-7ed5b7721123 {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 10 13:04:53 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-af338e0b-86c8-4b37-9891-78cb8ba4fc16 tempest-ProjectMemberTests-1574481172 None] snapshot_file for this snap is: volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123.cb32cf3d-62dd-42c9-aafd-2d8f48f6ee3f {{(pid=87378) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 10 13:04:53 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[5877da1b-fb69-41c0-9fe1-7799d0b9c742]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:04:53 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-af338e0b-86c8-4b37-9891-78cb8ba4fc16 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123.cb32cf3d-62dd-42c9-aafd-2d8f48f6ee3f {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:54 devstack sudo[108040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123.cb32cf3d-62dd-42c9-aafd-2d8f48f6ee3f
Jul 10 13:04:54 devstack sudo[108040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:54 devstack sudo[108040]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-af338e0b-86c8-4b37-9891-78cb8ba4fc16 tempest-ProjectMemberTests-1574481172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123.cb32cf3d-62dd-42c9-aafd-2d8f48f6ee3f" returned: 0 in 0.740s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:54 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.remotefs [None req-af338e0b-86c8-4b37-9891-78cb8ba4fc16 tempest-ProjectMemberTests-1574481172 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87378) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 10 13:04:54 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[065bdef6-126b-47d5-8ec1-92f56cd58f9a]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:04:54 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-af338e0b-86c8-4b37-9891-78cb8ba4fc16 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:54 devstack sudo[108045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123
Jul 10 13:04:54 devstack sudo[108045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:55 devstack sudo[108045]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-af338e0b-86c8-4b37-9891-78cb8ba4fc16 tempest-ProjectMemberTests-1574481172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123" returned: 0 in 0.725s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:55 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-af338e0b-86c8-4b37-9891-78cb8ba4fc16 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123.cb32cf3d-62dd-42c9-aafd-2d8f48f6ee3f {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:55 devstack sudo[108050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123.cb32cf3d-62dd-42c9-aafd-2d8f48f6ee3f
Jul 10 13:04:55 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:56 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-af338e0b-86c8-4b37-9891-78cb8ba4fc16 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123.cb32cf3d-62dd-42c9-aafd-2d8f48f6ee3f" returned: 0 in 0.701s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-af338e0b-86c8-4b37-9891-78cb8ba4fc16 tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123.cb32cf3d-62dd-42c9-aafd-2d8f48f6ee3f {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:56 devstack sudo[108055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123.cb32cf3d-62dd-42c9-aafd-2d8f48f6ee3f
Jul 10 13:04:56 devstack sudo[108055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:56 devstack sudo[108055]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:56 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-af338e0b-86c8-4b37-9891-78cb8ba4fc16 tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123.cb32cf3d-62dd-42c9-aafd-2d8f48f6ee3f" returned: 0 in 0.623s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:56 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-af338e0b-86c8-4b37-9891-78cb8ba4fc16 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-cb32cf3d-62dd-42c9-aafd-2d8f48f6ee3f" released by "_delete_snapshot" :: held 2.876s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:04:56 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-af338e0b-86c8-4b37-9891-78cb8ba4fc16 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-8f4f6196-eb68-40b3-a46c-7ed5b7721123" released by "delete_snapshot" :: held 2.896s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:04:56 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-af338e0b-86c8-4b37-9891-78cb8ba4fc16 tempest-ProjectMemberTests-1574481172 None] Created reservations ['a0366796-a651-4cef-8874-8227ea11db2b', '49c2b155-c252-4cf3-a026-44e3caf28ae4', '37b6b943-eeda-4015-b444-1ed43ae33bb6', '8a5df171-3514-483d-84e3-4ae48a7e9b31'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:04:56 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-af338e0b-86c8-4b37-9891-78cb8ba4fc16 tempest-ProjectMemberTests-1574481172 None] Delete snapshot completed successfully.
Jul 10 13:04:56 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-af338e0b-86c8-4b37-9891-78cb8ba4fc16 tempest-ProjectMemberTests-1574481172 None] Lock "cinder-cb32cf3d-62dd-42c9-aafd-2d8f48f6ee3f-delete_snapshot" released by "delete_snapshot" :: held 3.026s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:04:57 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-a8f2e0af-3960-43d7-be32-a70f9b9416fb tempest-ProjectMemberTests-1574481172 None] Acquiring lock "cinder-8f4f6196-eb68-40b3-a46c-7ed5b7721123-delete_volume" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:04:57 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-a8f2e0af-3960-43d7-be32-a70f9b9416fb tempest-ProjectMemberTests-1574481172 None] Lock "cinder-8f4f6196-eb68-40b3-a46c-7ed5b7721123-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:04:57 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-a8f2e0af-3960-43d7-be32-a70f9b9416fb tempest-ProjectMemberTests-1574481172 None] Acquiring lock "cinder-quobyte-8f4f6196-eb68-40b3-a46c-7ed5b7721123" by "delete_volume" {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 10 13:04:57 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-a8f2e0af-3960-43d7-be32-a70f9b9416fb tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-8f4f6196-eb68-40b3-a46c-7ed5b7721123" acquired by "delete_volume" :: waited 0.015s {{(pid=87378) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 10 13:04:57 devstack cinder-volume[87378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f994addb-a7a1-4dab-86f9-1f7ea270d670]: (4, 'qcow2') {{(pid=88478) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 10 13:04:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a8f2e0af-3960-43d7-be32-a70f9b9416fb tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:57 devstack sudo[108059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123
Jul 10 13:04:57 devstack sudo[108059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:57 devstack sudo[108059]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a8f2e0af-3960-43d7-be32-a70f9b9416fb tempest-ProjectMemberTests-1574481172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123" returned: 0 in 0.736s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:57 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a8f2e0af-3960-43d7-be32-a70f9b9416fb tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123 {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:57 devstack sudo[108064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123
Jul 10 13:04:57 devstack sudo[108064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:58 devstack sudo[108064]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a8f2e0af-3960-43d7-be32-a70f9b9416fb tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd/volume-8f4f6196-eb68-40b3-a46c-7ed5b7721123" returned: 0 in 0.634s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:58 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-a8f2e0af-3960-43d7-be32-a70f9b9416fb tempest-ProjectMemberTests-1574481172 None] Lock "cinder-quobyte-8f4f6196-eb68-40b3-a46c-7ed5b7721123" released by "delete_volume" :: held 1.423s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:04:58 devstack cinder-volume[87378]: DEBUG cinder.quota [None req-a8f2e0af-3960-43d7-be32-a70f9b9416fb tempest-ProjectMemberTests-1574481172 None] Created reservations ['a954af79-a64f-4359-b2c4-8b9f1982bd12', '1c190c4f-2a2d-43c6-a9f1-ab2d9dc81934', '4af22366-2ddd-430e-b15c-4f17f0cd68e6', '15caae3d-3a80-4355-8154-e527b2a6f511'] {{(pid=87378) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 10 13:04:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a8f2e0af-3960-43d7-be32-a70f9b9416fb tempest-ProjectMemberTests-1574481172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:04:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a8f2e0af-3960-43d7-be32-a70f9b9416fb tempest-ProjectMemberTests-1574481172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:04:58 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-a8f2e0af-3960-43d7-be32-a70f9b9416fb tempest-ProjectMemberTests-1574481172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:04:58 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-a8f2e0af-3960-43d7-be32-a70f9b9416fb tempest-ProjectMemberTests-1574481172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:04:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-a8f2e0af-3960-43d7-be32-a70f9b9416fb tempest-ProjectMemberTests-1574481172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:04:58 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a8f2e0af-3960-43d7-be32-a70f9b9416fb tempest-ProjectMemberTests-1574481172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:04:58 devstack sudo[108067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:04:58 devstack sudo[108067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:04:59 devstack sudo[108067]: pam_unix(sudo:session): session closed for user root
Jul 10 13:04:59 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-a8f2e0af-3960-43d7-be32-a70f9b9416fb tempest-ProjectMemberTests-1574481172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.634s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:04:59 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-a8f2e0af-3960-43d7-be32-a70f9b9416fb tempest-ProjectMemberTests-1574481172 None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:04:59 devstack cinder-volume[87378]: INFO cinder.volume.manager [None req-a8f2e0af-3960-43d7-be32-a70f9b9416fb tempest-ProjectMemberTests-1574481172 None] Deleted volume successfully.
Jul 10 13:04:59 devstack cinder-volume[87378]: DEBUG cinder.coordination [None req-a8f2e0af-3960-43d7-be32-a70f9b9416fb tempest-ProjectMemberTests-1574481172 None] Lock "cinder-8f4f6196-eb68-40b3-a46c-7ed5b7721123-delete_volume" released by "delete_volume" :: held 2.247s {{(pid=87378) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 10 13:05:08 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:DELETE=2,cinder:SELECT=23,cinder:INSERT=7,cinder:UPDATE=33 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 13:05:09 devstack cinder-volume[87378]: DEBUG dbcounter [-] [87378] Writing DB stats cinder:UPDATE=36,cinder:SELECT=28,cinder:INSERT=12,cinder:DELETE=3 {{(pid=87378) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 10 13:05:12 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 13:05:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 10 13:05:12 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 10 13:05:12 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be': None} {{(pid=87378) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 10 13:05:13 devstack cinder-volume[87378]: DEBUG cinder.volume.drivers.quobyte [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53374d92-35dc-4aa0-8dae-ba5175bd34be'] {{(pid=87378) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 10 13:05:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.lockutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87378) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 10 13:05:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 10 13:05:13 devstack sudo[108084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd
Jul 10 13:05:13 devstack sudo[108084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 10 13:05:13 devstack sudo[108084]: pam_unix(sudo:session): session closed for user root
Jul 10 13:05:13 devstack cinder-volume[87378]: DEBUG oslo_concurrency.processutils [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69ada21580537d8ad33f7da98289a7dd" returned: 0 in 0.632s {{(pid=87378) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 10 13:05:13 devstack cinder-volume[87378]: DEBUG cinder.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Notifying Schedulers of capabilities ... {{(pid=87378) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 10 13:05:13 devstack cinder-volume[87378]: DEBUG oslo_service.periodic_task [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] Running periodic task VolumeManager._thread_info {{(pid=87378) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 10 13:05:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread count: 28 {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 10 13:05:13 devstack cinder-volume[87378]: DEBUG cinder.volume.manager [None req-70fbc716-c5c7-4a9e-83ad-dc02ebcfb300 None None] thread info: [<_MainThread(MainThread, started 128233544536192)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128233445424704)>, <Thread(Thread-3 (stat_writer), started daemon 128233435118528)>, <Thread(Rabbit-heartbeat, started daemon 128233435718016)>, <Thread(Thread-5 (_runner), started daemon 128233432624448)>, <Thread(Thread-7 (_runner), started daemon 128233432674688)>, <Thread(fd_logger, started daemon 128233428569472)>, <Thread(privsep_reader, started daemon 128233429417088)>, <Thread(tpool_thread_0, started daemon 128233421182656)>, <Thread(tpool_thread_1, started daemon 128233412789952)>, <Thread(tpool_thread_2, started daemon 128233404397248)>, <Thread(tpool_thread_3, started daemon 128233396004544)>, <Thread(tpool_thread_4, started daemon 128233387611840)>, <Thread(tpool_thread_5, started daemon 128233379219136)>, <Thread(tpool_thread_6, started daemon 128233370826432)>, <Thread(tpool_thread_7, started daemon 128233362433728)>, <Thread(tpool_thread_8, started daemon 128233354041024)>, <Thread(tpool_thread_9, started daemon 128233345631936)>, <Thread(tpool_thread_10, started daemon 128233337222848)>, <Thread(tpool_thread_11, started daemon 128233328813760)>, <Thread(tpool_thread_12, started daemon 128233320404672)>, <Thread(tpool_thread_13, started daemon 128233311995584)>, <Thread(tpool_thread_14, started daemon 128233303586496)>, <Thread(tpool_thread_15, started daemon 128233295177408)>, <Thread(tpool_thread_16, started daemon 128233286768320)>, <Thread(tpool_thread_17, started daemon 128233278359232)>, <Thread(tpool_thread_18, started daemon 128233269950144)>, <Thread(tpool_thread_19, started daemon 128233261541056)>] {{(pid=87378) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}